LLM Labs (beta)
Enable your integration with models from Datasaur LLM Lab
Last updated
Enable your integration with models from Datasaur LLM Lab
Last updated
Supported Labeling Types: Span Labeling
, Row Labeling
, Document Labeling
Easily integrate with models from Datasaur's LLM Labs. If you've already tested and deployed your experiment in the Datasaur LLM Labs Sandbox, we're here to help! Our integration allows you to use your deployed LLM Sandbox from Datasaur LLM Labs to enhance your labeling process.
To begin using ML-Assisted Labeling with LLM Labs, you first need to create and deploy a Sandbox. You can see to learn more details about how to deploy an LLM Labs Sandbox.
We have label/question set of Category
and Suggestion
.
Therefore, the expected output or result from the LLM Labs Sandbox should be something like this
To generate a correct response in JSON object format from the LLM, you need to adjust the user instruction prompt so that the response returns in the expected format. Here are some example prompts you can try:
Besides directly adjusting the user instruction prompt in LLM Labs, if you are using the OpenAI model, you can also set advanced hyperparameters in the Hyperparameter configurations.
Here's the example of the Advance hyperparameters:
You can focus adjusting the property
and required
object to match with your label or question set.
Follow these steps to access your deployed LLM Labs Sandbox (from Datasaur LLM Labs) on your ML Assisted Labelling:
Create a custom project for Row Labeling, Span Labeling or Document Labeling.
Click "Manage Extension" on your right bar.
Pop Up Manage Extension will appear and you can enable the Datasaur ML Assisted.
Once enable it, select "LLM Labs" as provider and you will see the following menu:
Target text: the column(s) of your targeted data for this ML assistance are based on.
Target question: the column(s) you wish to answer.
Target pages: define specific page(s) you want to extract from a document.
After setting up the above options, simply click “Predict Labels” to start predicting and obtaining labels from your deployed LLM Application from Datasaur LLM Labs.
In the LLM Labs Sandbox, where you configure your model application, you can click the gear icon in the application to open the Hyperparameter configurations. From there, you can add advanced hyperparameters following .
LLM application: your deployed LLM Sandbox name from .
API token: your API keys to access the deployed LLM Application. You can visit and go to `Settings` on the left sidebar, then select the `API Keys` menu.