Custom model

Overview

LLM Labs Custom Models allows you to integrate your own large language models (LLMs) from various providers into Datasaur's LLM Labs. This feature empowers you to leverage your specialized models alongside Datasaur's built-in capabilities.

Connect your custom model

To connect to a custom model:

1. Navigate to the Models page.

2. Click the Manage providers button.

   

   Manage providers
3. Click the Custom model button.

   

   Custom models option
4. Input your model credentials. The required credentials are:

   1. Endpoint URL: The endpoint URL of your model.

   2. API key: The API key of your model.

   3. Model name: Your desired model name to be used in LLM Labs.

   

   Add custom model dialog

If you are adding a custom model from an LLM provider like Hugging Face, you only need to input the endpoint URL without the /chat/v1/completions suffix.

1. Once you’ve added your credentials, click the Add custom model button, and your custom model will be available in LLM Labs.

   

   Models available

Managing custom model

To manage your custom model, click the three-dots icon on the model card.

From there, you can:

1. View Details

2. Try in Sandbox

3. Edit

4. Delete

View details

Once you click the View details menu, you will see the endpoint name of the model displayed in the details dialog.

View details

Try in Sandbox

Once you click the Try in Sandbox menu, you'll be automatically taken to a Sandbox project. This allows you to integrate and test the model within your specific application. Learn more about Sandbox.

Try in Sandbox

Edit custom model

Once you click on the Edit menu, you will be able to modify the endpoint name, API key, and model name. Once you've updated the model credentials, click the Edit custom model button to save your changes.

Edit model

Delete custom model

Once you click on the Delete menu, you will be able to delete your model from LLM Labs. Confirm the deletion by clicking the Delete custom model button.

Delete custom model