Models

Overview

Model Management is designed to streamline the process of selecting, using, and deploying LLM models. With a diverse range of over 200 foundation models at your disposal, you can find the perfect fit for your specific use case without the need for extensive training. This documentation provides detailed instructions on how to utilize and configure models in your LLM projects.

Explore the models

Navigate to the Models page under LLM Labs menu.

Navigate to Models page

Here you can see a lot of models that you can use.

Integrating LLMs Provider

You can also integrate into several LLMs provider such as Amazon SageMaker JumpStart, OpenAI, and Azure OpenAI by clicking the Manage providers button.

Manage providers dialog

To integrate the LLMs provider, use will need to set up and add their providers credentials in Datasaur.

Input the credentials

Once the provider is integrated, you can deploy and use their own models in Datasaur.

Providers connected

Deploy the models

After integrating the LLMs provider, you can deploy your own model in Datasaur. To deploy the model, click on Deploy model. The Deploy model dialog will be shown. In this dialog, you need to input your specific endpoint name.

Deploy model dialog

Once you've clicked the Deploy model button, you will need to wait several minutes for deployment to complete. You can monitor the latest status of the deployment through model status information at the top right.

Deploying process

After the deployment process is complete, the model status will change to Available in the status information.

Deployed model

My models

The My Models page allows you to view all deployed models and provides functionality for deploying and undeploying models.

By default, Datasaur already provides you with Direct Access LLMs that are ready to use on this My models page.

My models page

Every new model that you deploy in the LLMs providers will be synced to Datasaur, and you can use it right away in Datasaur. If the models you just deployed haven't appeared on My models page, you can click the Sync models button.

Undeploying models

To undeploy a model, you can click the three dots on the model card and select the Undeploy model button.

Undeploy models

The model status will be changed into unavailable once you click the Undeploy model button.

Unavailable models

Disconnect the LLMs provider

You can disconnect the LLMs provider by clicking the Manage providers button. The Manage providers dialog will be shown, and you can see the providers that you have already connected.

Click the See details button, and you will see the Disconnect button in the bottom left of the dialog.

Disconnect dialog

Once you’ve clicked the Disconnect button, the providers will be disconnected from your workspace.

Providers disconnected