Models
Last updated
Last updated
Model Management is designed to streamline the process of selecting, using, and deploying LLM models. With a diverse range of over 200 foundation models at your disposal, you can find the perfect fit for your specific use case without the need for extensive training. This documentation provides detailed instructions on how to utilize and configure models in your LLM projects.
Navigate to the Models page under LLM Labs menu.
Here you can see a lot of models that you can use.
You can also integrate into several LLMs provider such as Amazon SageMaker JumpStart, OpenAI, and Azure OpenAI by clicking the Manage providers button.
To integrate the LLMs provider, use will need to set up and add their providers credentials in Datasaur.
Once the provider is integrated, you can deploy and use their own models in Datasaur.
After integrating the LLMs provider, you can deploy your own model in Datasaur. To deploy the model, click on Deploy model. The Deploy model dialog will be shown. In this dialog, you need to input your specific endpoint name.
Once you've clicked the Deploy model button, you will need to wait several minutes for deployment to complete. You can monitor the latest status of the deployment through model status information at the top right.
After the deployment process is complete, the model status will change to Available in the status information.
The My Models page allows you to view all deployed models and provides functionality for deploying and undeploying models.
By default, Datasaur already provides you with Direct Access LLMs that are ready to use on this My models page.
Every new model that you deploy in the LLMs providers will be synced to Datasaur, and you can use it right away in Datasaur. If the models you just deployed haven't appeared on My models page, you can click the Sync models button.
To undeploy a model, you can click the three dots on the model card and select the Undeploy model button.
The model status will be changed into unavailable once you click the Undeploy model button.
You can disconnect the LLMs provider by clicking the Manage providers button. The Manage providers dialog will be shown, and you can see the providers that you have already connected.
Click the See details button, and you will see the Disconnect button in the bottom left of the dialog.
Once you’ve clicked the Disconnect button, the providers will be disconnected from your workspace.
