# Models

## Overview

The **Models catalog** page allows you to explore and deploy LLMs. It includes over 200 base models, so you can pick one that fits your needs. You can connect your own models by adding credentials from our supported providers, or try **Direct Access LLMs** that consist of popular models you can use right away in Datasaur without entering credentials.

### Explore the models

1. Go to the **Models catalog** page under LLM Labs menu.

   <figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-c3376dd09bbe06ea742563483775a4f8d4913886%2FModels%20-%20main%20page%20-%20sidebar.png?alt=media" alt=""><figcaption></figcaption></figure>
2. Navigate to the **Explore** tab.

   <figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-876f0c60cf703f00545706c4a82fe286170eb9c6%2FModels%20-%20Explore.png?alt=media" alt=""><figcaption></figcaption></figure>

### Integrate LLM providers

You can also integrate with several LLM providers, such as Amazon SageMaker JumpStart, Amazon Bedrock, Azure OpenAI, OpenAI, and Google Vertex AI, through the **Manage providers** button.

<figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-cadc239a2dba3daaf8ec7df6be5af622d2a38531%2FModels%20-%20Manage%20providers%20dialog%20-%20initial.png?alt=media" alt=""><figcaption><p>Manage providers dialog</p></figcaption></figure>

To connect a provider, you need to set up and add your credentials in Datasaur.

<figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-371f27a089cd7292a3bf8a108a6c0955f3b3fdaf%2FModels%20-%20Manage%20providers%20dialog%20-%20Amazon%20SageMaker%20JumpStart%20-%20Initial.png?alt=media" alt=""><figcaption><p>Input the credentials</p></figcaption></figure>

Once you connect a provider, some will fetch your models so you can use them right away, while others require you to deploy the model first.

<figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-869f270c9deb0784125eed9da3afc738c086fc67%2FModels%20-%20Manage%20providers%20dialog%20-%20SageMaker%20connected.png?alt=media" alt=""><figcaption></figcaption></figure>

### Deploy the models

Here’s how to deploy a model from Amazon SageMaker JumpStart. Click **Deploy model**, then in the dialog that appears, enter an endpoint name and choose your preferred instance type.

<figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-2c33a2fd48a1abc9982b23e272defaa397435b5b%2FModels%20-%20Amazon%20Sagemaker%20-%20Deploy%20model%20dialog%20-%20meta%20llama%203.2%201B.png?alt=media" alt=""><figcaption><p>Deploy model dialog</p></figcaption></figure>

After you click **Deploy model**, the deployment may take several minutes. You can track its progress in the model status at the top right.

<figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-7160a2044a8cbc2e72835825025bf860fa0a0627%2FModels%20-%20Deployment%20notification%20-%20deploying.png?alt=media" alt=""><figcaption><p>Deploying process</p></figcaption></figure>

After deployment is complete, the model status will change to **Available**, and you can start using the model right away.

<figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-6fd3bd25265512a192bc5e037b07cae6ced745e0%2FModels%20-%20Deployment%20notification%20-%20deployed.png?alt=media" alt=""><figcaption><p>Deployed model</p></figcaption></figure>

## Available models

The **Available** tab shows all deployed models and lets you deploy or undeploy them. It also lists our **Direct Access LLMs** —popular models you can use right away without having to add credentials.

<figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-45dd2a316f40ce983ef92da48518efe6949cd406%2FModels%20-%20Direct%20access%20LLMs.png?alt=media" alt=""><figcaption></figcaption></figure>

{% hint style="info" %}
Every new model that you deploy in the LLM providers will be synced to Datasaur, and you can use it right away in Datasaur. If the models you just deployed haven't appeared on **Available** tab, you can click the **Sync models** button.
{% endhint %}

#### Undeploy models

To undeploy a model, you can click the three dots on the model card and select **Undeploy model**.

<figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-ef868c9d39cf284ce5a8a3dab62522307d9afc61%2FModels%20-%20private%20credentials%20-%20more%20menu.png?alt=media" alt=""><figcaption><p>Undeploy models</p></figcaption></figure>

The model status will be changed into unavailable once you click the **Undeploy model** button.

<figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-fc11dc812e04c0894b3e377383984f7014f0b450%2FModels%20-%20private%20credentials%20-%20not%20deployed.png?alt=media" alt=""><figcaption><p>Unavailable models</p></figcaption></figure>

### Disconnect LLM providers

To disconnect a provider, click **Manage providers**, then **View details** for the provider you want to disconnect. In the dialog that opens, click **Disconnect** at the bottom left.

<figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-aa2f77ac206514e873ae79b9294be0ee868a72d3%2FModels%20-%20Sagemaker%20-%20provider%20details.png?alt=media" alt=""><figcaption><p>Disconnect dialog</p></figcaption></figure>

Once you’ve clicked the **Disconnect** button, the providers will be disconnected from your workspace.
