# Vertex AI

## Overview

Vertex AI integration in LLM Labs lets you connect and manage your Vertex AI models, making them available for exploration, evaluation, and deployment within LLM Labs.

## Setup

1. Click **Manage providers** then select **Google Vertex AI** in the dialog that appears.

   <figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-cadc239a2dba3daaf8ec7df6be5af622d2a38531%2FModels%20-%20Manage%20providers%20dialog%20-%20initial.png?alt=media" alt=""><figcaption></figcaption></figure>
2. Insert your client email, private key, project ID, and region. To access the region:

   1. From Google Cloud Console:
      * Go to Vertex AI section
      * Look at the region selector in the top navigation bar
      * Or check where your Vertex AI resources are deployed
   2. From Project Settings:
      * Go to "IAM & Admin" > "Settings"
      * Look for "Location" or "Region"

   <figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-4697b648dfa0bc73ab4a6804dd07d80d7d83e75b%2FModels%20-%20Manage%20providers%20dialog%20-%20Google%20Vertex%20AI%20-%20initial.png?alt=media" alt=""><figcaption></figcaption></figure>

{% hint style="info" %}
Use the correct region format as specified in [Vertex AI locations](https://cloud.google.com/vertex-ai/docs/general/locations), for example, `us-east5`.
{% endhint %}

3. Once you have connected Vertex AI to LLM Labs, you will see a list of available LLMs that you have already deployed. You can immediately use these models within LLM Labs.

   <figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-406b0a05d2b18416501ddf08212228d953dfcbf0%2FModels%20-%20Manage%20providers%20dialog%20-%20Google%20Vertex%20AI%20-%20models%20retrieved.png?alt=media" alt=""><figcaption></figcaption></figure>

{% hint style="info" %}
Every new model that you deploy in Vertex AI will be synced to Datasaur, and you can use it right away in Datasaur. If the models you just deployed haven't appeared on Datasaur, you can click **Sync models**.
{% endhint %}

### **Availability**

The models will be accessible to all workspace members for use in their projects. Additionally, only the **Admin** can remove the Vertex AI provider from the workspace.

## **Disconnect** <a href="#disconnect" id="disconnect"></a>

1. Click **Manage providers**, then click **View details** on Google Vertex AI provider.

   <figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-154695351f03036434044ec4b101e8c344e2a0d3%2FModels%20-%20Manage%20providers%20dialog%20-%20Google%20Vertex%20AI%20-%20connected.png?alt=media" alt=""><figcaption></figcaption></figure>
2. In the dialog that opens, click **Disconnect** at the bottom left.

   <figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-e2d099635c12612e8f0101bfacd6f83493ac5800%2FModels%20-%20Manage%20providers%20dialog%20-%20Google%20Vertex%20AI%20-%20provider%20details.png?alt=media" alt=""><figcaption></figcaption></figure>
3. All Vertex AI models linked to that credentials will be removed from the workspace.
