BlogPlaygroundAPI Docs

Vertex AI

Overview

Vertex AI integration in LLM Labs lets you connect and manage your Vertex AI models, making them available for exploration, evaluation, and deployment within LLM Labs.

Setup

  1. Click Manage providers then select Google Vertex AI in the dialog that appears.

  2. Insert your client email, private key, project ID, and region. To access the region:

    1. From Google Cloud Console:

      • Go to Vertex AI section

      • Look at the region selector in the top navigation bar

      • Or check where your Vertex AI resources are deployed

    2. From Project Settings:

      • Go to "IAM & Admin" > "Settings"

      • Look for "Location" or "Region"

Use the correct region format as specified in Vertex AI locations, for example, us-east5.

  1. Once you have connected Vertex AI to LLM Labs, you will see a list of available LLMs that you have already deployed. You can immediately use these models within LLM Labs.

Every new model that you deploy in Vertex AI will be synced to Datasaur, and you can use it right away in Datasaur. If the models you just deployed haven't appeared on Datasaur, you can click Sync models.

Availability

The models will be accessible to all workspace members for use in their projects. Additionally, only the Admin can remove the Vertex AI provider from the workspace.

Disconnect

  1. Click Manage providers, then click View details on Google Vertex AI provider.

  2. In the dialog that opens, click Disconnect at the bottom left.

  3. All Vertex AI models linked to that credentials will be removed from the workspace.

Last updated