Amazon Bedrock

Overview

Amazon Bedrock integration allows you to bring your own Amazon Bedrock API Key and models into LLM Labs. This feature enhances security compliance by giving you complete control and privacy over your data. By using your own Large Language Models (LLMs), you can ensure that sensitive information remains within your organization's ecosystem.

Setup

1. Navigate to the Models page under LLM Labs menu.

2. Open My models tab, and click the Manage providers button.

   
3. Choose Amazon Bedrock as the provider, and insert your external ID, Role ARN, and Region.

   

Learn more on how to create a role ARN.

4. Once you have connected your Amazon Bedrock Models to LLM Labs, you will see a list of available LLM Models that you have already deployed in Amazon Bedrock. You can immediately use these models within LLM Labs.

   

Every new model that you deploy in Amazon Bedrock will be synced to Datasaur, and you can use it right away in Datasaur. If the models you just deployed haven't appeared on Datasaur, you can click Sync models.

Create a Role ARN for Amazon Bedrock

1. Open the IAM console at https://console.aws.amazon.com/iam/.

2. Choose Roles and then choose Create role.

3. Choose Custom trust policy in the trusted entity type section.

   
4. Paste the following configurations in custom trust policy. Don't forget to replace the ExternalID.

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Effect": "Allow",
            "Principal": {
                "AWS": "682361690817"
            },
            "Action": "sts:AssumeRole",
            "Condition": {
                "StringEquals": {
                    "sts:ExternalId": "<externalID>"
                }
            }
        },
        {
            "Effect": "Allow",
            "Principal": {
                "Service": "bedrock.amazonaws.com"
            },
            "Action": "sts:AssumeRole"
        }
    ]
}

After that, click on Next.

5. In the Add permissions section, pick the policy AmazonBedrockFullAccess. Then, click on Next.

   
6. Enter a Role name and a Description (optional).

7. Choose Create role.

8. After that, back on the Roles page, click on your newly created role.

9. Copy the Role ARN from the page and paste it in Amazon Bedrock manage provider dialog. And click Add Credentials to connect.

Supported Amazon Bedrock models

Datasaur supports a wide range of models available in Amazon Bedrock. You can find the list of supported models here: Amazon Bedrock Models.

Currently, Datasaur only supports text generation Large Language Models.

Additionally, you can bring your own fine-tuned models from Amazon Bedrock into Datasaur, allowing for greater customization and performance tailored to your specific use cases. Learn more about fine-tuning.

Disconnect Amazon Bedrock

To disconnect Amazon Bedrock from Datasaur, follow these steps:

1. Go to the Models page under the LLM Labs menu.

2. Open My models tab and select Manage providers.

   
3. Click View details next to the Amazon Bedrock provider.

   
4. Click Disconnect and confirm the action.

   

Availability

The models will be accessible to all workspace members for use in their projects. Additionally, only the Admin can remove the Amazon Bedrock provider from the workspace.