Amazon Bedrock

Overview

Amazon Bedrock integration in LLM Labs lets you connect your own models to Datasaur, making them available for evaluation and deployment within LLM Labs. It enhances security compliance by giving you complete control and privacy over your data. By using your own LLMs, you can ensure that sensitive information remains within your organization's ecosystem.

Setup

Connect to Amazon SageMaker Jumpstart

1. Select Amazon Bedrock.

   
2. Enter your external ID, Role ARN, and Region.

   

1. Once you have connected Amazon Bedrock to LLM Labs, you will see a list of available LLMs that you have already deployed. You can immediately use these models within LLM Labs.

   

Create a Role ARN for Amazon Bedrock

1. Open the IAM console at https://console.aws.amazon.com/iam/.

2. Choose Roles and then choose Create role.

3. Choose Custom trust policy in the trusted entity type section.

   
4. Paste the following configurations in custom trust policy. Don't forget to replace the ExternalID. After that, click Next.

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Effect": "Allow",
            "Principal": {
                "AWS": "682361690817"
            },
            "Action": "sts:AssumeRole",
            "Condition": {
                "StringEquals": {
                    "sts:ExternalId": "<externalID>"
                }
            }
        },
        {
            "Effect": "Allow",
            "Principal": {
                "Service": "bedrock.amazonaws.com"
            },
            "Action": "sts:AssumeRole"
        }
    ]
}

1. In the Add permissions section, pick the policy AmazonBedrockFullAccess. After that, click Next.

   
2. Enter a Role name and a Description (optional).

3. Choose Create role.

4. After that, back to the Roles page, and click on your newly created role.

5. Copy the Role ARN from the page and paste it in Amazon Bedrock dialog in Datasaur. Then, click Add Credentials to connect.

Supported Amazon Bedrock models

Datasaur supports a wide range of models available in Amazon Bedrock. You can find the list of supported models here: Amazon Bedrock Models.

Additionally, you can bring your own fine-tuned models from Amazon Bedrock into Datasaur, allowing for greater customization and performance tailored to your specific use cases. Learn more about fine-tuning.

Disconnect Amazon Bedrock

To disconnect Amazon Bedrock from Datasaur, follow these steps:

1. Click Manage providers, then click View details on Amazon SageMaker JumpStart provider.

   
2. In the dialog that opens, click Disconnect at the bottom left.

   

Availability

The models will be accessible to all workspace members for use in their projects. Additionally, only the Admin can remove the Amazon Bedrock provider from the workspace.