> For the complete documentation index, see [llms.txt](https://docs.datasaur.ai/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.datasaur.ai/llm-projects/models/amazon-bedrock.md).

# Amazon Bedrock

## Overview

Amazon Bedrock integration in LLM Labs lets you connect your own models to Datasaur, making them available for evaluation and deployment within LLM Labs. It enhances security compliance by giving you complete control and privacy over your data. By using your own LLMs, you can ensure that sensitive information remains within your organization's ecosystem.

## Setup

### Connect to Amazon Bedrock <a href="#connect-to-amazon-sagemaker-jumpstart" id="connect-to-amazon-sagemaker-jumpstart"></a>

1. Select **Amazon Bedrock.**

   <figure><img src="/files/nOG9tl14VjkPnxbmYUsO" alt=""><figcaption></figcaption></figure>
2. Enter your external ID, Role ARN, and Region. Learn more on [how to create a role ARN](#create-a-role-arn-for-amazon-bedrock).

   <figure><img src="/files/9Dbyv0MpmFL7Xea3by1a" alt=""><figcaption></figcaption></figure>
3. Once you have connected Amazon Bedrock to LLM Labs, you will see a list of available LLMs that you have already deployed. You can immediately use these models within LLM Labs.

   <figure><img src="/files/llwBqa2NHuxfrT8cT5vb" alt=""><figcaption></figcaption></figure>

{% hint style="info" %}
Every new model that you deploy in Amazon Bedrock will be synced to Datasaur, and you can use it right away in Datasaur. If the models you just deployed haven't appeared on Datasaur, you can click **Sync models**.
{% endhint %}

### Create a Role ARN for Amazon Bedrock

1. Open the [IAM console](https://console.aws.amazon.com/iam/).
2. Go to **Roles** and click **Create role**.
3. Choose **Custom trust policy** in the trusted entity type section.

   <figure><img src="/files/zsN9cx7lQZgyyE4dn5yK" alt=""><figcaption></figcaption></figure>
4. Paste the following configurations in custom trust policy. Don't forget to replace the **ExternalID**. After that, click **Next**.

```json
{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Effect": "Allow",
            "Principal": {
                "AWS": "682361690817"
            },
            "Action": "sts:AssumeRole",
            "Condition": {
                "StringEquals": {
                    "sts:ExternalId": "<externalID>"
                }
            }
        },
        {
            "Effect": "Allow",
            "Principal": {
                "Service": "bedrock.amazonaws.com"
            },
            "Action": "sts:AssumeRole"
        }
    ]
}
```

5. In the **Add permissions** section, select the **AmazonBedrockFullAccess** policy. After that, click **Next**.

   <figure><img src="/files/GY4SyxgZTIav8cDEp5dX" alt=""><figcaption></figcaption></figure>
6. Enter a **Role name** and a **Description** (optional).
7. Click **Create role**.
8. After that, go back to the **Roles** page, and click on your newly created role.
9. Copy the **Role ARN** from the page and paste it in the **Amazon Bedrock** dialog in Datasaur. Then, click **Add Credentials** to connect.

## Supported Amazon Bedrock models

Datasaur supports a wide range of models available in Amazon Bedrock. You can find the list of supported models here: [Amazon Bedrock Models](https://docs.aws.amazon.com/bedrock/latest/userguide/models-supported.html).

{% hint style="info" %}
Currently, Datasaur only supports text generation LLMs.
{% endhint %}

Additionally, you can bring your own **fine-tuned models** from Amazon Bedrock into Datasaur, allowing for greater customization and performance tailored to your specific use cases. Learn more about [fine-tuning](/llm-projects/models/fine-tuning.md).

## Disconnect Amazon Bedrock

To disconnect Amazon Bedrock from Datasaur, follow these steps:

1. Click **Manage providers**, then click **View details** on Amazon Bedrock provider.

   <figure><img src="/files/YbvNuvNznVHTSRoHSdhG" alt=""><figcaption></figcaption></figure>
2. In the dialog that opens, click **Disconnect** at the bottom left.

   <figure><img src="/files/E8L8cjzcCp9jnp2FuB7d" alt=""><figcaption></figcaption></figure>

## Availability

The models will be accessible to all workspace members for use in their projects. Additionally, only the **Admin** can remove the Amazon Bedrock provider from the workspace.


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter:

```
GET https://docs.datasaur.ai/llm-projects/models/amazon-bedrock.md?ask=<question>&goal=<endgoal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.