# Amazon SageMaker JumpStart

## Overview

Amazon SageMaker JumpStart integration in LLM Labs lets you connect and manage your own models and deployed new ones in Datasaur, making them available for evaluation and deployment within LLM Labs.

## Setup

### Connect to Amazon SageMaker Jumpstart

1. Select **Amazon SageMaker JumpStart.**

   <figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-cadc239a2dba3daaf8ec7df6be5af622d2a38531%2FModels%20-%20Manage%20providers%20dialog%20-%20initial.png?alt=media" alt=""><figcaption></figcaption></figure>
2. An External ID is generated each time the dialog is opened. This ID will be used later when creating the Role ARN. To avoid regenerating a new External ID, **do not close the dialog during setup**—otherwise, you’ll need to create the Role ARN with a different External ID.
3. You can start by selecting the **Region** attribute. We'll get back to this window later. Let's leave it for now.

   <figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-371f27a089cd7292a3bf8a108a6c0955f3b3fdaf%2FModels%20-%20Manage%20providers%20dialog%20-%20Amazon%20SageMaker%20JumpStart%20-%20Initial.png?alt=media" alt=""><figcaption></figcaption></figure>

### Create a Role ARN for Amazon SageMaker JumpStart

Create a role which will be assumed by Datasaur to access your Amazon SageMaker Jumpstart.

1. Open the IAM console at <https://console.aws.amazon.com/iam/>.
2. Choose **Roles** and then choose **Create role**.
3. Choose **Custom trust policy** in the trusted entity type section.

<figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-f375cffe997e9bf727758942d2f1d0c303de81be%2FModels%20-%20Manage%20providers%20dialog%20-%20SageMaker%20-%20select%20trusted%20entity.png?alt=media" alt=""><figcaption><p>Custom Trust Policy</p></figcaption></figure>

4. Paste the following configurations in custom trust policy. Don't forget to replace the **ExternalID.** After that, click **Next**.

```
{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Effect": "Allow",
            "Principal": {
                "AWS": "682361690817"
            },
            "Action": "sts:AssumeRole",
            "Condition": {
                "StringEquals": {
                    "sts:ExternalId": "<externalID>"
                }
            }
        },
        {
            "Effect": "Allow",
            "Principal": {
                "Service": "sagemaker.amazonaws.com"
            },
            "Action": "sts:AssumeRole"
        }
    ]
}
```

5. In the **Add permissions** section, pick the policy **AmazonSageMakerFullAccess**. Then, click on **Next**.

<figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-b12e8c2241faac0bad4eab6a60c2bfb3c16d975b%2FModels%20-%20Manage%20providers%20dialog%20-%20SageMaker%20-%20Add%20permissions.png?alt=media" alt=""><figcaption></figcaption></figure>

6. Enter a **Role name** and a **Description** (optional).
7. Choose **Create role**.
8. After that, back on the Roles page, click on your newly created role.
9. Copy the **Role ARN** from the page and paste it in Amazon SageMaker Jumpstart manage provider dialog. Then, click **Add Credentials** to connect.

## **Disconnect**

1. Click **Manage providers**, then click **View details** on Amazon SageMaker JumpStart provider.

   <figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-869f270c9deb0784125eed9da3afc738c086fc67%2FModels%20-%20Manage%20providers%20dialog%20-%20SageMaker%20connected.png?alt=media" alt=""><figcaption></figcaption></figure>
2. In the dialog that opens, click **Disconnect** at the bottom left.

   <figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-aa2f77ac206514e873ae79b9294be0ee868a72d3%2FModels%20-%20Sagemaker%20-%20provider%20details.png?alt=media" alt=""><figcaption></figcaption></figure>
3. All Azure SageMaker JumpStart models linked to that credentials will be removed from the workspace.
