Amazon SageMaker JumpStart

Overview

Amazon SageMaker JumpStart integration in LLM Labs lets you connect and manage your own models and deployed new ones in Datasaur, making them available for evaluation and deployment within LLM Labs.

Setup

Connect to Amazon SageMaker Jumpstart

1. Select Amazon SageMaker JumpStart.

   
2. An External ID is generated each time the dialog is opened. This ID will be used later when creating the Role ARN. To avoid regenerating a new External ID, do not close the dialog during setup—otherwise, you’ll need to create the Role ARN with a different External ID.

3. You can start by selecting the Region attribute. We'll get back to this window later. Let's leave it for now.

   

Create a Role ARN for Amazon SageMaker JumpStart

Create a role which will be assumed by Datasaur to access your Amazon SageMaker Jumpstart.

1. Open the IAM console at https://console.aws.amazon.com/iam/.

2. Choose Roles and then choose Create role.

3. Choose Custom trust policy in the trusted entity type section.

1. Paste the following configurations in custom trust policy. Don't forget to replace the ExternalID. After that, click Next.

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Effect": "Allow",
            "Principal": {
                "AWS": "682361690817"
            },
            "Action": "sts:AssumeRole",
            "Condition": {
                "StringEquals": {
                    "sts:ExternalId": "<externalID>"
                }
            }
        },
        {
            "Effect": "Allow",
            "Principal": {
                "Service": "sagemaker.amazonaws.com"
            },
            "Action": "sts:AssumeRole"
        }
    ]
}

1. In the Add permissions section, pick the policy AmazonSageMakerFullAccess. Then, click on Next.

1. Enter a Role name and a Description (optional).

2. Choose Create role.

3. After that, back on the Roles page, click on your newly created role.

4. Copy the Role ARN from the page and paste it in Amazon SageMaker Jumpstart manage provider dialog. Then, click Add Credentials to connect.

Disconnect

1. Click Manage providers, then click View details on Amazon SageMaker JumpStart provider.

   
2. In the dialog that opens, click Disconnect at the bottom left.

   
3. All Azure SageMaker JumpStart models linked to that credentials will be removed from the workspace.