Azure OpenAI

Overview

The Azure OpenAI integration feature in Datasaur's LLM Labs allows you to seamlessly integrate your own Large Language Models (LLMs) into the platform. This functionality provides three key benefits:

1. Integrating your own LLMs: This feature enables you to bring your own models into LLM Labs. Datasaur will retrieve all available Azure OpenAI models based on your credentials. Once connected, these models will be accessible to all workspace members.

2. Protect your data: By using your own LLMs, you can ensure better security compliance, providing you with complete control and privacy over your data.

3. Streamlined workflow: Access your preferred models directly within Datasaur's user-friendly interface, simplifying your LLM workflows to allows you to gain insights about your model's performance by comparing it to other models, both within and outside of Azure.

Setup

1. Navigate to the Models page under LLM Labs menu.

2. Open My models tab, and click the Manage providers button.

Manage providers button

3. Choose Azure OpenAI as the provider, and insert your Tenant ID, Subscription ID, Resource group name, and Resource name.

Setting up credentials

1. If this is your first time integrating Azure Open AI with Datasaur, click the Add Datasaur to your Azure Tenant button to grant consent for Datasaur's App Registration to your tenant. If you have previously done this, you can skip this step.

   • You must have at least the Privileged Role Administrator role to grant consent to App Registrations for delegated access. Continue the process on a new tab and authorize the Datasaur app. Note that you need Admin permission to complete this action.

Request permission

2. Grant role assignments to Datasaur's Service Principal

   1. Still in the Azure OpenAI Account, find Access Control (IAM) on the sidebar**.**

   2. Click on Add > Add role assignment.

   3. Select Cognitive Services OpenAI Contributor, then click Next.

   4. In Assign access to, click on User, group, or service principal, then click select members.

   5. Search for Datasaur Azure AI Integrator (you cannot see the service principals from the list, you must search for them), then add it. This step will not be available if you haven't added Datasaur to your Azure tenant as described above.

   6. Proceed by clicking "Next" and then click "Next" once more when you reach the Conditions section.

   7. Click on Review + assign.

3. Getting the Tenant ID:

   1. Go to your Microsoft Entra ID from the Azure portal. To learn more about Microsoft Entra ID, please visit this link.

   2. Under the Overview tab, copy the Tenant ID attribute under the Basic information section.

4. Getting the Subscription ID, Resource Group Name, and Account Name:

   1. Go to the Azure OpenAI page from the Azure portal.

   2. Create or select an Azure OpenAI Account.

   3. From the sidebar, click on Overview menu.

   4. You should find these fields under the Essentials section Subscription ID should be available as “Subscription ID” Resource Group Name should be available as “Resource group” Account Name is the name of the selected Azure OpenAI Account.

Azure OpenAI Studio Dashboard

4. Once you have connected your Azure OpenAI Models to LLM Labs, you will see a list of available LLM Models that you have already deployed in Azure OpenAI. You can immediately use these models within LLM Labs.

Azure OpenAI connected

Every new model that you deploy in Azure OpenAI will be synced to Datasaur, and you can use it right away in Datasaur. If the models you just deployed haven't appeared on Datasaur, you can click Sync models.

Supported Azure OpenAI Models

Datasaur supports a wide range of models available in Azure OpenAI. You can find the list of supported models here: Azure OpenAI Models.

Currently, Datasaur only provides support for text generation Large Language Models.

Additionally, you can bring your own fine-tuned models from Azure OpenAI into Datasaur, allowing for greater customization and performance tailored to your specific use cases.

Disconnecting Azure OpenAI

To disconnect Azure OpenAI from Datasaur, follow these steps:

1. Go to the Models page under the LLM Labs menu.

2. Open My models tab and select Manage providers.

3. Click See details next to the Azure OpenAI provider.

4. Click Disconnect and confirm the action.

Availability

The model will be accessible to all workspace members for use in their projects. Additionally, only the Admin can remove the Azure OpenAI provider from the workspace.

Conclusion

Integrating your own Azure OpenAI models with Datasaur not only enhances functionality but also ensures that your data remains secure and compliant with your organization's policies. By leveraging your own LLMs, you gain greater control, customization, and security for your AI applications.

For further assistance or to get started, please reach out to our support team at [e-mail].