Edit

Share via


How to use Azure AI services in Azure AI Foundry portal

You might have existing resources for Azure AI services that you used in the old studios such as Azure OpenAI Studio or Speech Studio. You can pick up where you left off by using your existing resources in the Azure AI Foundry portal.

This article describes how to use new or existing Azure AI services resources in an Azure AI Foundry project.

Usage scenarios

Depending on the AI service and model you want to use, you can use them in Azure AI Foundry portal via:

  • Bring your existing Azure AI services resources into a project. You can use your existing Azure AI services resources in an Azure AI Foundry project by creating a connection to the resource.
  • The model catalog. You don't need a project to browse and discover Azure AI models. Some of the Azure AI services are available for you to try via the model catalog without a project. Some Azure AI services require a project to use them in the playgrounds.
  • The project-level playgrounds.
  • Fine-tune models. You can fine-tune a subset of Azure AI services models in Azure AI Foundry portal.
  • Deploy models. You can deploy base models and fine-tuned models to production. Most Azure AI services models are already deployed and ready to use.

Connect Azure AI services after you create a project

You can connect Azure AI services resources to an Azure AI Foundry project after you create a project. To use your existing Azure AI services resources (such as Azure AI Speech) in an Azure AI Foundry project, you need to create a connection to the resource.

  1. Create an Azure AI Foundry project. For detailed instructions, see Create an Azure AI Foundry project.

  2. Go to your Azure AI Foundry project.

  3. Select Management center from the left pane.

  4. Select Connected resources (under Project) from the left pane.

  5. Select + New connection.

    Screenshot of the connected resources page with the button to create a new connection.

  6. On the Add a connection to external assets page, select the kind of AI service that you want to connect to the project. For example, you can select Azure AI services (for a connection to multiple services in one resource), Azure OpenAI in Azure AI Foundry Models, Azure AI Content Safety, Azure AI Speech, Azure AI Language, and other AI services.

    Screenshot of the page to select the kind of AI service that you want to connect to the project.

  7. On the next page in the wizard, browse or search to find the resource you want to connect. Then select Add connection.

    Screenshot of the page to select the Azure AI resource that you want to connect to the project.

  8. After the resource is connected, select Close to return to the Connected resources page. You should see the new connection listed.

Discover Azure AI models in the model catalog

You can discover Azure AI models in the model catalog without a project. Some Azure AI services are available for you to try via the model catalog without a project.

  1. Go to the Azure AI model catalog page in Azure AI Foundry portal.

  2. Scroll down the page to see the list of available models. You can also use the search box to find a specific model.

  3. From the Collections dropdown, select Microsoft. Search for Azure AI services models by entering azure-ai in the search box.

    Screenshot of the model catalog page in Azure AI Foundry portal with the option to search by collection and name.

  4. Select a model to view more details about it. You can also try the model if it's available for you to try without a project.

Try Azure AI services in the project level playgrounds

In the project-level playgrounds, you can try Azure AI services such as Azure AI Speech and Azure AI Language.

  1. Go to your Azure AI Foundry project. If you need to create a project, see Create an Azure AI Foundry project.

  2. Select Playgrounds from the left pane and then select a playground to use. In this example, select Try the Speech playground.

    Screenshot of the project level playgrounds that you can use.

  3. Optionally, you can select a different connection to use in the playground.

    Screenshot of the Speech playground in a project.

Fine-tune Azure AI services models

In Azure AI Foundry portal, you can fine-tune some Azure AI services models. For example, you can fine-tune a model for custom speech.

  1. Go to your Azure AI Foundry project. If you need to create a project, see Create an Azure AI Foundry project.

  2. Select Fine-tuning from the left pane.

  3. Select AI Service fine-tuning.

    Screenshot of the page to select fine-tuning of Azure AI Services models.

  4. Select + Fine-tune.

  5. Follow the wizard to fine-tune a model for the capabilities that you want.

Deploy models to production

Once you have a project, several Azure AI services models are already deployed and ready to use.

  1. Go to your Azure AI Foundry project.

  2. Select Models + endpoints (under My assets) from the left pane.

  3. Select the Service endpoints tab to view the list of Azure AI services models that are already deployed.

    Screenshot of the models and endpoints page to view Azure AI services endpoints.

    In this example, we see six Azure AI Services deployments (such as Azure AI Speech and Azure AI Language) via the default connection. These models were already available for use when you created the project.

There's no option to deploy Azure AI services models from the Models + endpoints page. Azure AI services models are already deployed and ready to use.

However, you can deploy fine-tuned Azure AI services models. For example, you might want to deploy a custom speech model that you fine-tuned. In this case, you can deploy the model from the corresponding fine-tuning page.