Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
Creating your first agent with Azure AI Agent Service is a two-step process:
- Set up your agent environment.
- Create and configure your agent using either the SDK of your choice or the Azure Foundry Portal.
Use this article to learn more about setting up your agents.
Required permissions
Action | Required Role |
---|---|
Create an account and project | Azure AI Account Owner |
Standard Setup Only: Assign RBAC for required resources (Cosmos DB, Search, Storage, etc.) | Role Based Access Administrator |
Create and edit agents | Azure AI User |
Set up your agent environment
To get started, you need an account and a project.
Agents are scoped at the project level, which ensures data isolation—agents within the same project share access to the same resources.
Prerequisites
- An Azure subscription - Create one for free.
- Ensure that the individual creating the account and project has the Azure AI Account Owner role at the subscription scope
- If configuring Standard Setup, the same individual must also have permissions to assign roles to required resources (Cosmos DB, Search, Storage).
- The built-in role needed is Role Based Access Administrator.
- Alternatively, having the Owner role at the subscription level also satisfies this requirement.
- The key permission needed is:
Microsoft.Authorization/roleAssignments/write
Choose your setup
Azure AI Foundry Agent Service offers three environment configuration modes to suit different needs:
Basic Setup:
This setup is compatible with OpenAI Assistants and manages agent states using the platform's built-in storage. It includes the same tools and capabilities as the Assistants API, with added support for non-OpenAI models and tools such as Azure AI Search, and Bing.
Standard Setup:
Includes everything in the basic setup and fine-grained control over your data by allowing you to use your own Azure resources. All customer data—including files, threads, and vector stores—are stored in your own Azure resources, giving you full ownership and control.
Standard Setup with Bring Your Own (BYO) Virtual Network:
Includes everything in the Standard Setup, with the added ability to operate entirely within your own virtual network. This setup supports Bring Your Own Virtual Network (BYO virtual network), allowing for strict control over data movement and helping prevent data exfiltration by keeping traffic confined to your network environment.
Compare setup options
Use Cases | Basic Setup | Standard Setup with Public Networking | Standard Setup with Private Networking |
---|---|---|---|
Get started quickly without managing resources | ✅ | ||
All conversation history, file, and vector stores are stored in your own resources | ✅ | ✅ | |
Support for Customer Managed Keys (CMK) | ✅ | ✅ | |
Private Network Isolation (Bring your own virtual network) | ✅ |
Deployment options
To customize these templates, see use your own resources.
If you want support for Private Network Isolation see network-secured setup for more information on how to bring your own virtual network.
[Optional] Model selection in autodeploy template
You can customize the model used by your agent by editing the model parameters in the autodeploy template. To deploy a different model, you need to update at least the modelName
and modelVersion
parameters.
By default, the deployment template is configured with the following values:
Model Parameter | Default Value |
---|---|
modelName | gpt-4o |
modelFormat | OpenAI (for Azure OpenAI) |
modelVersion | 2024-11-20 |
modelSkuName | GlobalStandard |
modelLocation | eastus |
Important
Don't change the modelFormat parameter.
The templates only support deployment of Azure OpenAI models. See which Azure OpenAI models are supported in the Azure AI Foundry Agent Service model support documentation.