Edit

Share via


Analyze app and agent usage in Developer Portal

Developer Portal for Microsoft Teams provides a comprehensive suite of tools to help you analyze and understand your app's and agent's performance and user engagement. By using these analytics, you can gain valuable insights into how users interact with your app and agent, identify areas for improvement, and make data-driven decisions to enhance the overall user experience.

Whether you're tracking active users, retention rates, or usage patterns across different platforms, Developer Portal helps you with the information you need to optimize your app and ensure its success. Custom apps built for your org (LOB apps) can access app and agent usage data only for Teams. However, for third-party apps you can explore new Microsoft 365 dimensions, such as host product and capabilities.

The app and agent usage for a given day is reflected within 24 to 48 hours, and usage data for the new apps or agents can take up to three to five days to reflect in the charts.

Prerequisite

To analyze custom app usage, your tenant admin (a global administrator or a Teams administrator) must allow app and agent usage data for custom apps to be shown in Developer Portal. To allow app and agent usage:

  1. Go to Microsoft 365 admin center.
  2. Navigate to Settings > Org settings > Services > Developer Portal for Teams.
  3. Select Allow app usage for all custom apps to show in the Developer Portal.

For more information, see enable developers to use app analytics.

Screenshot shows where admin can allow custom app analytics in Microsoft 365 admin center.

Get started

You can view your custom app's usage and other insights from the Analytics page. To access the page:

  1. Go to Developer Portal.
  2. Select Apps from the left pane.
  3. Select the required app from the Apps page.
  4. Select Analytics under the Overview section.

Screenshot shows the analytics page of your app and agent in Developer Portal.

Metric definitions

Metric Definition
Monthly active users (MAU) Number of unique users who performed an intentional activity with your app and agent within that rolling 28 days window in UTC.
Weekly active users (WAU) Number of unique users who performed an intentional activity with your app and agent within that rolling seven days window in UTC.
Daily active users (DAU) Number of unique users who performed an intentional activity with your app and agent in a given day in UTC.
Monthly active tenants Number of unique tenants who performed an intentional activity with your app and agent within that rolling 28 days window in UTC.
Weekly active tenants Number of unique tenants who performed an intentional activity with your app and agent within that rolling seven days window in UTC.
Daily active tenants Number of unique tenants who performed an intentional activity with your app and agent in a given day in UTC.

Tip

To know more about each metric definition, select See metric definitions. A pop-up window appears on the right-side of the window with the required definitions.

As you explore individual metrics on this page, you can use the Filter button to analyze your app's and agent's usage from the following filter options:

  • Aggregation type: Allows you to view active users or active tenants.
  • Platform: Allows you to group the metrics by the platform on which users performed intentional activities with your app and agent. The platform can be Desktop, Mobile, Web, or other available options.
  • Operating system: Allows you to group the metrics by the operating system on which users performed intentional activities with your app and agent. The operating system can be Windows, Mac, iOS, Android or other available options.
  • Area: Allows you to group the metrics by the geographical ___location of the active usage.

Screenshot shows the app and agent analytics page filter in Developer Portal.

App and agent analytics

To gain insights on the app and agent usage and analyze trends, explore the following three sections under Analytics:

App and agent usage

The App usage tab shows the following metrics to help you track engagement and user behavior:

Screenshot shows app and agent usage chart of your published app in Developer Portal.

Usage over time

The Usage over time chart shows the number of active users or tenants who opened and used your app and agent across different time periods.

Screenshot shows app and agent usage over time of your published app in Developer Portal.

Usage by retention state

The Usage by retention state chart allows you to track four key retention or churn metrics for your app and agent over time.

Screenshot shows app and agent usage by retention state of your published app in Developer Portal.

Metric Definition
New users or tenants Active users or tenants who used your app and agent for the first time in the current time period.
Returning users or tenants Active users or tenants who used your app and agent during the current period and in the immediately preceding period.
Resurrected users or tenants Active users or tenants who started using your app and agent again in the current period, after a previous period of inactivity.
Lapsed users or tenants Active users or tenants who stopped using your app and agent in the current period, after a previous period of activity.

Usage by country or region

The Usage by country/region chart shows the various regions where your app and agent are being used. Each user is mapped to a single area or geography. You can select View details for more information on active users in different countries or regions.

Screenshot shows app and agent usage by country or region of your published app in Developer Portal.

Usage intensity

The Usage intensity chart shows frequency and depth of use. They're one indicator that users are finding value in continuing to use your app and agent.

Screenshot shows app and agent usage intensity of your published app in Developer Portal.

Metric Definition
Median days used per month Median number of days in which your app and agent was opened in the last month.
% of 5+ days usage Percentage of active users who opened or used your app and agent more than five days in the last month.
DAU/MAU Average number of daily active users (DAU) divided by monthly active users (MAU) for a rolling 30-day time period.

App dashboard

The My App Dashboard table shows the latest R30 (Rolling 30 days) data for each of the metrics under the previous four categories, and the Month over Month (MoM) change. Use the time picker on the upper left side and select the desired date to view the following:

  • Select any day in the last 75 days to view daily R30 data.
  • Select any end of month in the last 12 months to view R30 data.

You can select each of these metric names to see trends over time.

Screenshot shows app and agent capability usage of your published app in Developer Portal.

Host product

The Host product tab shows the following usage analytics for app and agent:

The first two scorecards display metrics such as the host with the most active users and the operating system (OS) with the most active users based on monthly, weekly, and daily data.

Screenshot shows app and agent usage in different host products of your published app in Developer Portal.

App and agent usage by host product

The App usage by host product chart shows your app's and agent's active usage across various host products, including Microsoft 365 app, Microsoft 365 Copilot, Outlook, and Teams.

Screenshot shows app and agent usage in different host product of your published app in Developer Portal.

Usage by platform

The Usage by platform chart shows your app's and agent's active usage across various platforms, such as Desktop, Mobile, Web, and other platforms where the app and agent are used.

Screenshot shows app and agent usage in different platforms of your published app in Developer Portal.

Note

The Preview tag indicates that the metric Usage by host product is in its initial phase and might undergo modifications as we collect feedback and continue to improve the experience.

Usage by operating system

The Usage by operating system chart shows your app's or agent's active usage across various operating systems, such as Android, Chrome OS, Linux, Mac, Windows, and iOS of monthly, weekly, and daily data.

Screenshot shows app and agent usage in different OS of your published app in Developer Portal.

Capability

The Capability tab shows the usage of individual app and agent capabilities that you've configured within your app. This page summarizes the overall usage of the following app and agent capabilities in different host products.

  • Microsoft 365 Copilot Agent
  • Bots
  • Tabs
  • Message extension
  • Personal app
  • Connector
  • Personal tab

Screenshot shows app and agent capability usage in different host products of your published app in Developer Portal.

Note

Microsoft 365 Copilot Agent includes the usage of declarative agents only. The usage of custom engine agent is expected to be introduced later in Developer Portal.

Known limitations

  • The usage data for message extensions in Outlook and Outlook Add-in isn't available.
  • The usage data of the Outlook personal tab includes both personal tab and tab (meeting scenario) data.
  • The usage data for consumer apps isn't available.
  • The usage data for Android in Outlook, which doesn't have a tenant ID, isn't available.

See also