[BUG] Live Metrics maxes out at 10 requests/second

[vRune4]

Library name and version

Azure.Monitor.OpenTelemetry.AspNetCore 1.2.0

Describe the bug

LiveMetrics is showing incorrect values.
Specifically 'Requests per second'.

Similar to: #46417

Expected behavior

When hammering the service with thousands of requests, live metrics should reflect that.

Actual behavior

Live metrics maxes out at 10 requests per second:

Meanwhile, Azure Load Testing shows this:

Reproduction Steps

1. Create a new asp.net 9 application
2. Program.cs: builder.Services.AddOpenTelemetry().UseAzureMonitor(opt => { opt.Credential = credential; opt.ConnectionString = appInsightsConnectionString; });
3. This example uses the Northwind database
4. Create a new controller:

[Route("api/[controller]")]
[ApiController]
public class OrdersController(SqlConnection sqlConnection) : ControllerBase
{
	private readonly SqlConnection _sqlConnection = sqlConnection;

	[HttpGet]
	public ActionResult<IAsyncEnumerable<Order>> Get()
	{
		return Ok(ReadOrdersAsync());
	}

	private async IAsyncEnumerable<Order> ReadOrdersAsync()
	{
		using SqlCommand command = _sqlConnection.CreateCommand();
		command.CommandText = "SELECT TOP 15 OrderID, COALESCE(CustomerID, ''), COALESCE(EmployeeID, 0), COALESCE(OrderDate, '1900-01-01') FROM Orders";
		await _sqlConnection.OpenAsync();
		using SqlDataReader reader = await command.ExecuteReaderAsync();

		while (await reader.ReadAsync())
		{
			yield return new Order
			{
				OrderID = reader.GetInt32(0),
				CustomerID = reader.GetString(1),
				EmployeeID = reader.GetInt32(2),
				OrderDate = reader.GetDateTime(3)
			};
		}
	}
}

Environment

Azure Container Apps
.Net 9

[github-actions]

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @rajkumar-rangaraj @TimothyMothra.

[TimothyMothra]

Hi @vRune4, there was a bug in LiveMetrics.
That bug fix is available in https://www.nuget.org/packages/Azure.Monitor.OpenTelemetry.AspNetCore/1.3.0-beta.2.
Would you be able to test this beta and confirm that this resolves your issue?

[vRune4]

Beta 2 is a huge improvement:

The Load Tester presents this graph:

Difficult to compare those two, but at least now it is possible to see that the service is being hit by lots of traffic.

App insights: