[BUG] 401 Unauthorized with Azure OpenAI CompleteChatAsync()

[markjbrown]

Library name and version

Azure.AI.OpenAI 2.0.0-beta.2

Describe the bug

I am getting a consistent 401 unauthorized when using Default Identity using the new Azure OpenAI version for CompleteChatAsync().

It works fine when using embeddings. It's just Chat that doesn't work. I double checked by running the same test on a v1 beta package and it works fine. I am migrating my app to this new version when I encountered this.

Expected behavior

Function call should successfully authenticate and complete the request.

Actual behavior

The app itself appears to just sit there waiting. Eventually this comes into the log window.

  System.ClientModel.ClientResultException: Service request failed.
  Status: 401 (Unauthorized)
  
     at Azure.AI.OpenAI.ClientPipelineExtensions.ProcessMessageAsync(ClientPipeline pipeline, PipelineMessage message, RequestOptions options)
     at Azure.AI.OpenAI.Chat.AzureChatClient.CompleteChatAsync(BinaryContent content, RequestOptions options)
     at OpenAI.Chat.ChatClient.CompleteChatAsync(IEnumerable`1 messages, ChatCompletionOptions options, CancellationToken cancellationToken)

Reproduction Steps

This is difficult to build a complete repro for. The code for this is in this branch, https://github.com/markjbrown/cosmosdb-nosql-copilot/tree/oai2-sk118rc The file is /src/services/OpenAiService.cs the function is GetRagCompletionAsync()

Environment

Win 11
.NET 8
VS 17.11.3

[github-actions]

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @jpalvarezl @ralph-msft @trrwilson.