Stephen Toub

Add Microsoft.Extensions.AI support

Add multi-modal tool result support to IChatClients - Adds support for translating AIContent returned from AIFunctions to map to the corresponding BetaToolResultBlockParamContent - Adds support for passing through the new DeferLoading, Strict, InputExamples, and AllowedCallers settings from AIFunction.AdditionalProperties through to BetaTool

.Net: Update to latest M.E.AI{.Abstractions} + OpenAI Related Packages (#12685) This pull request updates package dependencies, refactors the OpenAI Realtime demo to align with API changes, and modifies related unit tests to reflect these updates. The most significant changes include updating package versions, transitioning from the `RealtimeConversation` API to the `Realtime` API, and adjusting test logic to accommodate updated data structures. ### Dependency Updates: * Updated `Azure.AI.OpenAI` to version `2.2.0-beta.5` and `OpenAI` to version `2.2.0`. [[1]](diffhunk://#diff-21abc2ac38e0ade95299a2450724507fe1d080c383a3024337f9177278c64186L22-R22) [[2]](diffhunk://#diff-21abc2ac38e0ade95299a2450724507fe1d080c383a3024337f9177278c64186L73-R73) * Updated `System.Text.Json` to version `8.0.6`. * Upgraded `Microsoft.Extensions.AI` and related libraries to version `9.7.1`. ### OpenAI Realtime Demo Refactor: * Replaced `RealtimeConversationClient` and related classes with `RealtimeClient` and its updated API. This includes changes to session initialization, configuration, and item handling in `Program.cs`. [[1]](diffhunk://#diff-fa8b1514e6458341bf08441b1dc14550fb9bb75d2a0c108c75e1615c2e2ba09dL11-R19) [[2]](diffhunk://#diff-fa8b1514e6458341bf08441b1dc14550fb9bb75d2a0c108c75e1615c2e2ba09dL36-R45) [[3]](diffhunk://#diff-fa8b1514e6458341bf08441b1dc14550fb9bb75d2a0c108c75e1615c2e2ba09dL378-R400) * Adjusted method calls and data types to align with the new API, such as replacing `ConversationItem` with `RealtimeItem` and updating event types like `ConversationUpdate` to `RealtimeUpdate`. [[1]](diffhunk://#diff-fa8b1514e6458341bf08441b1dc14550fb9bb75d2a0c108c75e1615c2e2ba09dL65-R70) [[2]](diffhunk://#diff-fa8b1514e6458341bf08441b1dc14550fb9bb75d2a0c108c75e1615c2e2ba09dL85-R84) [[3]](diffhunk://#diff-fa8b1514e6458341bf08441b1dc14550fb9bb75d2a0c108c75e1615c2e2ba09dL229-R228) ### Unit Test Updates: * Updated test cases to use new data structures, such as replacing `IReadOnlyList<string>` with `IReadOnlyList<ReasoningSummaryPart>` and adapting related assertions. [[1]](diffhunk://#diff-3e486c31e4424c1a3ea61e23b1f7a266d186a4016ad57d7187dacf7b4bc8140fL198-R206) [[2]](diffhunk://#diff-8ea1809160a96b9a3ebca5c1695353800f302aa2c5aabb4a2be51c6494f6f315L105-R105) * Added `OPENAI001` to `NoWarn` lists in several `.csproj` files to suppress warnings related to the OpenAI SDK. [[1]](diffhunk://#diff-ae520434a4ad683f6736397dfbd0b308dda10dbce75af0c5064efbb3b0059dc0L11-R11) [[2]](diffhunk://#diff-5703c2716d4b9753ae67ce3c1434595c4adbff1eb6564dd2fa0a0882c3925551L8-R8) [[3]](diffhunk://#diff-8788687b51a5a626ca287b5c18f667bf1f5fa9b13af4ee425765f8e84b765ac3L10-R10) --------- Co-authored-by: Mark Wallace <127216156+markwallace-microsoft@users.noreply.github.com> Co-authored-by: Roger Barreto <19890735+rogerbarreto@users.noreply.github.com>

.Net: Update MCP sample with ModelContextProtocol (#11121) cc: @markwallace-microsoft, @RogerBarret0 Closes #10966 --------- Co-authored-by: SergeyMenshykh <sergemenshikh@gmail.com>

Add internal OpenAIResponseClient.CreateResponse{Streaming}Async overloads that take RequestOptions (#687) Co-authored-by: Jose Arriaga Maldonado <josar@microsoft.com>

Improve reporting of token counts in UsageDetails (#70) * Improve reporting of token counts in UsageDetails - InputTokenCount needs to reflect cached tokens. - Only add to AdditionalCounts for positive counts. - Added reporting of WebFetch/SearchRequests. * lint * lint take 2

Fix incorrect handling of polyfills - The System.Runtime.CompilerServices / System.Diagnostics.CodeAnalysis types should all be internal rather than public; otherwise they will lead to ambiguity warnings with consumers and also won't type unify. - The System.Collection.Immutable / ValueTask types should not be polyfilled; they instead should just use the netstandard2.0 packages. - Anthropic.Foundry needs to include the shims.cs file correctly.

.Net: Update M.E.AI and OpenAI dependencies (#13095)

.Net: Implement OnnxRuntimeGenAIChatCompletionService on OnnxRuntimeGenAIChatClient (#12197) Co-authored-by: Roger Barreto <19890735+RogerBarreto@users.noreply.github.com> Co-authored-by: Mark Wallace <127216156+markwallace-microsoft@users.noreply.github.com>

.Net: Update ModelContextProtocol to 0.4.0-preview.3 (#13271)