Stephen Toub

Update IChatClient with support from latest bedrock runtime / M.E.AI (#4184) * Update IChatClient with support from latest bedrock runtime / M.E.AI - Updates to M.E.AI.Abstractions 10.4.0 - Adds support for multi-modal tool returns. - Adds support for citations with URIs. - Adds support for cached tokens in usage details. - Adds support for reasoning. - Adds a ton of tests verifying IChatClient behavior around the underlying IAmazonBedrockRuntime.

Add Microsoft.Extensions.AI support

Add multi-modal tool result support to IChatClients - Adds support for translating AIContent returned from AIFunctions to map to the corresponding BetaToolResultBlockParamContent - Adds support for passing through the new DeferLoading, Strict, InputExamples, and AllowedCallers settings from AIFunction.AdditionalProperties through to BetaTool

Update Microsoft.Extensions.AI to 9.3.0-preview.1.25114.11 (#3656)

Update to Microsoft.Extensions.AI.Abstractions 9.9.0 (#3960) * Update to M.E.AI 9.9 - Set new ChatMessage.CreatedAt property - Set and use new DataContent.Name property - Added citations to BedrockChatClient - Added implementation of IImageGenerator (as [Experimental] because the interface is itself [Experimental])

.Net: Update to latest M.E.AI{.Abstractions} + OpenAI Related Packages (#12685) This pull request updates package dependencies, refactors the OpenAI Realtime demo to align with API changes, and modifies related unit tests to reflect these updates. The most significant changes include updating package versions, transitioning from the `RealtimeConversation` API to the `Realtime` API, and adjusting test logic to accommodate updated data structures. ### Dependency Updates: * Updated `Azure.AI.OpenAI` to version `2.2.0-beta.5` and `OpenAI` to version `2.2.0`. [[1]](diffhunk://#diff-21abc2ac38e0ade95299a2450724507fe1d080c383a3024337f9177278c64186L22-R22) [[2]](diffhunk://#diff-21abc2ac38e0ade95299a2450724507fe1d080c383a3024337f9177278c64186L73-R73) * Updated `System.Text.Json` to version `8.0.6`. * Upgraded `Microsoft.Extensions.AI` and related libraries to version `9.7.1`. ### OpenAI Realtime Demo Refactor: * Replaced `RealtimeConversationClient` and related classes with `RealtimeClient` and its updated API. This includes changes to session initialization, configuration, and item handling in `Program.cs`. [[1]](diffhunk://#diff-fa8b1514e6458341bf08441b1dc14550fb9bb75d2a0c108c75e1615c2e2ba09dL11-R19) [[2]](diffhunk://#diff-fa8b1514e6458341bf08441b1dc14550fb9bb75d2a0c108c75e1615c2e2ba09dL36-R45) [[3]](diffhunk://#diff-fa8b1514e6458341bf08441b1dc14550fb9bb75d2a0c108c75e1615c2e2ba09dL378-R400) * Adjusted method calls and data types to align with the new API, such as replacing `ConversationItem` with `RealtimeItem` and updating event types like `ConversationUpdate` to `RealtimeUpdate`. [[1]](diffhunk://#diff-fa8b1514e6458341bf08441b1dc14550fb9bb75d2a0c108c75e1615c2e2ba09dL65-R70) [[2]](diffhunk://#diff-fa8b1514e6458341bf08441b1dc14550fb9bb75d2a0c108c75e1615c2e2ba09dL85-R84) [[3]](diffhunk://#diff-fa8b1514e6458341bf08441b1dc14550fb9bb75d2a0c108c75e1615c2e2ba09dL229-R228) ### Unit Test Updates: * Updated test cases to use new data structures, such as replacing `IReadOnlyList<string>` with `IReadOnlyList<ReasoningSummaryPart>` and adapting related assertions. [[1]](diffhunk://#diff-3e486c31e4424c1a3ea61e23b1f7a266d186a4016ad57d7187dacf7b4bc8140fL198-R206) [[2]](diffhunk://#diff-8ea1809160a96b9a3ebca5c1695353800f302aa2c5aabb4a2be51c6494f6f315L105-R105) * Added `OPENAI001` to `NoWarn` lists in several `.csproj` files to suppress warnings related to the OpenAI SDK. [[1]](diffhunk://#diff-ae520434a4ad683f6736397dfbd0b308dda10dbce75af0c5064efbb3b0059dc0L11-R11) [[2]](diffhunk://#diff-5703c2716d4b9753ae67ce3c1434595c4adbff1eb6564dd2fa0a0882c3925551L8-R8) [[3]](diffhunk://#diff-8788687b51a5a626ca287b5c18f667bf1f5fa9b13af4ee425765f8e84b765ac3L10-R10) --------- Co-authored-by: Mark Wallace <127216156+markwallace-microsoft@users.noreply.github.com> Co-authored-by: Roger Barreto <19890735+rogerbarreto@users.noreply.github.com>

Update Microsoft.Extensions.AI version and improve chat client for AWS updates (#3788) * Update Microsoft.Extensions.AI version and improve chat client for AWS updates - Bumped version number to 9.4.3-preview.1.25230.7 - Renamed some methods and arguments to match other implementations - Added support for TextReasoningContent - Ensured underlying objects propagated out as RawRepresentation - Added message and response IDs, along with setting additional metadata - Propagate cached token counts to UsageDetails

Update BedrockChatClient with support for Instructions/RawRepresentationFactory (#3906) * Update BedrockChatClient with support for Instructions/RawRepresentationFactory - ChatOptions.RawRepresentationFactory, to support "breaking glass" if someone wants to set Converse{Stream}Request properties that aren't available via messages/options directly. - ChatOptions.Instructions, as a non-messages way to set a system prompt.

.Net: Update MCP sample with ModelContextProtocol (#11121) cc: @markwallace-microsoft, @RogerBarret0 Closes #10966 --------- Co-authored-by: SergeyMenshykh <sergemenshikh@gmail.com>

Add internal OpenAIResponseClient.CreateResponse{Streaming}Async overloads that take RequestOptions (#687) Co-authored-by: Jose Arriaga Maldonado <josar@microsoft.com>