Chris

.Net - Agent Runtime (#11648) ### Motivation and Context <!-- Thank you for your contribution to the semantic-kernel repo! Please help reviewers and future users, providing the following information: 1. Why is this change required? 2. What problem does it solve? 3. What scenario does it contribute to? 4. If it fixes an open issue, please link to the issue here. --> Move _Agent Runtime_ from dedicated repo ### Description <!-- Describe your changes, the overall approach, the underlying design. These notes will help understanding how your code works. Thanks! --> This ports the three projects/packages from the shared runtime repo + tests ### Contribution Checklist <!-- Before submitting this PR, please make sure: --> - [X] The code builds clean without any errors or warnings - [X] The PR follows the [SK Contribution Guidelines](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md) and the [pre-submission formatting script](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md#development-scripts) raises no violations - [X] All unit tests pass, and I have added new tests where possible - [X] I didn't break anyone :smile:

.Net - Agent Orchestration (#11542) ### Motivation and Context <!-- Thank you for your contribution to the semantic-kernel repo! Please help reviewers and future users, providing the following information: 1. Why is this change required? 2. What problem does it solve? 3. What scenario does it contribute to? 4. If it fixes an open issue, please link to the issue here. --> Add support for multi-agent orchestration patterns based on using the the shared _AutoGen_ Agent Runtime. ### Description <!-- Describe your changes, the overall approach, the underlying design. These notes will help understanding how your code works. Thanks! --> - Introduce framework for defining an `AgentOrchestration` - Include support for Sequential, Concurrent, Handoff, and GroupChat orchestrations - Includes unit-tests and samples ### Contribution Checklist <!-- Before submitting this PR, please make sure: --> - [X] The code builds clean without any errors or warnings - [X] The PR follows the [SK Contribution Guidelines](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md) and the [pre-submission formatting script](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md#development-scripts) raises no violations - [X] All unit tests pass, and I have added new tests where possible - [X] I didn't break anyone :smile: --------- Co-authored-by: Tao Chen <taochen@microsoft.com>

.Net Agents - Fix and streamlining for `OpenAIAssistantAgent` (#10583) ### Motivation and Context <!-- Thank you for your contribution to the semantic-kernel repo! Please help reviewers and future users, providing the following information: 1. Why is this change required? 2. What problem does it solve? 3. What scenario does it contribute to? 4. If it fixes an open issue, please link to the issue here. --> Adjust design approach for `OpenAIAssistantAgent` to match that of `AzureAIAgent`, specifically around exposing the public constructor and not requiring the use of static factory methods. This approach enables all features present in the underlying SDK and addresses several initialization bugs based on the hidden/private constructor. > Obsolete methods are maintained for compatibility, but will not be graduated. Eventually, it is likely they will be removed. ### Description <!-- Describe your changes, the overall approach, the underlying design. These notes will help understanding how your code works. Thanks! --> **Changes:** - Exposed public constructor for `OpenAIAssistantAgent` - Now support all assistant features (available in the SDK) - Deprecated factory methods and functional wrappers - Exposed extension methods to facilitate common operations - Adjusted all samples and tests - No single sample increased its line count...most have less lines of code **Fixes:** - Fixes: https://github.com/microsoft/semantic-kernel/issues/10110 - Fixes: https://github.com/microsoft/semantic-kernel/issues/10160 - Fixes: https://github.com/microsoft/semantic-kernel/issues/10390 - Fixes: https://github.com/microsoft/semantic-kernel/issues/10397 - Fixes: https://github.com/microsoft/semantic-kernel/issues/8222 - Fixes: https://github.com/microsoft/semantic-kernel/issues/6795 ### Contribution Checklist <!-- Before submitting this PR, please make sure: --> - [X] The code builds clean without any errors or warnings - [X] The PR follows the [SK Contribution Guidelines](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md) and the [pre-submission formatting script](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md#development-scripts) raises no violations - [X] All unit tests pass, and I have added new tests where possible - [X] I didn't break anyone :smile:

.Net: Agents: Support Azure AI Agent (#10134) ### Motivation and Context <!-- Thank you for your contribution to the semantic-kernel repo! Please help reviewers and future users, providing the following information: 1. Why is this change required? 2. What problem does it solve? 3. What scenario does it contribute to? 4. If it fixes an open issue, please link to the issue here. --> Add support for Azure AI Agents: - https://github.com/Azure/azure-sdk-for-net/tree/main/sdk/ai/Azure.AI.Projects/src/Custom/Agent - https://learn.microsoft.com/en-us/azure/ai-services/agents/ Fixes: https://github.com/microsoft/semantic-kernel/issues/10114 ### Description <!-- Describe your changes, the overall approach, the underlying design. These notes will help understanding how your code works. Thanks! --> - Adds `AzureAIAgent` type in a new project/package - Maintains parity with `OpenAIAssistantAgent` - Supports Azure specific tool offerings ### Contribution Checklist <!-- Before submitting this PR, please make sure: --> - [X] The code builds clean without any errors or warnings - [X] The PR follows the [SK Contribution Guidelines](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md) and the [pre-submission formatting script](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md#development-scripts) raises no violations - [X] All unit tests pass, and I have added new tests where possible - [X] I didn't break anyone :smile:

.Net Agents - Update Azure Foundry Agent SDK (#12027) ### Motivation and Context As part of going GA with Foundry Agents, Azure team has split `Azure.AI.Projects` into two packages: `Azure.AI.Projects` & `Azure.AI.Agents.Persistent` In addition, connecting to a foundry project will be based on endpoint/credential and connection-string will not be supported. ### Description - Updated package dependency to include: `Azure.AI.Projects.OneDP` & `Azure.AI.Agents.Persistent` - Updated declarative agents to support `endpoint` instead of `connection-string` - Updated tests and samples - Deprecated `OpenAIClientProvider` - Removed `AzureAIClientProvider`  ### Contribution Checklist <!-- Before submitting this PR, please make sure: --> - [X] The code builds clean without any errors or warnings - [X] The PR follows the [SK Contribution Guidelines](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md) and the [pre-submission formatting script](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md#development-scripts) raises no violations - [X] All unit tests pass, and I have added new tests where possible - [X] I didn't break anyone :smile:

.Net Agents - Introducing `CopilotStudioAgent` (#12372) ### Motivation and Context <!-- Thank you for your contribution to the semantic-kernel repo! Please help reviewers and future users, providing the following information: 1. Why is this change required? 2. What problem does it solve? 3. What scenario does it contribute to? 4. If it fixes an open issue, please link to the issue here. --> Support _Copilot Studio Agents_ in the SK Agent Framework: `CopilotStudioAgent` ### Description <!-- Describe your changes, the overall approach, the underlying design. These notes will help understanding how your code works. Thanks! --> Implement `CopilotStudioAgent` with client factory and token handler. Includes "Action" and "Reasoning" content models. Both may be justified outside of use with `CopilotStudioAgent`. ### Contribution Checklist <!-- Before submitting this PR, please make sure: --> - [X] The code builds clean without any errors or warnings - [X] The PR follows the [SK Contribution Guidelines](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md) and the [pre-submission formatting script](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md#development-scripts) raises no violations - [X] All unit tests pass, and I have added new tests where possible - [X] I didn't break anyone :smile:

.Net Agents - Magentic Agent Orchestration (#12110) ### Motivation and Context <!-- Thank you for your contribution to the semantic-kernel repo! Please help reviewers and future users, providing the following information: 1. Why is this change required? 2. What problem does it solve? 3. What scenario does it contribute to? 4. If it fixes an open issue, please link to the issue here. --> Introducing _Magentic_ agent orchestration. Fixes: https://github.com/microsoft/semantic-kernel/issues/10900 Fixes: https://github.com/microsoft/semantic-kernel/issues/12156 ### Description <!-- Describe your changes, the overall approach, the underlying design. These notes will help understanding how your code works. Thanks! --> Add _Magentic_ ledger based orchestration, based on AutoGen _Magentic One_ ### Contribution Checklist <!-- Before submitting this PR, please make sure: --> - [X] The code builds clean without any errors or warnings - [X] The PR follows the [SK Contribution Guidelines](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md) and the [pre-submission formatting script](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md#development-scripts) raises no violations - [X] All unit tests pass, and I have added new tests where possible - [X] I didn't break anyone :smile: --------- Co-authored-by: Tao Chen <taochen@microsoft.com>

.Net - Update and Fixes for `AzureAIAgent` (#12348) ### Motivation and Context <!-- Thank you for your contribution to the semantic-kernel repo! Please help reviewers and future users, providing the following information: 1. Why is this change required? 2. What problem does it solve? 3. What scenario does it contribute to? 4. If it fixes an open issue, please link to the issue here. --> Address customer input and discovered issues for `AzureAIAgent` ### Description <!-- Describe your changes, the overall approach, the underlying design. These notes will help understanding how your code works. Thanks! --> Address several issues: - Support image input - Null reference when function calling parameter is null - Null reference when using BingGroundingTool with streaming - Add samples for response-format - Fix connection resolution for declarative bing tool Fixes: https://github.com/microsoft/semantic-kernel/issues/12288 ### Contribution Checklist <!-- Before submitting this PR, please make sure: --> - [X] The code builds clean without any errors or warnings - [X] The PR follows the [SK Contribution Guidelines](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md) and the [pre-submission formatting script](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md#development-scripts) raises no violations - [X] All unit tests pass, and I have added new tests where possible - [X] I didn't break anyone :smile:

.Net Agents - Add support for URL citation on Azure Agent (#11910) ### Motivation and Context <!-- Thank you for your contribution to the semantic-kernel repo! Please help reviewers and future users, providing the following information: 1. Why is this change required? 2. What problem does it solve? 3. What scenario does it contribute to? 4. If it fixes an open issue, please link to the issue here. --> Expose URL citation for `AzureAIAgent` Fixes: https://github.com/microsoft/semantic-kernel/issues/11635 ### Description <!-- Describe your changes, the overall approach, the underlying design. These notes will help understanding how your code works. Thanks! --> Tools such as the `bing-grounding-tool` provide url based annotations. This change updates the SDK, run processing, and annotation content types. - SDK: Must reference a version of that includes the fix for streaming url annocations - Run Processing: Capture annotation data and expose via the SK content model - Content Types: Add support for url annotation to `AnnotationContent` and `StreamingAnnocationContent` ### Contribution Checklist <!-- Before submitting this PR, please make sure: --> - [X] The code builds clean without any errors or warnings - [X] The PR follows the [SK Contribution Guidelines](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md) and the [pre-submission formatting script](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md#development-scripts) raises no violations - [X] All unit tests pass, and I have added new tests where possible - [X] I didn't break anyone :smile: --------- Co-authored-by: Roger Barreto <19890735+RogerBarreto@users.noreply.github.com>

.NET Agent - Add AIContext to `OpenAIResponseAgent` (#12456) ### Motivation and Context <!-- Thank you for your contribution to the semantic-kernel repo! Please help reviewers and future users, providing the following information: 1. Why is this change required? 2. What problem does it solve? 3. What scenario does it contribute to? 4. If it fixes an open issue, please link to the issue here. --> Follow-up to https://github.com/microsoft/semantic-kernel/pull/12444 Fixes: https://github.com/microsoft/semantic-kernel/issues/12472 ### Description <!-- Describe your changes, the overall approach, the underlying design. These notes will help understanding how your code works. Thanks! --> Add support for incorporating `AIContext` when invoking `OpenAIResponseAgent` Enabled conformance tests ### Contribution Checklist <!-- Before submitting this PR, please make sure: --> - [X] The code builds clean without any errors or warnings - [X] The PR follows the [SK Contribution Guidelines](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md) and the [pre-submission formatting script](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md#development-scripts) raises no violations - [X] All unit tests pass, and I have added new tests where possible - [X] I didn't break anyone :smile: --------- Co-authored-by: westey <164392973+westey-m@users.noreply.github.com>