-
Notifications
You must be signed in to change notification settings - Fork 398
Document available hosted agent sizes #633
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
|
@gukoff : Thanks for your contribution! The author(s) and reviewer(s) have been notified to review your proposed change. |
|
Learn Build status updates of commit 16e381a: ✅ Validation status: passed
For more details, please refer to the build report. |
|
Can you review the proposed changes? IMPORTANT: When the changes are ready for publication, adding a #label:"aq-pr-triaged" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull request overview
This PR adds documentation for the supported CPU and memory size configurations for hosted agents in Microsoft Foundry Agent Service. The change addresses a gap in the documentation by providing developers with a clear reference table of valid replica sizes, which helps prevent validation errors when creating hosted agents.
Key Changes
- Adds a new "Agent sizes" subsection under "Understand key concepts" with a comprehensive table listing all 14 supported CPU/memory pairs
- Clarifies that these values define replica sizes and that agents can run multiple replicas
| - Python: `azure-ai-agentserver-core`, `azure-ai-agentserver-agentframework`, `azure-ai-agentserver-langgraph` | ||
| - .NET: `Azure.AI.AgentServer.Core`, `Azure.AI.AgentServer.AgentFramework` | ||
|
|
||
| ### Agent sizes |
Copilot
AI
Dec 15, 2025
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The heading "Agent sizes" should be changed to "Agent replica sizes" to more accurately reflect that these values define the size of each replica, not the agent as a whole. The current heading could be misleading since the following text clarifies that "an agent can run multiple replicas." Using "Agent replica sizes" makes the scope clearer immediately.
| ### Agent sizes | |
| ### Agent replica sizes |
Hosted agents seem to require specific replica sizes. Attempting to create any other agent sizes results in a validation error.
By the way, the
definition.memoryerror message gives wrong memory limits. Could you fix it internally in the product?Validation error:
{ "error": { "code": "invalid_payload", "message": "Invalid payload", "param": null, "type": "invalid_request_error", "details": [ { "code": "ValidationError", "message": "CPU must be a decimal number representing cores. Examples: '0.25', '0.5', '1', '2', '3.5'", "param": "definition.cpu", "type": "error" }, { "code": "ValidationError", "message": "CPU must be between 0.25 and 3.5 cores.", "param": "definition.cpu", "type": "error" }, { "code": "ValidationError", "message": "CPU must be in increments of 0.25. Valid values: 0.25, 0.5, 0.75, 1, 1.25, etc.", "param": "definition.cpu", "type": "error" }, { "code": "ValidationError", "message": "The specified condition was not met for 'Cpu'.", "param": "definition.cpu", "type": "error" }, { "code": "ValidationError", "message": "Memory must be specified in GiB format only. Examples: '0.5Gi', '1Gi', '1.5Gi', '4Gi', '7Gi'", "param": "definition.memory", "type": "error" }, { "code": "ValidationError", "message": "Memory must be between 1 Gi and 7 Gi.", "param": "definition.memory", "type": "error" }, { "code": "ValidationError", "message": "Memory must be in increments of 0.5Gi. Valid values: 0.5Gi, 1Gi, 1.5Gi, 2Gi, 2.5Gi, etc.", "param": "definition.memory", "type": "error" }, { "code": "ValidationError", "message": "CPU and Memory must be specified as a valid combination. Valid pairs: (0.25, 0.5Gi), (0.5, 1Gi), (0.75, 1.5Gi), (1, 2Gi), (1.25, 2.5Gi), (1.5, 3Gi), (1.75, 3.5Gi), (2, 4Gi), (2.25, 4.5Gi), (2.5, 5Gi), (2.75, 5.5Gi), (3, 6Gi), (3.25, 6.5Gi), (3.5, 7Gi)", "param": "definition", "type": "error" } ], "additionalInfo": { "request_id": "e598b1a8c1bf324767fa26236c69333a" } } }