Skip to content

Commit f8b4c12

Browse files
move token usage to a new page
1 parent b4d6b60 commit f8b4c12

File tree

6 files changed

+42
-15
lines changed

6 files changed

+42
-15
lines changed

solutions/search/agent-builder/agent-builder-agents.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -18,6 +18,10 @@ An agent parses user requests to define a goal and then runs tools in a loop to
1818

1919
When you ask a question to an agent, it analyzes your request to define a specific goal. It selects the most appropriate tools and determines the right arguments to use. The agent evaluates the information returned after each action and decides whether to use additional tools or formulate a response. This iterative process of tool selection, execution, and analysis continues until the agent can provide a complete answer.
2020

21+
:::{note}
22+
This iterative process consumes tokens. To understand how usage is calculated, refer to [Token usage in Elastic Agent Builder](monitor-usage.md#token-usage-in-elastic-agent-builder).
23+
:::
24+
2125
{{agent-builder}} includes a default agent (named `Elastic AI Agent`) with access to all built-in tools. You can create specialized agents with custom instructions and selected tools to address specific use cases or workflows.
2226

2327
:::{note}

solutions/search/agent-builder/chat.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -35,6 +35,10 @@ This takes you to the chat GUI:
3535

3636
Use the text input area to chat with an agent in real time. By default, you chat with the built-in Elastic AI Agent.
3737

38+
:::{note}
39+
Conversations with agents consume tokens. To understand how usage is calculated, refer to [Token usage in Elastic Agent Builder](monitor-usage.md#token-usage-in-elastic-agent-builder).
40+
:::
41+
3842
:::{image} images/agent-builder-chat-input.png
3943
:alt: Text input area for chatting with agents
4044
:width: 850px

solutions/search/agent-builder/limitations-known-issues.md

Lines changed: 0 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -24,21 +24,6 @@ However, it must be enabled for non-serverless deployments {applies_to}`stack: p
2424

2525
In the first release of {{agent-builder}} on serverless, the feature is **only available on {{es}} projects**.
2626

27-
### Token usage and counting
28-
29-
When using {{agent-builder}}, total token usage typically exceeds the visible conversation text. Because {{agent-builder}} utilizes an agentic framework, a single user request often triggers multiple model calls (rounds) to process reasoning steps, run tools, and interpret results.
30-
31-
Token counts include:
32-
33-
* **Input Tokens:** These accumulate throughout the session. They include the user's current query, the conversation history from previous rounds, system prompts, and the results returned from any tools used during execution.
34-
* **Output Tokens:** These include the final response visible to the user, as well as all internal reasoning steps, tool calls, and intermediate results generated by the model.
35-
36-
:::{note}
37-
As the conversation history grows and the agent performs more complex reasoning loops, the input and output token count increases multiplicatively for each round of execution.
38-
:::
39-
40-
For more information on billing and token costs, refer to [Elastic pricing](https://www.elastic.co/pricing).
41-
4227
## Known issues
4328

4429
### Incompatible LLMs
Lines changed: 24 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,24 @@
1+
---
2+
navigation_title: "Monitor usage"
3+
applies_to:
4+
stack: preview 9.2
5+
serverless:
6+
elasticsearch: preview
7+
observability: unavailable
8+
security: unavailable
9+
---
10+
11+
# Token usage in Elastic Agent Builder
12+
13+
When using {{agent-builder}}, total token usage typically exceeds the visible conversation text. Because {{agent-builder}} utilizes an agentic framework, a single user request often triggers multiple model calls (rounds) to process reasoning steps, run tools, and interpret results.
14+
15+
Token counts include:
16+
17+
* **Input Tokens:** These accumulate throughout the session. They include the user's current query, the conversation history from previous rounds, system prompts, and the results returned from any tools used during execution.
18+
* **Output Tokens:** These include the final response visible to the user, as well as all internal reasoning steps, tool calls, and intermediate results generated by the model.
19+
20+
:::{note}
21+
As the conversation history grows and the agent performs more complex reasoning loops, the input and output token count increases multiplicatively for each round of execution.
22+
:::
23+
24+
For more information on billing and token costs, refer to [Elastic pricing](https://www.elastic.co/pricing).

solutions/search/agent-builder/tools.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -34,6 +34,10 @@ Tools enable agents to work with {{es}} data. When an agent receives a natural l
3434

3535
Each tool is an atomic operation with a defined signature - accepting typed parameters and returning structured results in a format the agent can parse, transform, and incorporate into its response generation.
3636

37+
:::{note}
38+
Tool execution and result processing consume tokens. To understand how usage is calculated, refer to [Token usage in Elastic Agent Builder](monitor-usage.md#token-usage-in-elastic-agent-builder).
39+
:::
40+
3741
## Built-in tools
3842

3943
{{agent-builder}} ships with a comprehensive set of built-in tools that provide core capabilities for working with your {{es}} data. These tools are ready to use. They cannot be modified or deleted.

solutions/search/elastic-agent-builder.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -72,6 +72,12 @@ Configure security roles and API keys to control who can use agents, which tools
7272

7373
[**Learn more about permissions and access control**](agent-builder/permissions.md)
7474

75+
## Monitor usage
76+
77+
Understand how tokens are calculated and accumulated during agent execution to predict the impact on your usage and costs.
78+
79+
[**Learn more about token usage**](agent-builder/monitor-usage.md)
80+
7581
## Limitations and known issues
7682

7783
{{agent-builder}} is in technical preview.

0 commit comments

Comments
 (0)