Find slow, failing, and repetitive agent tools without exposing prompts, arguments, or outputs.
Detailed production timing active
6101 of 6166 saved tool calls include execution duration.
Tool calls
498
p50 latency
1.2 s
p95 latency
6.5 s
Tool failures
0.4%
No result
0.0%
Calls / turn
3.7
Material regressions ranked by severity and affected call volume.
Stable against baseline
Tools with enough activity were checked for higher failure rates, available p95 latency regressions, more no-results, and increased loop pressure.
Review the tool comparison for absolute hotspots that may still need a product threshold.
InvestigateRegression checks require at least 3 calls in both windows. Latency is flagged at +20%; failure and no-result rates are flagged at +1 and +3 points respectively.
Successful calls, no-results, and failures combined.
How often results exceed the 20 KB inline cap.
5.0%
handle rows / all calls
309 stored handles in this period. This is a payload-size proxy, not a one-to-one call classification.
Each change is measured against the previous equal window; latency appears only where detailed timing exists.
| Tool | Calls | p50 | p95 | Failures | No result |
|---|---|---|---|---|---|
| app_shell | 498+82% vs prior | 1.2 s-6% vs prior | 6.5 s-52% vs prior | 0.4%-0.3 pts vs prior | 0.0%No change vs prior |
Operational failures only; NoResults is excluded.
The data has known edges that change what a chart means.
Arguments, outputs, user IDs, and message content are never rendered.
Outcome
Success
Thread
ed7becf5…
Tool call
call_lvM…
Turn sequence
10 of 27
Turn state
Completed
Outcome
Success
Thread
ed7becf5…
Tool call
call_XZ5…
Turn sequence
20 of 31
Turn state
Completed
Outcome
Success
Thread
ed7becf5…
Tool call
call_Uqi…
Turn sequence
21 of 31
Turn state
Completed
Outcome
Success
Thread
b612fa70…
Tool call
call_XwL…
Turn sequence
7 of 41
Turn state
Completed
Outcome
Success
Thread
b612fa70…
Tool call
call_tzW…
Turn sequence
10 of 41
Turn state
Completed
Outcome
Success
Thread
b612fa70…
Tool call
call_FFB…
Turn sequence
11 of 41
Turn state
Completed
Outcome
Success
Thread
b612fa70…
Tool call
call_p62…
Turn sequence
41 of 41
Turn state
Completed
Outcome
Success
Thread
dae0a154…
Tool call
call_vme…
Turn sequence
35 of 36
Turn state
Completed
Outcome
Success
Thread
dae0a154…
Tool call
call_yff…
Turn sequence
36 of 36
Turn state
Completed
Outcome
Success
Thread
b9ce5727…
Tool call
chatcmpl…
Turn sequence
4 of 24
Turn state
Completed
Outcome
Success
Thread
b9ce5727…
Tool call
chatcmpl…
Turn sequence
16 of 24
Turn state
Completed
Outcome
Success
Thread
b9ce5727…
Tool call
chatcmpl…
Turn sequence
19 of 24
Turn state
Completed
Outcome
Success
Thread
b9ce5727…
Tool call
chatcmpl…
Turn sequence
23 of 24
Turn state
Completed
Outcome
Success
Thread
b9ce5727…
Tool call
call_Ego…
Turn sequence
15 of 39
Turn state
Completed
Outcome
Success
Thread
b9ce5727…
Tool call
call_MnX…
Turn sequence
18 of 39
Turn state
Completed
Outcome
Success
Thread
b9ce5727…
Tool call
call_owu…
Turn sequence
28 of 39
Turn state
Completed
Outcome
Success
Thread
b9ce5727…
Tool call
call_AZh…
Turn sequence
29 of 39
Turn state
Completed
Outcome
Success
Thread
b9ce5727…
Tool call
call_hBs…
Turn sequence
34 of 39
Turn state
Completed
Outcome
Success
Thread
b9ce5727…
Tool call
call_hGi…
Turn sequence
38 of 39
Turn state
Completed
Outcome
Success
Thread
b9ce5727…
Tool call
call_I4T…
Turn sequence
39 of 39
Turn state
Completed
Outcome
Success
Thread
20a1bcaf…
Tool call
call_ab1…
Turn sequence
17 of 40
Turn state
Completed
Outcome
Success
Thread
20a1bcaf…
Tool call
call_yex…
Turn sequence
23 of 40
Turn state
Completed
Outcome
Success
Thread
20a1bcaf…
Tool call
call_Z9E…
Turn sequence
32 of 40
Turn state
Completed
Outcome
Success
Thread
20a1bcaf…
Tool call
call_EX0…
Turn sequence
35 of 40
Turn state
Completed
