Latency regression
get_collection_fields p95 slowed 3180%
164 ms now vs 5 ms previously across 158 calls.
Open the tool view and inspect the slowest recent calls for a repeatable bottleneck.
InvestigateBidlo Status Frontend
Chat tool telemetry
Find slow, failing, and repetitive agent tools without exposing prompts, arguments, or outputs.
Detailed production timing active
6096 of 6161 saved tool calls include execution duration.
Tool calls
6.2K
+88% vs previous 7d408 saved production turns
p50 latency
365 ms
-6% vs previous 7d6096 timed calls
p95 latency
7.0 s
+22% vs previous 7d6096 timed calls
Tool failures
3.2%
+0.1 pts vs previous 7d199 excluding NoResults
No result
0.0%
No change vs previous 7d0 product outcomes
Calls / turn
15.1
+27% vs previous 7d70.6% of turns at 5+ calls
What changed
Material regressions ranked by severity and affected call volume.
Reliability regression
search_document failures increased
30.9% now vs 0.0% previously across 97 calls; ProviderError is the leading code.
Inspect recent failures, then check the tool handler and upstream dependency logs.
InvestigateReliability regression
read_tool_result failures increased
9.9% now vs 0.0% previously across 111 calls; NotFound is the leading code.
Inspect recent failures, then check the tool handler and upstream dependency logs.
InvestigateReliability regression
shell failures increased
4.6% now vs 3.1% previously across 371 calls; Timeout is the leading code.
Inspect recent failures, then check the tool handler and upstream dependency logs.
InvestigateRegression checks require at least 3 calls in both windows. Latency is flagged at +20%; failure and no-result rates are flagged at +1 and +3 points respectively.
Execution volume
Successful calls, no-results, and failures combined.
Calls
Oct 1Oct 4Oct 7
Payload pressure
How often results exceed the 20 KB inline cap.
5.0%
handle rows / all calls
309 stored handles in this period. This is a payload-size proxy, not a one-to-one call classification.
Tool comparison
Each change is measured against the previous equal window; latency appears only where detailed timing exists.
| Tool | Calls | p50 | p95 | Failures | No result |
|---|---|---|---|---|---|
| run_subagents | 65+171% vs prior | 28 s+80% vs prior | 1.4 min+142% vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| run_flow | 52+767% vs prior | 1.0 min+34% vs prior | 1.1 min+17% vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| shell | 371+94% vs prior | 1.1 s+152% vs prior | 26 s+2% vs prior | 4.6%+1.4 pts vs prior | 0.0%No change vs prior |
| app_typecheck | 200+42% vs prior | 155 ms-4% vs prior | 20 sNo change vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| app_update_kit | 4No prior data | 4.3 sNo prior timing | 13 sNo prior timing | 0.0%No prior data | 0.0%No prior data |
| publish_flow | 14+600% vs prior | 728 ms+6% vs prior | 12 s+1571% vs prior | 14.3%+14.3 pts vs prior | 0.0%No change vs prior |
| load_office_document | 27+93% vs prior | 1.0 s+2571% vs prior | 9.5 s+524% vs prior | 29.6%-56.1 pts vs prior | 0.0%No change vs prior |
| mutate_database | 43+26% vs prior | 281 ms-40% vs prior | 9.1 s-10% vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| create_app | 8+167% vs prior | 3.1 s-16% vs prior | 8.4 s+118% vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| app_edit_file | 1,104+74% vs prior | 1.5 s+53% vs prior | 6.9 s+18% vs prior | 0.6%+0.5 pts vs prior | 0.0%No change vs prior |
| app_shell | 498+82% vs prior | 1.2 s-6% vs prior | 6.5 s-52% vs prior | 0.4%-0.3 pts vs prior | 0.0%No change vs prior |
| app_write_file | 97+185% vs prior | 1.5 s+118% vs prior | 5.5 s+127% vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| app_delete_file | 10+900% vs prior | 781 ms+78% vs prior | 5.4 s+1133% vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| query_database_data | 473+134% vs prior | 267 msNo change vs prior | 3.6 s+191% vs prior | 8.2%-5.1 pts vs prior | 0.0%No change vs prior |
| mutate_schema | 5+400% vs prior | 1.9 s+4800% vs prior | 2.9 s+7441% vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| save_attachment_to_workspace | 3-40% vs prior | 350 msNew activity vs prior | 2.6 sNew activity vs prior | 0.0%-100.0 pts vs prior | 0.0%No change vs prior |
| officecli_status | 10+900% vs prior | 708 ms-46% vs prior | 2.6 s+98% vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| search_files | 5+400% vs prior | 2.4 s+322% vs prior | 2.5 s+342% vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| upload_workspace_file | 25+400% vs prior | 1.0 s+2% vs prior | 2.4 s+82% vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| list_files | 13+333% vs prior | 96 ms-72% vs prior | 2.4 s+10% vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| look_at_map | 13No prior data | 952 msNo prior timing | 2.3 sNo prior timing | 30.8%No prior data | 0.0%No prior data |
| read_file | 151+278% vs prior | 107 ms-15% vs prior | 2.0 s-13% vs prior | 0.7%+0.7 pts vs prior | 0.0%No change vs prior |
| app_run_data_request | 161+19% vs prior | 398 ms-30% vs prior | 1.9 s+139% vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| update_map | 8No prior data | 662 msNo prior timing | 1.6 sNo prior timing | 37.5%No prior data | 0.0%No prior data |
| hcss_api | 40+264% vs prior | 272 ms+20% vs prior | 1.3 s+284% vs prior | 0.0%-9.1 pts vs prior | 0.0%No change vs prior |
| app_read_file | 1,287+112% vs prior | 322 ms-57% vs prior | 1.2 s-19% vs prior | 0.8%-0.2 pts vs prior | 0.0%No change vs prior |
| resolve_documents_by_name | 60+200% vs prior | 215 ms-42% vs prior | 1.2 s+23% vs prior | 8.3%+8.3 pts vs prior | 0.0%No change vs prior |
| update_canvas | 25-46% vs prior | 457 ms-7% vs prior | 1.1 s+8% vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| app_list_files | 53+308% vs prior | 124 ms+19% vs prior | 869 ms-49% vs prior | 3.8%+3.8 pts vs prior | 0.0%No change vs prior |
| app_dev_server_log | 192+27% vs prior | 130 ms+2% vs prior | 837 ms-10% vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| update_database_view | 10+25% vs prior | 387 ms-35% vs prior | 767 ms+19% vs prior | 40.0%+40.0 pts vs prior | 0.0%No change vs prior |
| apply_page_layout_ops | 5-17% vs prior | 470 ms+23400% vs prior | 736 ms+66% vs prior | 0.0%-50.0 pts vs prior | 0.0%No change vs prior |
| get_hcss_connections | 3-25% vs prior | 550 ms-22% vs prior | 735 ms-70% vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| manage_sharing | 1-80% vs prior | 625 ms+63% vs prior | 625 ms-52% vs prior | 0.0%-20.0 pts vs prior | 0.0%No change vs prior |
| create_database_view | 5-17% vs prior | 490 ms+17% vs prior | 599 ms-6% vs prior | 20.0%+3.3 pts vs prior | 0.0%No change vs prior |
| search_notes | 13-38% vs prior | 440 ms-5% vs prior | 598 ms+9% vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| create_dashboard_view | 6No prior data | 526 msNo prior timing | 590 msNo prior timing | 0.0%No prior data | 0.0%No prior data |
| save_flow | 40+700% vs prior | 286 ms-14% vs prior | 581 ms-20% vs prior | 2.5%+2.5 pts vs prior | 0.0%No change vs prior |
| get_database_view | 47-2% vs prior | 320 ms+28% vs prior | 555 ms-8% vs prior | 19.1%-10.0 pts vs prior | 0.0%No change vs prior |
| build_app | 32+191% vs prior | 452 ms+3% vs prior | 546 ms+1% vs prior | 3.1%-15.1 pts vs prior | 0.0%No change vs prior |
| get_flow | 34No prior data | 319 msNo prior timing | 390 msNo prior timing | 0.0%No prior data | 0.0%No prior data |
| query_mentioned_document | 252+163% vs prior | 178 ms+1% vs prior | 382 ms-72% vs prior | 6.3%-2.0 pts vs prior | 0.0%No change vs prior |
| app_attach_flow | 2No prior data | 339 msNo prior timing | 346 msNo prior timing | 0.0%No prior data | 0.0%No prior data |
| save_agent | 2No prior data | 329 msNo prior timing | 342 msNo prior timing | 0.0%No prior data | 0.0%No prior data |
| set_flow_enabled | 3No prior data | 326 msNo prior timing | 336 msNo prior timing | 0.0%No prior data | 0.0%No prior data |
| write_file | 15+36% vs prior | 103 ms-8% vs prior | 317 ms-4% vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| get_page_layout | 34+6% vs prior | 106 ms-45% vs prior | 303 ms+1% vs prior | 52.9%+9.2 pts vs prior | 0.0%No change vs prior |
| get_integration | 1No prior data | 291 msNo prior timing | 291 msNo prior timing | 0.0%No prior data | 0.0%No prior data |
| app_list_flow_bindings | 8No prior data | 235 msNo prior timing | 289 msNo prior timing | 0.0%No prior data | 0.0%No prior data |
| update_memory | 12+200% vs prior | 190 ms-14% vs prior | 281 ms+1% vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| edit_document_notes | 4-60% vs prior | 206 ms+4% vs prior | 266 ms-2% vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| get_team_collections | 16+60% vs prior | 1 msNo change vs prior | 264 ms+37% vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| get_flow_runs | 6No prior data | 221 msNo prior timing | 263 msNo prior timing | 0.0%No prior data | 0.0%No prior data |
| write_field_estimate | 3No prior data | 250 msNo prior timing | 250 msNo prior timing | 0.0%No prior data | 0.0%No prior data |
| list_flows | 8No prior data | 179 msNo prior timing | 231 msNo prior timing | 0.0%No prior data | 0.0%No prior data |
| deep_research | 1No change vs prior | 214 msNo change vs prior | 214 msNo change vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| get_document_notes | 20+33% vs prior | 169 ms+1% vs prior | 211 ms+7% vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| get_flow_run | 40No prior data | 144 msNo prior timing | 190 msNo prior timing | 2.5%No prior data | 0.0%No prior data |
| search_document | 97+52% vs prior | 102 ms-28% vs prior | 176 ms-18% vs prior | 30.9%+30.9 pts vs prior | 0.0%No change vs prior |
| revise_sync_map | 1No change vs prior | 174 ms-89% vs prior | 174 ms-89% vs prior | 100.0%+100.0 pts vs prior | 0.0%No change vs prior |
| get_collection_fields | 158+25% vs prior | 2 msNo change vs prior | 164 ms+3180% vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| save_skill | 1No prior data | 150 msNo prior timing | 150 msNo prior timing | 0.0%No prior data | 0.0%No prior data |
| read_tool_result | 111+66% vs prior | 0 ms-100% vs prior | 138 ms+35% vs prior | 9.9%+9.9 pts vs prior | 0.0%No change vs prior |
| get_document_page | 73-13% vs prior | 75 ms-4% vs prior | 116 ms-23% vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| plan_import | 3No prior data | 37 msNo prior timing | 87 msNo prior timing | 66.7%No prior data | 0.0%No prior data |
| update_pdf_layers | 1No prior data | 75 msNo prior timing | 75 msNo prior timing | 100.0%No prior data | 0.0%No prior data |
| check_capabilities | 64+121% vs prior | 1 ms-50% vs prior | 3 msNo change vs prior | 0.0%No change vs prior | 0.0%No change vs prior |
| web_search | 9-18% vs prior | —Not instrumented | —Not instrumented | 0.0%No change vs prior | 0.0%No change vs prior |
| connect_integration | 2No prior data | —Not instrumented | —Not instrumented | 100.0%No prior data | 0.0%No prior data |
| render_pdf_region | 1-50% vs prior | —Not instrumented | —Not instrumented | 100.0%+100.0 pts vs prior | 0.0%No change vs prior |
Failure codes
Operational failures only; NoResults is excluded.
InvalidArguments76
NotFound46
ProviderError30
Unknown23
Timeout22
Aborted2
Interpretation notes
The data has known edges that change what a chart means.
- Blocked loops are invisible
- Rate-limited and identical-argument calls are rejected before telemetry fires.
- NoResults is not downtime
- It remains a failed tool outcome, but is separated from runtime reliability here.
- Preview volume lives elsewhere
- Preview and threadless chats reach PostHog but are intentionally absent from Postgres.
- Latency is partially instrumented
- Saved tool parts provide production outcomes and volume; duration appears only on calls with detailed telemetry.
- Partial turns are retained
- They remain in volume counts but are excluded from failures and latency percentiles.
- Comparisons use equal windows
- Every delta compares the selected period with the immediately preceding period under the same tool and team filters.
Recent sanitized calls
Arguments, outputs, user IDs, and message content are never rendered.
get_flow_runHJC170 msOct 6, 8:24 PM UTC
Outcome
Success
Thread
ed7becf5…
Tool call
call_XIZ…
Turn sequence
1 of 1
Turn state
Completed
check_capabilitiesHJC1 msOct 6, 8:04 PM UTC
Outcome
Success
Thread
ed7becf5…
Tool call
call_Kbd…
Turn sequence
1 of 29
Turn state
Completed
get_team_collectionsHJC264 msOct 6, 8:04 PM UTC
Outcome
Success
Thread
ed7becf5…
Tool call
call_wuO…
Turn sequence
2 of 29
Turn state
Completed
run_subagentsHJC18 sOct 6, 8:04 PM UTC
Outcome
Success
Thread
ed7becf5…
Tool call
call_CS0…
Turn sequence
3 of 29
Turn state
Completed
get_collection_fieldsHJC2 msOct 6, 8:05 PM UTC
Outcome
Success
Thread
ed7becf5…
Tool call
call_bnb…
Turn sequence
4 of 29
Turn state
Completed
search_documentHJC141 msOct 6, 8:05 PM UTC
Outcome
Success
Thread
ed7becf5…
Tool call
call_pej…
Turn sequence
5 of 29
Turn state
Completed
resolve_documents_by_nameHJC154 msOct 6, 8:05 PM UTC
Outcome
Success
Thread
ed7becf5…
Tool call
call_Jz2…
Turn sequence
6 of 29
Turn state
Completed
search_documentHJC175 msOct 6, 8:05 PM UTC
Outcome
Success
Thread
ed7becf5…
Tool call
call_2qK…
Turn sequence
7 of 29
Turn state
Completed
query_database_dataHJC127 msOct 6, 8:05 PM UTC
Outcome
Success
Thread
ed7becf5…
Tool call
call_dci…
Turn sequence
8 of 29
Turn state
Completed
app_read_fileHJC542 msOct 6, 8:05 PM UTC
Outcome
Success
Thread
ed7becf5…
Tool call
call_lWd…
Turn sequence
9 of 29
Turn state
Completed
mutate_schemaHJC1.9 sOct 6, 8:06 PM UTC
Outcome
Success
Thread
ed7becf5…
Tool call
call_u2J…
Turn sequence
10 of 29
Turn state
Completed
run_subagentsHJC2.6 minOct 6, 8:09 PM UTC
Outcome
Success
Thread
ed7becf5…
Tool call
call_74S…
Turn sequence
11 of 29
Turn state
Completed
run_subagentsHJC60 sOct 6, 8:10 PM UTC
Outcome
Success
Thread
ed7becf5…
Tool call
call_iwb…
Turn sequence
12 of 29
Turn state
Completed
app_read_fileHJC143 msOct 6, 8:10 PM UTC
Outcome
Success
Thread
ed7becf5…
Tool call
call_MP8…
Turn sequence
13 of 29
Turn state
Completed
app_read_fileHJC149 msOct 6, 8:10 PM UTC
Outcome
Success
Thread
ed7becf5…
Tool call
call_L6i…
Turn sequence
14 of 29
Turn state
Completed
app_read_fileHJC94 msOct 6, 8:10 PM UTC
Outcome
Success
Thread
ed7becf5…
Tool call
call_EOP…
Turn sequence
15 of 29
Turn state
Completed
app_run_data_requestHJC428 msOct 6, 8:10 PM UTC
Outcome
Success
Thread
ed7becf5…
Tool call
call_sDA…
Turn sequence
16 of 29
Turn state
Completed
app_read_fileHJC85 msOct 6, 8:10 PM UTC
Outcome
Success
Thread
ed7becf5…
Tool call
call_Noe…
Turn sequence
17 of 29
Turn state
Completed
app_write_fileHJC1.8 sOct 6, 8:10 PM UTC
Outcome
Success
Thread
ed7becf5…
Tool call
call_bhH…
Turn sequence
18 of 29
Turn state
Completed
app_edit_fileHJC1.1 sOct 6, 8:10 PM UTC
Outcome
Success
Thread
ed7becf5…
Tool call
call_d4g…
Turn sequence
19 of 29
Turn state
Completed
app_edit_fileHJC831 msOct 6, 8:11 PM UTC
Outcome
Success
Thread
ed7becf5…
Tool call
call_IHn…
Turn sequence
20 of 29
Turn state
Completed
app_edit_fileHJC1.0 sOct 6, 8:11 PM UTC
Outcome
Success
Thread
ed7becf5…
Tool call
call_g70…
Turn sequence
21 of 29
Turn state
Completed
app_read_fileHJC79 msOct 6, 8:11 PM UTC
Outcome
Success
Thread
ed7becf5…
Tool call
call_4Q3…
Turn sequence
22 of 29
Turn state
Completed
app_edit_fileHJC324 msOct 6, 8:11 PM UTC
Outcome
Success
Thread
ed7becf5…
Tool call
call_LFw…
Turn sequence
23 of 29
Turn state
Completed