- Badges are explained under Approvals.
project_idis optional on most tools; without it, the server picks a project for that call only (Projects).expected_organization_idis an optional string on every write tool, omitted from parameter tables; passorganization.idfromget_identity(Organization check).limitvalues above a tool’s maximum are capped, not refused.
Tools
list_runs
List run results. Returns a page of runs with stable IDs, typed errors, and a plain explanation of each result incriteriaSummary.
Read-only · CLI: oqoqo runs list
Result fields
Each run has its stable IDs, typed errors, and
criteriaSummary. It can also have:
treatmentUse: each tool’s state and calls, as inget_run_profile. It’s null when the run has no usable profile.blockedReason: on a blocked run, itscauseand a one-linemessage.setupFailure: present when a setup command stopped the run before its agent started. It has theownerstep,commandNumberwhen the owner has several commands of that kind (null for a package install, wheremanagerandpackageOwnersname the package manager and who declared the packages), thecommand,exitCode(null on a timeout, withtimeoutSeconds), the lastoutputlines, andoutputTruncated. See troubleshooting.
experiment_id to friction_id, name the records whose runs to read; a run must match them all. list_frictions and get_friction take the same ones, and list_experiments all but experiment_id. An unknown ID returns scope_not_found, not an empty list. scope in the result names each record with its dashboard page.
get_run_profile
Get a run profile. Returns the same profile as the dashboard’s Run profile rail: treatment use, tool calls, what stood out, tokens, cost, and time. Read-only · CLI:oqoqo runs profile
Result fields
Step ordinals refer to
get_run_trajectory, and the per-turn series is the runTurns dataset of query_data.
get_run_trajectory
Get a run trajectory. Returns a page of a run’s steps in order, each with its model turn and tool, plus the run’s input, cached-input, and output token totals (or null). Read-only · CLI:oqoqo runs trajectory
Continue with
nextAfterOrdinal while truncated is true.
Result fields
steps (each with its ordinal, model turn, and tool; tool steps include their measured duration when the agent reported it), the run’s token totals, truncated, nextAfterOrdinal, and coverage, which gives the returned range, the total steps, and whether this page holds the whole trajectory. For a custom agent, the run also has the same stopReason, reported model, and agentError as get_run_profile.
get_run_transcript
Get a run’s raw transcript. Returns a page of the original transcript: UTF-8 text incontentText, other bytes as base64 in contentBase64. sha256 covers the whole transcript.
Read-only · CLI: oqoqo runs transcript
get_run_output
Get a run’s output and files. Returns a page of the final message, the unified diff, the file manifest, one kept file, or the output archive. Read-only · CLI:oqoqo runs output
Text pages are UTF-8 in
contentText, and other pages are base64 in contentBase64. sourceTruncated marks a preview that was capped.
analyze_results
Analyze experiment results. Runs one ranked analysis over experiment and run results. Read-only · CLI:oqoqo results analyze
scope takes these fields. A run counts only when it matches every field you send.
Ranked analysis is never paged:
limit is an upper bound, and the response size limit can return fewer items.
Result fields
When page.truncated is true, these fields say why and where to read the rest:
The analysis is in
result:
summarize_scope:result.totals(runs,passedRuns,failedRuns,evalsFailedRuns,infraBlockedRuns,inconclusiveRuns,pendingRuns) andresult.treatments[](treatmentKey,runCount,passedRuns,failedRuns).compare_treatments:result.treatments[]with the same counts plusfailureRate,isReferenceTreatment, anddeltaFromReference.failureRate, andresult.referenceTreatmentKey.
passedRuns / (passedRuns + failedRuns), or 1 - failureRate. pendingRuns counts runs with no verdict that Evals can still judge. They stay out of the pass and fail counts and out of inconclusiveRuns, so wait until pendingRuns is 0. summarize_scope and search_frictions return insightsCoverage: analyzedRuns, pendingRuns, and unanalyzedRuns (Insights off, skipped, failed, or never run). An empty friction list is final when pendingRuns is 0.
Related
Evals and Insights tools
Compare treatments and read Evals and Insights.
Frictions tools
Rank and inspect frictions across runs.
oqoqo runs and results
The matching CLI commands and run scope flags.

