Skip to main content
Inspect individual runs, tool usage profiles, step trajectories, transcripts, and changed files, or aggregate results across runs. See Read results and Run details.
  • Badges are explained under Approvals.
  • project_id is optional on most tools; without it, the server picks a project for that call only (Projects).
  • expected_organization_id is an optional string on every write tool, omitted from parameter tables; pass organization.id from get_identity (Organization check).
  • limit values above a tool’s maximum are capped, not refused.

Tools

list_runs

List run results. Returns a page of runs with stable IDs, typed errors, and a plain explanation of each result in criteriaSummary. Read-only · CLI: oqoqo runs list Result fields Each run has its stable IDs, typed errors, and criteriaSummary. It can also have:
  • treatmentUse: each tool’s state and calls, as in get_run_profile. It’s null when the run has no usable profile.
  • blockedReason: on a blocked run, its cause and a one-line message.
  • setupFailure: present when a setup command stopped the run before its agent started. It has the owner step, commandNumber when the owner has several commands of that kind (null for a package install, where manager and packageOwners name the package manager and who declared the packages), the command, exitCode (null on a timeout, with timeoutSeconds), the last output lines, and outputTruncated. See troubleshooting.
The scope fields, experiment_id to friction_id, name the records whose runs to read; a run must match them all. list_frictions and get_friction take the same ones, and list_experiments all but experiment_id. An unknown ID returns scope_not_found, not an empty list. scope in the result names each record with its dashboard page.

get_run_profile

Get a run profile. Returns the same profile as the dashboard’s Run profile rail: treatment use, tool calls, what stood out, tokens, cost, and time. Read-only · CLI: oqoqo runs profile Result fields Step ordinals refer to get_run_trajectory, and the per-turn series is the runTurns dataset of query_data.

get_run_trajectory

Get a run trajectory. Returns a page of a run’s steps in order, each with its model turn and tool, plus the run’s input, cached-input, and output token totals (or null). Read-only · CLI: oqoqo runs trajectory Continue with nextAfterOrdinal while truncated is true. Result fields steps (each with its ordinal, model turn, and tool; tool steps include their measured duration when the agent reported it), the run’s token totals, truncated, nextAfterOrdinal, and coverage, which gives the returned range, the total steps, and whether this page holds the whole trajectory. For a custom agent, the run also has the same stopReason, reported model, and agentError as get_run_profile.

get_run_transcript

Get a run’s raw transcript. Returns a page of the original transcript: UTF-8 text in contentText, other bytes as base64 in contentBase64. sha256 covers the whole transcript. Read-only · CLI: oqoqo runs transcript

get_run_output

Get a run’s output and files. Returns a page of the final message, the unified diff, the file manifest, one kept file, or the output archive. Read-only · CLI: oqoqo runs output Text pages are UTF-8 in contentText, and other pages are base64 in contentBase64. sourceTruncated marks a preview that was capped.

analyze_results

Analyze experiment results. Runs one ranked analysis over experiment and run results. Read-only · CLI: oqoqo results analyze scope takes these fields. A run counts only when it matches every field you send. Ranked analysis is never paged: limit is an upper bound, and the response size limit can return fewer items. Result fields When page.truncated is true, these fields say why and where to read the rest: The analysis is in result:
  • summarize_scope: result.totals (runs, passedRuns, failedRuns, evalsFailedRuns, infraBlockedRuns, inconclusiveRuns, pendingRuns) and result.treatments[] (treatmentKey, runCount, passedRuns, failedRuns).
  • compare_treatments: result.treatments[] with the same counts plus failureRate, isReferenceTreatment, and deltaFromReference.failureRate, and result.referenceTreatmentKey.
The pass rate is passedRuns / (passedRuns + failedRuns), or 1 - failureRate. pendingRuns counts runs with no verdict that Evals can still judge. They stay out of the pass and fail counts and out of inconclusiveRuns, so wait until pendingRuns is 0. summarize_scope and search_frictions return insightsCoverage: analyzedRuns, pendingRuns, and unanalyzedRuns (Insights off, skipped, failed, or never run). An empty friction list is final when pendingRuns is 0.

Evals and Insights tools

Compare treatments and read Evals and Insights.

Frictions tools

Rank and inspect frictions across runs.

oqoqo runs and results

The matching CLI commands and run scope flags.