Skip to main content
After an experiment finishes, use three experiment tabs: Matrix, Runs, and Frictions. Open any run for Traces, Output, and Evals. You can also open All experiments and All runs from the dashboard Analyze section for project-wide lists.

​
Run and trial

A run is one agent attempt on a task under a treatment. The task brings its files and machine. The treatment brings its assets. The agent is who attempts the work. See Core concepts. A trial is a repeat of the same inputs. Trials = 2 launches two runs with the same task, treatment, and agent. Each costs one run from your balance. Agents are not deterministic. Repeats turn a lucky or unlucky one-off into a pass rate you can trust.
For quota and plans, see Billing.

​
Pass rate and lift

Pass rate is the fraction of those repeated runs that passed, with a 95% confidence interval. More trials narrow the interval. Lift is the change in pass rate from a treatment versus the baseline. Positive lift means the treatment helped. Your skill, MCP server, CLI, or SDK made agents more successful.

​
Matrix

Matrix lines up tasks, agents, and treatments. You see pass rate, lift, cost, tokens, and duration together. Use it to pick what works well and cheaply. Experiment Matrix with search, metric controls, and result cells.

​
Runs

Runs lists every execution. Open a run to review its recorded work.

​
Compare runs side by side

  1. On the Runs list, select 2 or 3 runs.
  2. Choose Compare.
  3. Review shared Traces, Output, and Evals columns.
You can compare at most three runs at once. One selection opens that run’s detail page instead.

​
Export a transcript

On run detail, choose Export transcript. Oqoqo downloads the recorded trajectory artifact for that run. CLI and MCP can also fetch a run transcript. See Traces and output.

​
Frictions

Frictions shows where agents got stuck. Findings come from Insights. See Frictions.

​
Metrics

Every run records steps, tool calls, tokens, cost, and duration. Metrics show how hard an agent worked, not only whether it passed.

​
Ask Oqo

Use Ask Oqo for a plain-language summary of Matrix, frictions, or a specific run.