> ## Documentation Index
> Fetch the complete documentation index at: https://docs.oqoqo.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Read results

> Read an experiment's Matrix, Comparisons, Frictions, and Runs, compare runs side by side, and download a run's trajectory.

Every experiment has three tabs—**Matrix**, **Frictions**, and **Runs**—taking you from high-level pass rates down to individual agent turns. **Comparisons** is a collapsed section below the **Matrix** grid.

## Read an experiment in this order

1. [**Matrix**](#matrix): see which tasks passed or failed across treatments and agents, alongside cost and duration.
2. [**Comparisons**](https://docs.oqoqo.ai/evaluation/comparisons.md), below the **Matrix** grid: check which differences hold up across tasks and read the **Brief** on frictions seen with the side that did worse.
3. [**Frictions**](https://docs.oqoqo.ai/evaluation/frictions.md): prioritize the recurring problems blocking agents and see where to fix each one.
4. [**Runs**](#runs) & [**Evals**](https://docs.oqoqo.ai/evaluation/evals.md): open failed or slow runs to inspect which rubric criteria failed on the **Evals** tab before reading [Traces](https://docs.oqoqo.ai/evaluation/traces.md).

## Pass rate and lift

**Pass rate** is the percentage of scored runs that passed the task's rubric in [Evals](https://docs.oqoqo.ai/evaluation/evals.md) (blocked runs have no verdict and are excluded; see [setup and machine errors](https://docs.oqoqo.ai/reference/troubleshooting.md#a-run-could-not-start-because-a-setup-command-failed) if runs could not start). Because each [trial](https://docs.oqoqo.ai/experiments/overview.md#trials) is a separate run, repeating trials steadies each cell's pass rate.

**Lift** is the difference in pass rate between a treatment and the [baseline](https://docs.oqoqo.ai/experiments/overview.md#baseline-and-lift) you selected [at launch](https://docs.oqoqo.ai/experiments/launch.md#choose-treatments-and-a-baseline). **Matrix** displays raw pass rates rather than a lift column, so compare cells side by side:

1. Set **Matrix metric** to **Evals**.
2. Compare the treatment's cell and the baseline's cell on the same task and agent, hovering for exact trial counts.

For example, if the baseline passes 1 of 4 trials (25%) and your treatment passes 3 of 4 trials (75%), the treatment's lift on that task is **+50 percentage points**. Because single-task swings can mislead, check [Comparisons](https://docs.oqoqo.ai/evaluation/comparisons.md) before treating a difference as settled, or follow [Measure a tool's impact](https://docs.oqoqo.ai/guides/measure-tool-lift.md).

## Matrix

**Matrix** maps tasks against agent-and-treatment combinations as a heat map. Switch **Matrix metric** to inspect different dimensions across all trials in each cell:

| Metric | What each cell shows |
| - | - |
| **Evals** | Pass rate (default when Evals ran) |
| **Steps**, **Tool calls** | Average steps or tool calls per run |
| **Treatment use** | Share of trials where the agent called a treatment tool (lower bound; excludes calls inside scripts) |
| **Frictions** | Average frictions per run |
| **Tokens**, **Cost** | Average tokens or USD cost (**Mixed sources** shows separate means if cost sources differ) |
| **Duration** | Agent working time excluding machine setup and overhead |

Hover over any cell for exact trial counts or min/max/spread statistics; a `*` marks incomplete trials or missing metrics (see [Evals or Insights troubleshooting](https://docs.oqoqo.ai/reference/troubleshooting.md#evals-or-insights-did-not-run)). Filter the grid by task, Evals verdict, treatment, or agent, or select **Transpose** to swap rows and columns.

Above the grid, a one-line banner summarizes the [Comparisons](https://docs.oqoqo.ai/evaluation/comparisons.md#answers) outcome. Its link expands **Comparisons** below the grid and scrolls to it.

![The Matrix with one line above the grid: Brief, Stripe CLI did better than Raw Agent on all 7 tasks, and See the differences.](https://mintcdn.com/oqoqo/k4Yj05MbUPbdkSQD/images/screenshots/matrix-answer-line-light.png?fit=max\&auto=format\&n=k4Yj05MbUPbdkSQD\&q=85\&s=c57dc845245122f26b061031099391ab)

In this transposed **Stripe interface evals** Matrix, **Raw Agent** fails four of five tasks while **Stripe CLI** passes more across every agent.

![Matrix with the Evals metric: rows are agent and treatment combinations, columns are five tasks, and each cell shows a pass rate.](https://mintcdn.com/oqoqo/YO1ysyUx4SPwBwoz/images/screenshots/matrix-light.png?fit=max\&auto=format\&n=YO1ysyUx4SPwBwoz\&q=85\&s=e94b77d566a04c02f10cdef053e1bcda)

## Runs

**Runs** lists every run with its task, treatment, agent, trial, Evals result, and **Treatment use** status ([Run profile](https://docs.oqoqo.ai/evaluation/run-profile.md#when-the-profile-cannot-answer)). Filter by **Evals**, **Status**, **Treatment (toolset)**, **Agent**, or toggle **Best trials** to keep only the top trial per combination.

![Experiment Runs tab with filters and a Treatment use column for each run.](https://mintcdn.com/oqoqo/YO1ysyUx4SPwBwoz/images/screenshots/runs-list-light.png?fit=max\&auto=format\&n=YO1ysyUx4SPwBwoz\&q=85\&s=e52f394bb8bf0e97b2d85db8654410b7)

Open any run and select **⋯** to [download its trajectory, output files, or diff](https://docs.oqoqo.ai/evaluation/traces.md#download-the-trajectory).

## Compare runs side by side

Select two or three runs in **Runs** (or select **Compare** inside an open run) to inspect their **Traces**, **Output**, **Evals**, and **Run profile** side by side across columns.

## Find results across the project

Use the **Analyze** group in the sidebar to inspect results across every experiment in the project:

| Page | What it lists |
| - | - |
| **All experiments** | All project experiments and statuses |
| **All runs** | All runs across experiments, with an added **Experiment** filter |
| **All frictions** | All [project frictions](https://docs.oqoqo.ai/evaluation/frictions.md#friction-lists) |

You can also ask [Ask Oqo](https://docs.oqoqo.ai/operate/ask-oqo.md) or your AI assistant via the [Oqoqo Plugin](https://docs.oqoqo.ai/operate/plugin.md) to summarize any experiment.

## From the CLI and the plugin

| Task | CLI | Plugin (MCP) |
| - | - | - |
| Check experiment status | [`oqoqo experiments status`](https://docs.oqoqo.ai/cli/experiments#oqoqo-experiments-status) | [`get_experiment_status`](https://docs.oqoqo.ai/mcp-server/experiments#get_experiment_status) |
| Summarize or compare treatments | [`oqoqo results analyze`](https://docs.oqoqo.ai/cli/runs#oqoqo-results-analyze) | [`analyze_results`](https://docs.oqoqo.ai/mcp-server/runs-and-results#analyze_results) |
| Read the Brief | [`oqoqo experiments brief`](https://docs.oqoqo.ai/cli/experiments#oqoqo-experiments-brief) | [`get_experiment_brief`](https://docs.oqoqo.ai/mcp-server/evals-and-insights#get_experiment_brief) |
| Check statistical comparisons | [`oqoqo evals compare`](https://docs.oqoqo.ai/cli/evals-and-insights#oqoqo-evals-compare) | [`get_evals_comparisons`](https://docs.oqoqo.ai/mcp-server/evals-and-insights#get_evals_comparisons) |
| List and filter runs | [`oqoqo runs list`](https://docs.oqoqo.ai/cli/runs#oqoqo-runs-list) | [`list_runs`](https://docs.oqoqo.ai/mcp-server/runs-and-results#list_runs) |
| Inspect profile, steps, transcript, or output | [`runs profile`](https://docs.oqoqo.ai/cli/runs#oqoqo-runs-profile), [`trajectory`](https://docs.oqoqo.ai/cli/runs#oqoqo-runs-trajectory), [`transcript`](https://docs.oqoqo.ai/cli/runs#oqoqo-runs-transcript), [`output`](https://docs.oqoqo.ai/cli/runs#oqoqo-runs-output) | [`get_run_profile`](https://docs.oqoqo.ai/mcp-server/runs-and-results#get_run_profile), [`get_run_trajectory`](https://docs.oqoqo.ai/mcp-server/runs-and-results#get_run_trajectory), [`get_run_transcript`](https://docs.oqoqo.ai/mcp-server/runs-and-results#get_run_transcript), [`get_run_output`](https://docs.oqoqo.ai/mcp-server/runs-and-results#get_run_output) |
| Query structured datasets | [`oqoqo data query`](https://docs.oqoqo.ai/cli/data#oqoqo-data-query) | [`query_data`](https://docs.oqoqo.ai/mcp-server/tags-and-data#query_data) |

## Next steps

> [card] [Comparisons](https://docs.oqoqo.ai/evaluation/comparisons.md)
>
> Verify which differences hold up and read the Brief.

> [card] [Frictions](https://docs.oqoqo.ai/evaluation/frictions.md)
>
> Rank and fix the problems stopping agents.

> [card] [Run details](https://docs.oqoqo.ai/evaluation/traces.md)
>
> Inspect step-by-step traces, outputs, and diffs.

> [card] [Evals](https://docs.oqoqo.ai/evaluation/evals.md)
>
> See how rubric verdicts are scored.


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.