Skip to main content
A treatment is one condition in an experiment. Change one thing at a time so you can see what helped. Create treatments under Manage → Treatments. Build the pieces under Manage → Assets, then attach them here. See Assets. Files and a machine attach to the task. Skills, MCP servers, CLIs, and SDKs attach to the treatment. Agents are chosen at launch. See Core concepts.

​
What belongs on a treatment

  • The raw agent with no extra help (usually your baseline)
  • The agent with one or more skills
  • The agent with one or more MCP servers
  • The agent with a CLI or SDK
  • A mix of the above
Include several treatments in one experiment to compare them together. Treatment page with asset types and attached assets.

​
What does not belong on a treatment

Files and Machines attach to the task, not the treatment. When two treatments run on the same task, they share that task’s files and machine. Only the attached assets differ. If you need a different environment or starting folders, change the task, or use a different task. Agents are not part of a treatment. You choose them at launch. See Supported agents.

​
Lift

Lift is the change in pass rate from a treatment versus your baseline. Positive lift means the treatment helped. Example: raw agent passes 3 of 10 runs; agent with your skill passes 8 of 10. That is real lift. Agents are not deterministic, so use several trials so each treatment is measured across repeated runs.

​
Example

  1. Create a skill, MCP server, CLI, or SDK under Manage → Assets.
  2. Create two treatments: baseline (raw agent), and one with your asset attached.
  3. Select a task that already has the right files and machine.
  4. Launch both treatments with the same agents and a few trials.
  5. Read Matrix for lift and Frictions for remaining blockers.