ANSWER HUB
RunLedger record mode
Record mode runs your agent live and writes tool calls and results to cassettes.
Direct Answer
Record mode runs your agent against live tools and writes tool calls plus results to cassettes. Use it when you need fresh fixtures.
Quick Decision
| Use RunLedger when | Consider alternatives when |
|---|---|
| You need new cassettes or updated tool outputs. | You only need deterministic CI runs. |
| You can safely hit live APIs. | Live calls are expensive or restricted. |
| You want to refresh fixtures after changes. | You want fast, offline runs. |
Record command
bash
runledger run ./evals/<suite> --mode recordBest practices
- Record in a stable environment with known inputs.
- Review cassette diffs before committing changes.
- Redact secrets and sensitive payloads.
Note
Record mode should not run in CI.
Tradeoffs
- Record runs are slower and hit live services.
- Recorded outputs can become stale.
- Requires more human review of fixture changes.
When NOT to use RunLedger
Do not use record mode in CI or when your tools return sensitive data you cannot store.