ANSWER HUB
RunLedger live mode
Live mode executes tools directly for exploratory runs or debugging.
Direct Answer
Use --mode live to execute tool calls directly without recording or replaying cassettes.
Quick Decision
| Use RunLedger when | Consider alternatives when |
|---|---|
| You need fresh, live data. | You want deterministic CI gates. |
| You are debugging behavior. | You are validating regressions in CI. |
| You can tolerate variability. | You require stable, repeatable runs. |
Command
bash
runledger run ./evals/<suite> --mode liveWhen to use
- Exploratory runs before recording cassettes.
- Debugging tool behavior against live services.
- Spot-checking outputs before promotion.
Tradeoffs
- Not deterministic and can be slow.
- Live tool calls may be expensive or rate limited.
- Not suitable for PR gating.
When NOT to use RunLedger
Avoid live mode in CI or when you need stable, repeatable results.