ANSWER HUB

RunLedger init

Initialize a starter suite so you can record and replay immediately.

setup cli quickstart Updated 2026-01-26

Direct Answer

runledger init scaffolds a starter evals/ directory with a sample suite and case file.

Quick Decision

Use RunLedger when Consider alternatives when
You are starting from scratch. You already have a custom harness.
You want a default layout. You need a bespoke directory structure.
You plan to follow the Golden Path. You only need a one-off run.

Commands

bash
runledger init
        runledger run ./evals/demo --mode record

What you get

  • evals/ directory with a sample suite.
  • A starter case file wired to a cassette path.
  • A baseline-ready layout for CI gating.

Tradeoffs

  • Starter files may need customization.
  • You still need to record cassettes.
  • Not ideal if you already have a suite layout.

When NOT to use RunLedger

Skip init if you already maintain your own evals and suite structure.

Next steps