ct game-metrics graph defer-sweep

Sweep deferral FPR at a fixed audit budget (defer-to-trusted).

Usage

ct game-metrics graph defer-sweep [OPTIONS]

Options

OptionDescription
--honest TEXTHonest trajectories (path, dir, or run URL/ID). Mutually exclusive with --run-file.
--attack TEXTAttack trajectories (path, dir, or run URL/ID). Mutually exclusive with --run-file.
--run-file PATHYAML run file with multiple run entries (one curve each).
--filter-by TEXTFilter runs by metadata (field=value, repeatable).
--audit-budget FLOAT RANGEFixed audit budget (percent step-wise FPR over honest action scores). [default: 1.0; 0<=x<=100]
--defer-fpr-min FLOAT RANGESmallest deferral FPR on the grid (percent). [default: 0.0; 0<=x<=100]
--defer-fpr-max FLOAT RANGELargest deferral FPR on the grid (percent). [default: 100.0; 0<=x<=100]
--points INTEGER RANGENumber of linearly spaced deferral-FPR grid points. [default: 41; x>=2]
--output-dir PATHOutput directory (default: data/defer_sweep/<timestamp>).
--helpShow this message and exit.