ct game-metrics graph safety-fpr

Plot a dense safety-vs-audit-FPR curve (action-monitor leg).

Usage

ct game-metrics graph safety-fpr [OPTIONS]

Options

OptionDescription
--honest TEXTHonest trajectories (path, dir, or run URL/ID). Mutually exclusive with --run-file.
--attack TEXTAttack trajectories (path, dir, or run URL/ID). Mutually exclusive with --run-file.
--run-file PATHYAML run file with multiple run entries (one curve each).
--filter-by TEXTFilter runs by metadata (field=value, repeatable).
--fpr-min FLOAT RANGESmallest target FPR on the grid (percent step-wise audit FPR). [default: 0.01; 0.0001<=x<=100]
--fpr-max FLOAT RANGELargest target FPR on the grid (percent step-wise audit FPR). [default: 100.0; 0.0001<=x<=100]
--points INTEGER RANGENumber of log-spaced FPR grid points. [default: 250; x>=2]
--output-dir PATHOutput directory (default: data/safety_fpr/<timestamp>).
--helpShow this message and exit.