ct game-metrics graph roc
Plot ROC curves from honest/attack trajectory pairs.
Usage
ct game-metrics graph roc [OPTIONS]
Options
| Option | Description |
|---|---|
--honest TEXT | Honest trajectories (path, dir, or run URL/ID). Mutually exclusive with --run-file. |
--attack TEXT | Attack trajectories (multiple allowed). Mutually exclusive with --run-file. |
--run-file PATH | YAML run file with multiple run entries. |
--output-dir PATH | Output directory for plots (default: data/roc/<timestamp>). |
--group-by [env|failure_type|main_task_category|side_task_category] | Group trajectories and produce separate plots per group value. |
--color-by TEXT | Run metadata field to map to curve color. |
--style-by TEXT | Run metadata field to map to curve linestyle. |
--filter-by TEXT | Filter runs by metadata (format: field=value, repeatable). |
--agg-func [combined_max|action_only|traj_level] | Aggregation method(s). combined_max = max(action, traj_monitor) with live-failure awareness; action_only = max action score; traj_level = trajectory monitor score only. Can specify multiple. [default: combined_max] |
--min-samples INTEGER | Min trajectories per group per side (only with --group-by). [default: 2] |
--max-workers INTEGER RANGE | Thread-pool size for loading run entries concurrently. [default: 8; x>=1] |
--help | Show this message and exit. |