ct game-metrics
Compute safety and usefulness metrics from honest and attack trajectories.
Usage
ct game-metrics [OPTIONS] COMMAND [ARGS]...
Options
| Option | Description |
|---|---|
--help | Show this message and exit. |
Commands
| Command | Description |
|---|---|
ct game-metrics compare-monitors | Compare safety curves across monitors. |
ct game-metrics compare-sabotagers | Compare safety curves across different attackers. |
ct game-metrics graph | Generate metrics graphs. |
ct game-metrics metrics | Compute safety + usefulness metrics across one or more honest/attack pairs. |
ct game-metrics top-uncaught | Print uncaught ST-successful trajectories, ordered by catch probability. |
ct game-metrics view-scores | View trajectories with catch probabilities under the optimal audit rule. |