Control Tower
/
EnvironmentsGitHub
Home
QuickstartHands-On GuideRunning Evals on HawkDevelopment Setup
Architecture at a GlanceAI Control ConceptsControl Tower and InspectSafety CurvesROC CurvesPareto Frontier
Running EvaluationsMonitoring TrajectoriesSabotage Eval PipelineProtocolsTrajectoriesWeb ViewerInspect Logs ViewerDocentAuditing EnvironmentsRun Scripts
CLI ReferencePython Reference
CLI DevelopmentLive DevelopmentMaking EnvironmentsEnvironment ArchitecturePorting SettingsMaking Main TasksMaking Side TasksMaking ScorersSide-Task Scorer PatternsFailure TypesMaking StrajsStraj Review WorkflowStrategy DevelopmentInternet SimulatorHawk Values ContractFunction RegistryPR ConventionsDevelopment and Release Process
DatabaseEC2 SandboxSimulated SandboxHTTP API

ct game-metrics graph

Generate metrics graphs.

Usage

ct game-metrics graph [OPTIONS] COMMAND [ARGS]...

Options

OptionDescription
--helpShow this message and exit.

Commands

CommandDescription
ct game-metrics graph defer-sweepSweep deferral FPR at a fixed audit budget (defer-to-trusted).
ct game-metrics graph paretoCompute (safety, usefulness) Pareto-frontier scatter from a YAML config.
ct game-metrics graph rocPlot ROC curves from honest/attack trajectory pairs.
ct game-metrics graph safety-fprPlot a dense safety-vs-audit-FPR curve (action-monitor leg).

On this page

  • Usage
  • Options
  • Commands