Reference
Python API
inspect_ai | Tasks, evaluation, and scoring. |
inspect_ai.solver | Prompting, elicitation and agents. |
inspect_ai.tool | Built-in and custom tool functions. |
inspect_ai.scorer | Task scoring and metrics. |
inspect_ai.model | Model interface and providers. |
inspect_ai.dataset | Reading samples from datasets. |
inspect_ai.approval | Approvers and approval policies. |
inspect_ai.log | List, read, write, and analyse logs. |
inspect_ai.util | Miscellaneous utility functions. |
Inspect CLI
inspect eval | Evaluate one or more tasks. |
inspect eval-retry | Retry an evaluation task. |
inspect eval-set | Evaluate a set of tasks with retries. |
inspect score | Score a previous evaluation run. |
inspect view | Inspect log viewer |
inspect_log | Query, read, write, and convert logs. |
inspect trace | List and read execution traces. |
inspect sandbox | Manage sandbox environments. |
inspect cache | Manage the Inspect model cache. |
inspect list | List tasks on the filesystem. |
inspect info | Read version and configuration. |