Agent Psychometrics

Open-source Python research code and data for the paper "Agent Psychometrics: Task-Level Performance Prediction in Agentic Coding Benchmarks." It implements experiments and IRT-based methods for predicting task-level success or failure of coding agents using task features, agent features, and adaptive task selection.