Agents API

Unified agent trajectory extraction interface.

contextbench.agents.extract_trajectory(traj_file_or_data) → dict

Auto-detect format and extract trajectory.

Supports: - MiniSWE-agent: .traj.json files - SWE-agent: .checkpoints.jsonl files - Agentless: *_traj.json files - Prometheus: .log files (Prometheus answer_issue_logs format) - OpenHands: output.jsonl files or dict data with ‘history’ field

Parameters:

traj_file_or_data – Either a file path (str) or pre-parsed OpenHands data (dict)

Returns unified format: {

‘pred_steps’: [{‘files’: […], ‘spans’: {…}}, …], ‘pred_files’: […], ‘pred_spans’: {…}

}