Julian lechnerandClaude Opus 5.5 97879fd6a5 feat(benchmarks): pin models and verify arm provenance ...

Pin one model and reasoning effort per client for both arms, disable user and
plugin skills in the Codex baseline home, and record what each arm loads in
provenance.json; stop when the arms are not comparable.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

2026-10-01 13:59:12 +02:00

..

tasks

test(benchmarks): add concept-search tasks

2026-10-01 13:27:56 +02:00

ab.py

feat(benchmarks): pin models and verify arm provenance

2026-10-01 13:59:12 +02:00

context.py

feat(benchmarks): report context the clients actually load

2026-10-01 12:45:39 +02:00