Run tasks with and without the installed setup and compare pass rate, rework, duration, tokens, cost, tool calls, and workflow checks; exclude runs that end with a client or API error. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
5 lines
152 B
Bash
5 lines
152 B
Bash
#!/usr/bin/env bash
|
|
set -euo pipefail
|
|
root=$(cd -- "$(dirname -- "${BASH_SOURCE[0]}")/../.." && pwd)
|
|
exec python3 "$root/scripts/benchmarks/ab.py" "$@"
|