test(benchmarks): add A/B task fixtures with hidden checks

Ten small Python tasks, each failing on the fixture and passing with a
reference solution, including workflow expectations for a small change, a
bugfix, and a delegable change.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
Julian lechnerandClaude Opus 5.5 committed 2026-10-01 12:45:40 +02:00
1 parent b8fd66ce3b
commit 3480072ed7
60 files changed
+374

No files matched your search

@@ -0,0 +1,6 @@
def parse_csv(text):
"""Parse comma-separated text with a header row into a list of dicts.
Strip whitespace around cells, skip blank lines, and support double-quoted cells containing commas.
"""
raise NotImplementedError
@@ -0,0 +1,6 @@
def parse_ini(text):
"""Parse INI text into {section: {key: value}}.
Ignore lines starting with ; or #, strip whitespace, keep keys before the first section under "".
"""
raise NotImplementedError
@@ -0,0 +1,6 @@
def parse_json_lines(text):
"""Parse JSON Lines text into a list of objects.
Skip blank lines. Raise ValueError naming the 1-based line number for invalid JSON.
"""
raise NotImplementedError