[Leaderboard] Alkera - Fable 5 + Opus 4.8 Fallback - 83.28% Pass@1

[28andrew]

Alkera (Fable 5 + Opus 4.8) — Leaderboard Submission

Agent name: Alkera
Backbone LLM: Fable (max reasoning) with fallback to Opus 4.8 (xhigh reasoning) for Fable safety refusals
Hints: Yes
Trials: 5 per query
Stratified Pass@1: 83.28%

Architecture

Alkera is given its standard prompt, an addendum system prompt (described in method) inspired by SCRIBE's submission, and native tools for SQL querying (returning objects that can be paginated, SQL schema queries, bash, data lineage (reads relational data relations), and spawning review subagents. All these data tools only pull from the provided databases for the task. See more on our method.

Results

Dataset	Pass@1
bookreview	1.00
googlelocal	1.00
music_brainz_20k	1.00
PATENTS	1.00
stockindex	1.00
stockmarket	1.00
yelp	1.00
crmarenapro	0.88
PANCANCER_ATLAS	0.67
DEPS_DEV_V1	0.50
GITHUB_REPOS	0.50
agnews	0.45
Stratified Pass@1	0.8328

Notes

• 270 entries (54 queries × 5 trials), validated against the official DAB validators (common_scaffold/validate/validate.py)
• Integrity (per SUBMISSION_RUBRIC.md §2). Answers come solely from the agent's own analysis of the provided databases. Every one of the 270 traces was self-audited over its full tool-call surface with three independent checkers: 0 reads of validate.py / ground_truth.csv / queries.json / other runs' artifacts, 0 external fetches (load_dataset, HuggingFace cache, snapshot_download, curl/wget/git clone, Kaggle), 0 cached-model loads.
• Prompt disclosure. The system addendum, inspired by SCRIBE's submission, is benchmark-agnostic — an answer-delivery contract, literal-reading/verification discipline, and standard analytical conventions (result shape & grain, code-vs-name identifiers, EMA / dollar-cost-averaging, etc.). It contains no gold values, no per-dataset rules, and no validator references; any example tokens in it are fictional. Full text below.
• Submission file: leaderboard_submissions/alkera-fable5-opus-fallback_results.json
• Execution traces (all 270 runs): https://github.com/AlkeraAI/Alkera-DAB-July/blob/main/traces/alkera-fable5-opus-fallback_traces.tar.gz

[Ruiying-Ma]

Hi @28andrew! Thanks for the submission and the detailed traces. We have added your results to the leaderboard.