50 questions answered strictly from two real Summary of Benefits and Coverage (SBC) documents
(an official CMS reference PPO plan, and Auburn University's actual 2025 HDHP plan), scored
against an answer key verified against the source PDFs. Model tested: claude-sonnet-5.
Full write-up on GitHub.
Note on Q50: it's marked FAIL below because of a grading-script bug, not a model error — the
model answered "Plan A: PPO; Plan B: HDHP" (correct), but the answer key only matched the exact
phrase "Plan A is PPO, Plan B is HDHP". See the README for the full explanation.