← Back to leaderboard

mistral:7b

5.6 GB measured VRAM · 4-8GB tier · reasoning-gauntlet-v1
Exact problems, puzzles, and expected answers for this category are held back from publication to avoid training-data contamination — see About for why. This page shows per-tier pass/fail counts and timing only.
Tier 1 — floor 5/5
78 tokens · 2.855s (representative seed)
Tier 2 — multi-step 5/5
370 tokens · 2.361s (representative seed)
Tier 3 — logical deduction 5/5
193 tokens · 1.269s (representative seed)
Tier 4 — adversarial (CRT trap) 5/5
224 tokens · 1.453s (representative seed)
Tier 5 — combinatorics 5/5
310 tokens · 1.97s (representative seed)
Tier 6 — distractor filtering 0/5
143 tokens · 0.955s (representative seed)