← Back to leaderboard

qwen2.5-coder:7b

5.1 GB measured VRAM · 4-8GB tier · reasoning-gauntlet-v1

Exact problems, puzzles, and expected answers for this category are held back from publication to avoid training-data contamination — see About for why. This page shows per-tier pass/fail counts and timing only.

Tier 1 — floor 5/5

80 tokens · 3.04s (representative seed)

Tier 2 — multi-step 5/5

465 tokens · 3.143s (representative seed)

Tier 3 — logical deduction 5/5

147 tokens · 1.106s (representative seed)

Tier 4 — adversarial (CRT trap) 5/5

10 tokens · 0.206s (representative seed)

Tier 5 — combinatorics 5/5

431 tokens · 2.894s (representative seed)

Tier 6 — distractor filtering 0/5

381 tokens · 2.635s (representative seed)