Smaug Mini
Updated 3 h ago · first seen 11 Sept 2026
model_01M29A6S4WWKAS3WHCJRB5QC87
Specification
- Livebench hf link
- https://huggingface.co/abacusai/Smaug-Mini
Source:LiveBenchT2observed 3 h agomedium
Each value shows its source, tier and observation time. Conflicting claims are kept side by side and flagged — never averaged. How AI Atlas records facts →
Provenance
Attributed facts
1
Source tiers
T21
Freshest observation
3 h ago
Conflicts
None
Modalities
Modalities unavailable.
Capabilities
Tool calling
Unavailable
Structured output
Unavailable
Reasoning
Unavailable
Vision
Unavailable
Audio
Unavailable
Fine-tuning available
Unavailable
No capability flags have been observed from a source yet — we do not infer them.
No structured attributes yet.
| Benchmark | Score | Metric | Config | Evaluated | Source |
|---|---|---|---|---|---|
| LiveBench | 76.93% | global_average | release=2026-06-25 · aggregation=mean of category averages; category = mean of its subtasks · livebench_model_id=smaug-mini | 25 Jun 2026 | livebench.aiT2 |
| LiveBench | 82.81% | category:Reasoning | release=2026-06-25 · subtasks=["theory_of_mind","zebra_puzzle","spatial","logic_with_navigation"] · livebench_model_id=smaug-mini | 25 Jun 2026 | livebench.aiT2 |
| LiveBench | 75.43% | category:Coding | release=2026-06-25 · subtasks=["code_generation","code_completion"] · livebench_model_id=smaug-mini | 25 Jun 2026 | livebench.aiT2 |
| LiveBench | 60.81% | category:Agentic Coding | release=2026-06-25 · subtasks=["javascript","typescript","python"] · livebench_model_id=smaug-mini | 25 Jun 2026 | livebench.aiT2 |
| LiveBench | 89.74% | category:Mathematics | release=2026-06-25 · subtasks=["AMPS_Hard","integrals_with_game","math_comp","olympiad"] · livebench_model_id=smaug-mini | 25 Jun 2026 | livebench.aiT2 |
| LiveBench | 78.81% | category:Data Analysis | release=2026-06-25 · subtasks=["consecutive_events","tablejoin","tablereformat"] · livebench_model_id=smaug-mini | 25 Jun 2026 | livebench.aiT2 |
| LiveBench | 77% | category:Language | release=2026-06-25 · subtasks=["connections","plot_unscrambling","typos"] · livebench_model_id=smaug-mini | 25 Jun 2026 | livebench.aiT2 |
| LiveBench | 73.92% | category:IF | release=2026-06-25 · subtasks=["paraphrase","simplify","story_generation","summarize"] · livebench_model_id=smaug-mini | 25 Jun 2026 | livebench.aiT2 |
Scores are reported as published, with their evaluation configuration (harness, prompting, judge). Results with different configs are not directly comparable — see methodology.
Current prices
No current prices recorded
Price history
No hardware estimate available
No lineage recorded
Papers 0
No papers linked yet.
Repositories 0
No repositories linked yet.
As of
Rewind the record: see this entity's attributes exactly as AI Atlas knew them on a given day.
Claim history
Livebench hf linklivebench_hf_link1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| https://huggingface.co/abacusai/Smaug-Mini | → current | current | LiveBenchT2 | medium | deterministic |
Claims are temporal and append-only: a new observation closes the previous claim (valid_to) instead of overwriting it. Conflicting claims from different sources are kept side by side and flagged — never averaged. Methodology →
| Source | Document | Type | Tier | Last observed | Snapshots |
|---|---|---|---|---|---|
| LiveBench | livebench.ai/table_2026_06_25.csv | leaderboard | T2· Quality secondary | 3 h ago | 1 |
Tier 1 = official/primary, 2 = quality secondary, 3 = community, 4 = unverified. Every snapshot is archived; see all sources and the methodology.