Smaug Agentic
Updated 57 min ago · first seen 11 Sept 2026
model_01M29A6S4VVCC5RZY57SPZ8J1F
Specification
- Livebench hf link
- https://huggingface.co/abacusai/Smaug-Agentic
Source:LiveBenchT2observed 57 min agomedium
Each value shows its source, tier and observation time. Conflicting claims are kept side by side and flagged — never averaged. How AI Atlas records facts →
Provenance
Attributed facts
1
Source tiers
T21
Freshest observation
57 min ago
Conflicts
None
Modalities
Modalities unavailable.
Capabilities
Tool calling
Unavailable
Structured output
Unavailable
Reasoning
Unavailable
Vision
Unavailable
Audio
Unavailable
Fine-tuning available
Unavailable
No capability flags have been observed from a source yet — we do not infer them.
No structured attributes yet.
| Benchmark | Score | Metric | Config | Evaluated | Source |
|---|---|---|---|---|---|
| LiveBench | 79.51% | global_average | release=2026-06-25 · aggregation=mean of category averages; category = mean of its subtasks · livebench_model_id=smaug-agentic | 25 Jun 2026 | livebench.aiT2 |
| LiveBench | 90.27% | category:Reasoning | release=2026-06-25 · subtasks=["theory_of_mind","zebra_puzzle","spatial","logic_with_navigation"] · livebench_model_id=smaug-agentic | 25 Jun 2026 | livebench.aiT2 |
| LiveBench | 82.47% | category:Coding | release=2026-06-25 · subtasks=["code_generation","code_completion"] · livebench_model_id=smaug-agentic | 25 Jun 2026 | livebench.aiT2 |
| LiveBench | 64.65% | category:Agentic Coding | release=2026-06-25 · subtasks=["javascript","typescript","python"] · livebench_model_id=smaug-agentic | 25 Jun 2026 | livebench.aiT2 |
| LiveBench | 83.92% | category:Mathematics | release=2026-06-25 · subtasks=["AMPS_Hard","integrals_with_game","math_comp","olympiad"] · livebench_model_id=smaug-agentic | 25 Jun 2026 | livebench.aiT2 |
| LiveBench | 79.9% | category:Data Analysis | release=2026-06-25 · subtasks=["consecutive_events","tablejoin","tablereformat"] · livebench_model_id=smaug-agentic | 25 Jun 2026 | livebench.aiT2 |
| LiveBench | 84.36% | category:Language | release=2026-06-25 · subtasks=["connections","plot_unscrambling","typos"] · livebench_model_id=smaug-agentic | 25 Jun 2026 | livebench.aiT2 |
| LiveBench | 70.99% | category:IF | release=2026-06-25 · subtasks=["paraphrase","simplify","story_generation","summarize"] · livebench_model_id=smaug-agentic | 25 Jun 2026 | livebench.aiT2 |
Scores are reported as published, with their evaluation configuration (harness, prompting, judge). Results with different configs are not directly comparable — see methodology.
Current prices
No current prices recorded
Price history
No hardware estimate available
No lineage recorded
Papers 0
No papers linked yet.
Repositories 0
No repositories linked yet.
As of
Rewind the record: see this entity's attributes exactly as AI Atlas knew them on a given day.
Claim history
Livebench hf linklivebench_hf_link1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| https://huggingface.co/abacusai/Smaug-Agentic | → current | current | LiveBenchT2 | medium | deterministic |
Claims are temporal and append-only: a new observation closes the previous claim (valid_to) instead of overwriting it. Conflicting claims from different sources are kept side by side and flagged — never averaged. Methodology →
| Source | Document | Type | Tier | Last observed | Snapshots |
|---|---|---|---|---|---|
| LiveBench | livebench.ai/table_2026_06_25.csv | leaderboard | T2· Quality secondary | 57 min ago | 1 |
Tier 1 = official/primary, 2 = quality secondary, 3 = community, 4 = unverified. Every snapshot is archived; see all sources and the methodology.