mlx-community/Llama-3.1-8B-Instruct-4bit
MLX Communityhuggingface.co/mlx-community/Llama-3.1-8B-Instru
Updated 48 min ago · first seen 11 Sept 2026
model_01M294ZDRH9WG0YDYEX9N3MXJA
- Parameters
- 8.03B
- T2 · 1 h ago
- Released
- 15 Feb 2025
- T2 · 48 min ago
- License
- llama3.1
- T2 · 48 min ago
Specification
- Release date
- 15 Feb 2025
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 48 min agomedium
- Openness
- open-weights
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- License
- llama3.1
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 48 min agomedium
- Architecture
- LlamaForCausalLM
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 48 min agomedium
- Parameters
- 8.03B
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- Languages
- en, de, fr, it, pt, hi, es, th
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 48 min agomedium
- Base model
- meta-llama/Llama-3.1-8B-Instruct
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 48 min agomedium
- Quantization
- 4bit
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 48 min agomedium
- Quantization format
- mlx
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 48 min agomedium
- File size
- 4.5 GB
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 48 min agomedium
- Hugging Face repo
- mlx-community/Llama-3.1-8B-Instruct-4bit
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- Pipeline tag
- text-generation
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- Model card
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- Downloads
- 1,033,841
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 48 min agomedium
- Likes
- 4
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 48 min agomedium
- Gated
- No
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 48 min agomedium
- Is quantized
- Yes
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 48 min agomedium
- Last modified
- 2025-02-15T14:55:20+00:00
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- Library name
- mlx
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 48 min agomedium
- Downloads all time
- 1,075,005
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 48 min agomedium
- Model type
- llama
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 48 min agomedium
- Tags
- mlx, safetensors, llama, facebook, meta, pytorch, llama-3, text-generation, en, de, fr, it, pt, hi, es, th, 4-bit
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 48 min agomedium
- Weights dtype
- F16, U32
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 48 min agomedium
Each value shows its source, tier and observation time. Conflicting claims are kept side by side and flagged — never averaged. How AI Atlas records facts →
Provenance
Attributed facts
23
Source tiers
T223
Freshest observation
48 min ago
Conflicts
None
Modalities
Modalities unavailable.
Capabilities
Tool calling
Unavailable
Structured output
Unavailable
Reasoning
Unavailable
Vision
Unavailable
Audio
Unavailable
Fine-tuning available
Unavailable
No capability flags have been observed from a source yet — we do not infer them.
- Languages
- en, de, fr, it, pt, hi, es, th
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 48 min agomedium
No benchmark results recorded
Current prices
No current prices recorded
Price history
Memory need = bytes per parameter (4-bit ≈ 0.5 × 1.15 overhead, 8-bit 1.0, fp16 2.0) + a KV-cache allowance. Not a measurement.
| Hardware | Quantization | Memory | Est. need | Fits |
|---|---|---|---|---|
| Apple M3 Ultra | 4bit | — | 5.1 GB | Yes |
| AMD Instinct MI325X | 4bit | 256 GB | 5.1 GB | Yes |
| AMD Instinct MI300X | 4bit | 192 GB | 5.1 GB | Yes |
| Apple M2 Ultra | 4bit | — | 5.1 GB | Yes |
| NVIDIA B200 | 4bit | 180 GB | 5.1 GB | Yes |
| NVIDIA H200 | 4bit | 141 GB | 5.1 GB | Yes |
| Apple M1 Ultra | 4bit | — | 5.1 GB | Yes |
| Apple M3 Max | 4bit | — | 5.1 GB | Yes |
| Apple M4 Max | 4bit | — | 5.1 GB | Yes |
| NVIDIA DGX Spark | 4bit | 128 GB | 5.1 GB | Yes |
| Apple M2 Max | 4bit | — | 5.1 GB | Yes |
| NVIDIA A100 80GB | 4bit | 80 GB | 5.1 GB | Yes |
| NVIDIA H100 SXM | 4bit | 80 GB | 5.1 GB | Yes |
| Apple M1 Max | 4bit | — | 5.1 GB | Yes |
| Apple M4 Pro | 4bit | — | 5.1 GB | Yes |
| Apple M3 Pro | 4bit | — | 5.1 GB | Yes |
| Apple M1 Pro | 4bit | — | 5.1 GB | Yes |
| Apple M2 Pro | 4bit | — | 5.1 GB | Yes |
| Apple M4 | 4bit | — | 5.1 GB | Yes |
| NVIDIA GeForce RTX 5090 | 4bit | 32 GB | 5.1 GB | Yes |
| Apple M2 | 4bit | — | 5.1 GB | Yes |
| Apple M3 | 4bit | — | 5.1 GB | Yes |
| NVIDIA GeForce RTX 3090 | 4bit | 24 GB | 5.1 GB | Yes |
| NVIDIA GeForce RTX 4090 | 4bit | 24 GB | 5.1 GB | Yes |
| Apple M1 | 4bit | — | 5.1 GB | Yes |
Ancestors 3
- Llama-3.1-8B-Instruct8.03B
- Llama 3.1 8B8.03B
- Meta-Llama-3.1-8BMeta AI
This model
mlx-community/Llama-3.1-8B-Instruct-4bit
8.03B params
Quantizations 0
None recorded.
Descendants 0
None recorded.
Papers 0
No papers linked yet.
Repositories 0
No repositories linked yet.
As of
Rewind the record: see this entity's attributes exactly as AI Atlas knew them on a given day.
Claim history · Pipeline tag
Pipeline tagpipeline_tag1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| text-generation | → current | current | Hugging Face Hub (public pages, model cards, papers)T2 | medium | deterministic |
Claims are temporal and append-only: a new observation closes the previous claim (valid_to) instead of overwriting it. Conflicting claims from different sources are kept side by side and flagged — never averaged. Methodology →
New model: mlx-community/Llama-3.1-8B-Instruct-4bit (MLX Community)
huggingface
| Source | Document | Type | Tier | Last observed | Snapshots |
|---|---|---|---|---|---|
| Hugging Face Hub (public pages, model cards, papers) | huggingface.co/mlx-community/Llama-3.1-8B-Instruct-4bit/raw/main/README.md | model_card | T2· Quality secondary | 13 min ago | 1 |
| Hugging Face Hub (public pages, model cards, papers) | huggingface.co/mlx-community/Llama-3.1-8B-Instruct-4bit | model_page | T2· Quality secondary | 48 min ago | 1 |
| Hugging Face Hub (public pages, model cards, papers) | huggingface.co/models?author=mlx-community&p=0&sort=downloads | listing | T2· Quality secondary | 1 h ago | 2 |
Tier 1 = official/primary, 2 = quality secondary, 3 = community, 4 = unverified. Every snapshot is archived; see all sources and the methodology.