mlx-community/Llama-3.1-8B-Instruct-4bit
MLX Communityhuggingface.co/mlx-community/Llama-3.1-8B-Instru
Updated 2 min ago · first seen 11 Sept 2026
model_01M294ZDRH9WG0YDYEX9N3MXJA
- Parameters
- 8.03B
- T2 · 40 min ago
- Released
- 15 Feb 2025
- T2 · 2 min ago
- License
- llama3.1
- T2 · 2 min ago
Specification
- Release date
- 15 Feb 2025
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 2 min agomedium
- Openness
- open-weights
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 40 min agomedium
- License
- llama3.1
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 2 min agomedium
- Architecture
- LlamaForCausalLM
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 2 min agomedium
- Parameters
- 8.03B
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 40 min agomedium
- Languages
- en, de, fr, it, pt, hi, es, th
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 2 min agomedium
- Base model
- meta-llama/Llama-3.1-8B-Instruct
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 2 min agomedium
- Quantization
- 4bit
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 2 min agomedium
- Quantization format
- mlx
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 2 min agomedium
- File size
- 4.5 GB
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 2 min agomedium
- Hugging Face repo
- mlx-community/Llama-3.1-8B-Instruct-4bit
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 40 min agomedium
- Pipeline tag
- text-generation
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 40 min agomedium
- Model card
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 40 min agomedium
- Downloads
- 1,033,841
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 2 min agomedium
- Likes
- 4
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 2 min agomedium
- Gated
- No
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 2 min agomedium
- Is quantized
- Yes
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 2 min agomedium
- Last modified
- 2025-02-15T14:55:20+00:00
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 40 min agomedium
- Library name
- mlx
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 2 min agomedium
- Downloads all time
- 1,075,005
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 2 min agomedium
- Model type
- llama
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 2 min agomedium
- Tags
- mlx, safetensors, llama, facebook, meta, pytorch, llama-3, text-generation, en, de, fr, it, pt, hi, es, th, 4-bit
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 2 min agomedium
- Weights dtype
- F16, U32
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 2 min agomedium
Each value shows its source, tier and observation time. Conflicting claims are kept side by side and flagged — never averaged. How AI Atlas records facts →
Provenance
Attributed facts
23
Source tiers
T223
Freshest observation
2 min ago
Conflicts
None
Modalities
Modalities unavailable.
Capabilities
Tool calling
Unavailable
Structured output
Unavailable
Reasoning
Unavailable
Vision
Unavailable
Audio
Unavailable
Fine-tuning available
Unavailable
No capability flags have been observed from a source yet — we do not infer them.
- Languages
- en, de, fr, it, pt, hi, es, th
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 2 min agomedium
No benchmark results recorded
Current prices
No current prices recorded
Price history
Memory need = bytes per parameter (4-bit ≈ 0.5 × 1.15 overhead, 8-bit 1.0, fp16 2.0) + a KV-cache allowance. Not a measurement.
| Hardware | Quantization | Memory | Est. need | Fits |
|---|---|---|---|---|
| Apple M3 Ultra | 4bit | — | 5.1 GB | Yes |
| AMD Instinct MI325X | 4bit | 256 GB | 5.1 GB | Yes |
| AMD Instinct MI300X | 4bit | 192 GB | 5.1 GB | Yes |
| Apple M2 Ultra | 4bit | — | 5.1 GB | Yes |
| NVIDIA B200 | 4bit | 180 GB | 5.1 GB | Yes |
| NVIDIA H200 | 4bit | 141 GB | 5.1 GB | Yes |
| Apple M1 Ultra | 4bit | — | 5.1 GB | Yes |
| Apple M3 Max | 4bit | — | 5.1 GB | Yes |
| Apple M4 Max | 4bit | — | 5.1 GB | Yes |
| NVIDIA DGX Spark | 4bit | 128 GB | 5.1 GB | Yes |
| Apple M2 Max | 4bit | — | 5.1 GB | Yes |
| NVIDIA A100 80GB | 4bit | 80 GB | 5.1 GB | Yes |
| NVIDIA H100 SXM | 4bit | 80 GB | 5.1 GB | Yes |
| Apple M1 Max | 4bit | — | 5.1 GB | Yes |
| Apple M4 Pro | 4bit | — | 5.1 GB | Yes |
| Apple M3 Pro | 4bit | — | 5.1 GB | Yes |
| Apple M1 Pro | 4bit | — | 5.1 GB | Yes |
| Apple M2 Pro | 4bit | — | 5.1 GB | Yes |
| Apple M4 | 4bit | — | 5.1 GB | Yes |
| NVIDIA GeForce RTX 5090 | 4bit | 32 GB | 5.1 GB | Yes |
| Apple M2 | 4bit | — | 5.1 GB | Yes |
| Apple M3 | 4bit | — | 5.1 GB | Yes |
| NVIDIA GeForce RTX 3090 | 4bit | 24 GB | 5.1 GB | Yes |
| NVIDIA GeForce RTX 4090 | 4bit | 24 GB | 5.1 GB | Yes |
| Apple M1 | 4bit | — | 5.1 GB | Yes |
Ancestors 3
- Llama-3.1-8B-Instruct8.03B
- Llama 3.1 8B8.03B
- Meta-Llama-3.1-8BMeta AI
This model
mlx-community/Llama-3.1-8B-Instruct-4bit
8.03B params
Quantizations 0
None recorded.
Descendants 0
None recorded.
Papers 0
No papers linked yet.
Repositories 0
No repositories linked yet.
As of
Rewind the record: see this entity's attributes exactly as AI Atlas knew them on a given day.
Claim history
Release daterelease_date1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| 15 Feb 2025 | → current | current | Hugging Face Hub (public pages, model cards, papers)T2 | medium | deterministic |
Opennessopenness1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| open-weights | → current | current | Hugging Face Hub (public pages, model cards, papers)T2 | medium | deterministic |
Licenselicense1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| llama3.1 | → current | current | Hugging Face Hub (public pages, model cards, papers)T2 | medium | deterministic |
Architecturearchitecture1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| LlamaForCausalLM | → current | current | Hugging Face Hub (public pages, model cards, papers)T2 | medium | deterministic |
Parametersparameter_count1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| 8.03B | → current | current | Hugging Face Hub (public pages, model cards, papers)T2 | medium | deterministic |
Languageslanguages1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| en, de, fr, it, pt, hi, es, th | → current | current | Hugging Face Hub (public pages, model cards, papers)T2 | medium | deterministic |
Base modelbase_model1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| meta-llama/Llama-3.1-8B-Instruct | → current | current | Hugging Face Hub (public pages, model cards, papers)T2 | medium | deterministic |
Quantizationquantization1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| 4bit | → current | current | Hugging Face Hub (public pages, model cards, papers)T2 | medium | deterministic |
Quantization formatquant_format1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| mlx | → current | current | Hugging Face Hub (public pages, model cards, papers)T2 | medium | deterministic |
File sizefile_size_gb1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| 4.5 GB | → current | current | Hugging Face Hub (public pages, model cards, papers)T2 | medium | deterministic |
Hugging Face repohf_repo1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| mlx-community/Llama-3.1-8B-Instruct-4bit | → current | current | Hugging Face Hub (public pages, model cards, papers)T2 | medium | deterministic |
Pipeline tagpipeline_tag1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| text-generation | → current | current | Hugging Face Hub (public pages, model cards, papers)T2 | medium | deterministic |
Model cardmodel_card_url1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| https://huggingface.co/mlx-community/Llama-3.1-8B-Instruct-4bit | → current | current | Hugging Face Hub (public pages, model cards, papers)T2 | medium | deterministic |
Downloadsmetric.downloads1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| 1,033,841 | → current | current | Hugging Face Hub (public pages, model cards, papers)T2 | medium | deterministic |
Likesmetric.likes1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| 4 | → current | current | Hugging Face Hub (public pages, model cards, papers)T2 | medium | deterministic |
Gatedgated1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| No | → current | current | Hugging Face Hub (public pages, model cards, papers)T2 | medium | deterministic |
Is quantizedis_quantized1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| Yes | → current | current | Hugging Face Hub (public pages, model cards, papers)T2 | medium | deterministic |
Last modifiedlast_modified1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| 2025-02-15T14:55:20+00:00 | → current | current | Hugging Face Hub (public pages, model cards, papers)T2 | medium | deterministic |
Library namelibrary_name1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| mlx | → current | current | Hugging Face Hub (public pages, model cards, papers)T2 | medium | deterministic |
Downloads all timemetric.downloads_all_time1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| 1,075,005 | → current | current | Hugging Face Hub (public pages, model cards, papers)T2 | medium | deterministic |
Model typemodel_type1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| llama | → current | current | Hugging Face Hub (public pages, model cards, papers)T2 | medium | deterministic |
Weights dtypeweights_dtype1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| F16, U32 | → current | current | Hugging Face Hub (public pages, model cards, papers)T2 | medium | deterministic |
Claims are temporal and append-only: a new observation closes the previous claim (valid_to) instead of overwriting it. Conflicting claims from different sources are kept side by side and flagged — never averaged. Methodology →
New model: mlx-community/Llama-3.1-8B-Instruct-4bit (MLX Community)
huggingface
| Source | Document | Type | Tier | Last observed | Snapshots |
|---|---|---|---|---|---|
| Hugging Face Hub (public pages, model cards, papers) | huggingface.co/mlx-community/Llama-3.1-8B-Instruct-4bit | model_page | T2· Quality secondary | 2 min ago | 1 |
| Hugging Face Hub (public pages, model cards, papers) | huggingface.co/models?author=mlx-community&p=0&sort=downloads | listing | T2· Quality secondary | 38 min ago | 2 |
Tier 1 = official/primary, 2 = quality secondary, 3 = community, 4 = unverified. Every snapshot is archived; see all sources and the methodology.