Skip to content
AI Atlas
ArtifactquantizationMLXOpen weightsof Devstral-Small-2-24B-Instruct-2512

mlx-community/Devstral-Small-2-24B-Instruct-2512-4bit

published by MLX Communityhuggingface.co/mlx-community/Devstral-Small-2-24B-Instru

This is a quantization of Devstral-Small-2-24B-Instruct-2512, not an independent model. Parameters, benchmarks, prices and lineage are recorded on the canonical model. Open Devstral-Small-2-24B-Instruct-2512 →

data quality42

Updated 2 h ago · first seen 11 Sept 2026

model_01M294ZDS82J8QP1YM58ZCGDWY

File size
Format
Downloads
Published

Artifact facts

Quantization format

Source:Hugging Face Hub (public pages, model cards, papers)T2observed 11 h agomedium

Quantization

Source:Hugging Face Hub (public pages, model cards, papers)T2observed 11 h agomedium

Weights dtype

Source:Hugging Face Hub (public pages, model cards, papers)T2observed 11 h agomedium

File size

Source:Hugging Face Hub (public pages, model cards, papers)T2observed 11 h agomedium

Downloads

Source:Hugging Face Hub (public pages, model cards, papers)T2observed 6 h agomedium

Likes

Source:Hugging Face Hub (public pages, model cards, papers)T2observed 6 h agomedium

Hugging Face repo

Source:Hugging Face Hub (public pages, model cards, papers)T2observed 12 h agomedium

Base model

Source:Hugging Face Hub (public pages, model cards, papers)T2observed 11 h agomedium

Pipeline tag

Source:Hugging Face Hub (public pages, model cards, papers)T2observed 12 h agomedium

Library name

Source:Hugging Face Hub (public pages, model cards, papers)T2observed 11 h agomedium

Gated

Source:Hugging Face Hub (public pages, model cards, papers)T2observed 11 h agomedium

License

Source:Hugging Face Hub (public pages, model cards, papers)T2observed 11 h agomedium

Release date

Source:Hugging Face Hub (public pages, model cards, papers)T2observed 11 h agomedium

Last modified

Source:Hugging Face Hub (public pages, model cards, papers)T2observed 12 h agomedium

Tags

Source:Hugging Face Hub (public pages, model cards, papers)T2observed 11 h agomedium

1 quantisation levels in this repository (4bit).

Hardware fit (this packaging)

Estimated

36 of 37 device × quantization combinations fit.

Run locally: your machine →
Estimated hardware fit
HardwareQuantizationDevice memoryEst. memoryFits
Apple M3 Ultra4bit—14.3 GB est.Yes
Mac Studio (Apple M5 Ultra)4bit—14.3 GB est.Yes
Apple M2 Ultra4bit—14.3 GB est.Yes
Apple M1 Ultra4bit—14.3 GB est.Yes
Apple M3 Max4bit—14.3 GB est.Yes
Apple M4 Max4bit—14.3 GB est.Yes
Mac Studio (Apple M5 Max)4bit—14.3 GB est.Yes
MacBook Pro (Apple M5 Max)4bit—14.3 GB est.Yes
Apple M2 Max4bit—14.3 GB est.Yes
Apple M1 Max4bit—14.3 GB est.Yes
Apple M4 Pro4bit—14.3 GB est.Yes
Mac mini (Apple M5 Pro)4bit—14.3 GB est.Yes
MacBook Pro (Apple M5 Pro)4bit—14.3 GB est.Yes
Apple M3 Pro4bit—14.3 GB est.Yes
Apple M1 Pro4bit—14.3 GB est.Yes
Apple M2 Pro4bit—14.3 GB est.Yes
Apple M44bit—14.3 GB est.Yes
iMac (Apple M4)4bit—14.3 GB est.Yes
Mac mini (Apple M6)4bit—14.3 GB est.Yes
MacBook Air (Apple M5)4bit—14.3 GB est.Yes
MacBook Pro (Apple M5)4bit—14.3 GB est.Yes
Apple M24bit—14.3 GB est.Yes
Apple M34bit—14.3 GB est.Yes
NVIDIA GeForce RTX 30904bit24 GB14.3 GB est.Yes
NVIDIA GeForce RTX 40904bit24 GB14.3 GB est.Yes
NVIDIA GeForce RTX 50904bit32 GB14.3 GB est.Yes
NVIDIA A100 80GB4bit80 GB14.3 GB est.Yes
NVIDIA H100 SXM4bit80 GB14.3 GB est.Yes
NVIDIA H100 NVL4bit94 GB14.3 GB est.Yes
NVIDIA DGX Spark4bit128 GB14.3 GB est.Yes
NVIDIA H2004bit141 GB14.3 GB est.Yes
NVIDIA H200 NVL4bit141 GB14.3 GB est.Yes
NVIDIA B2004bit180 GB14.3 GB est.Yes
AMD Instinct MI300X4bit192 GB14.3 GB est.Yes
AMD Instinct MI325X4bit256 GB14.3 GB est.Yes
NVIDIA DGX B2004bit1,440 GB14.3 GB est.Yes
Apple M14bit—14.3 GB est.No
Assumptions (7)
  • Estimated, not measured: weights = parameters × bytes/param × 1.15 runtime overhead (or the observed artifact file size when one is recorded).
  • bytes/param: 4bit = 0.5, 8bit = 1.0, fp16 = 2.0 (uniform quantization, no per-layer exceptions).
  • KV cache: 2 × layers × kv_heads × head_dim × 2 bytes × context × batch when the architecture is known; otherwise 0.5 GB per 8 192 tokens (× batch), independent of architecture (GQA/MLA models need less).
  • A model 'fits' when the estimate is at most the device memory minus 2 GB reserved for the OS and framework.
  • Mixture-of-experts models are estimated on total parameters (all experts must be resident); active parameters are ignored.
  • Device memory uses the largest configuration when several are listed (e.g. Apple silicon tiers).
  • Multi-GPU: device memories are summed; interconnect bandwidth, tensor-parallel replication and pipeline bubbles are not modelled.

Provenance

Attributed facts

27

Source tiers

T227

Freshest observation

2 h ago

Conflicts

None

Source documents
SourceDocumentTypeTierLast observedSnapshots
Hugging Face Hub (public pages, model cards, papers)huggingface.co/models?author=mlx-community&p=0&sort=downloads listingT2· Quality secondary2 h ago7
Hugging Face Hub (public pages, model cards, papers)huggingface.co/mlx-community/Devstral-Small-2-24B-Instruct-2512-4bit/raw/main/README.md model_cardT2· Quality secondary5 h ago1
Hugging Face Hub (public pages, model cards, papers)huggingface.co/mlx-community/Devstral-Small-2-24B-Instruct-2512-4bit model_pageT2· Quality secondary6 h ago5

Tier 1 = official/primary, 2 = quality secondary, 3 = community, 4 = unverified. Every snapshot is archived; see all sources and the methodology.