bartowski/Qwen_Qwen3.5-2B-GGUF
published by bartowskihuggingface.co/bartowski/Qwen_Qwen3.5-2B-GGUF
This is a quantization of Qwen3.5-2B, not an independent model. Parameters, benchmarks, prices and lineage are recorded on the canonical model. Open Qwen3.5-2B →
Updated 3 h ago · first seen 11 Sept 2026
model_01M294XK0K3XZT68YPCHVZ8H1C
- File size
- —
- Format
- Downloads
- Published
Artifact facts
- Quantization format
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 12 h agomedium
- Quantization
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 12 h agomedium
- Downloads
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 7 h agomedium
- Likes
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 7 h agomedium
- Hugging Face repo
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 13 h agomedium
- Base model
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 12 h agomedium
- Quantized by
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 12 h agomedium
- Pipeline tag
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 13 h agomedium
- Gated
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 12 h agomedium
- License
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 12 h agomedium
- Release date
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 12 h agomedium
- Last modified
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 13 h agomedium
- Model card
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 13 h agomedium
- Tags
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 12 h agomedium
24 quantisation levels in this repository (BF16, IQ2_M, IQ3_M, IQ3_XS, IQ3_XXS, IQ4_NL, IQ4_XS, Q2_K…).
Hardware fit (this packaging)
Assumptions (7)
- Estimated, not measured: weights = parameters × bytes/param × 1.15 runtime overhead (or the observed artifact file size when one is recorded).
- bytes/param: 4bit = 0.5, 8bit = 1.0, fp16 = 2.0 (uniform quantization, no per-layer exceptions).
- KV cache: 2 × layers × kv_heads × head_dim × 2 bytes × context × batch when the architecture is known; otherwise 0.5 GB per 8 192 tokens (× batch), independent of architecture (GQA/MLA models need less).
- A model 'fits' when the estimate is at most the device memory minus 2 GB reserved for the OS and framework.
- Mixture-of-experts models are estimated on total parameters (all experts must be resident); active parameters are ignored.
- Device memory uses the largest configuration when several are listed (e.g. Apple silicon tiers).
- Multi-GPU: device memories are summed; interconnect bandwidth, tensor-parallel replication and pipeline bubbles are not modelled.
Timeline
bartowski/Qwen_Qwen3.5-2B-GGUF: parameter count changed from 2000000000 to 1942653248
Parameters2B→1.94Bhuggingfacebartowski/Qwen_Qwen3.5-2B-GGUF: parameter count changed from 1942653248 to 2000000000
Parameters1.94B→2Bhuggingface
Provenance
Attributed facts
24
Source tiers
T224
Freshest observation
3 h ago
Conflicts
None
Tier 1 = official/primary, 2 = quality secondary, 3 = community, 4 = unverified. Every snapshot is archived; see all sources and the methodology.