bartowski/Qwen2.5-7B-Instruct-GGUF
Updated 1 h ago · first seen 11 Sept 2026
model_01M294XK1XBWD55AQMMYS8SXDP
- Parameters
- 7B
- T2 · 1 h ago
- Released
- 16 Sept 2024
- T2 · 1 h ago
- License
- apache-2.0
- T2 · 1 h ago
Specification
- Release date
- 16 Sept 2024
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- Openness
- open-weights
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- License
- apache-2.0
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- Parameters
- 7B
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- Languages
- en
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- Base model
- Qwen/Qwen2.5-7B-Instruct
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- Quantization
- F16, IQ2_M, IQ3_M, IQ3_XS, IQ4_XS, Q2_K, Q2_K_L, Q3_K_L, Q3_K_M, Q3_K_S, Q3_K_XL, Q4_0, Q4_0_4_4, Q4_0_4_8, Q4_0_8_8, Q4_K_L, Q4_K_M, Q4_K_S, Q5_K_L, Q5_K_M, Q5_K_S, Q6_K, Q6_K_L, Q8_0
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- Quantization format
- gguf
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- Hugging Face repo
- bartowski/Qwen2.5-7B-Instruct-GGUF
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- Pipeline tag
- text-generation
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- Model card
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- Downloads
- 230,231
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- Likes
- 75
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- Gated
- No
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- Is quantized
- Yes
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- Last modified
- 2024-09-19T12:54:25+00:00
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- License url
- https://huggingface.co/Qwen/Qwen2.5-7B-Instruct/blob/main/LICENSE
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- Downloads all time
- 1,298,640
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- Quantized by
- bartowski
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
- Tags
- gguf, chat, text-generation, en
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
Each value shows its source, tier and observation time. Conflicting claims are kept side by side and flagged — never averaged. How AI Atlas records facts →
Provenance
Attributed facts
20
Source tiers
T220
Freshest observation
1 h ago
Conflicts
None
Modalities
Modalities unavailable.
Capabilities
Tool calling
Unavailable
Structured output
Unavailable
Reasoning
Unavailable
Vision
Unavailable
Audio
Unavailable
Fine-tuning available
Unavailable
No capability flags have been observed from a source yet — we do not infer them.
- Languages
- en
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 1 h agomedium
No benchmark results recorded
Current prices
No current prices recorded
Price history
Memory need = bytes per parameter (4-bit ≈ 0.5 × 1.15 overhead, 8-bit 1.0, fp16 2.0) + a KV-cache allowance. Not a measurement.
| Hardware | Quantization | Memory | Est. need | Fits |
|---|---|---|---|---|
| Apple M3 Ultra | 4bit | — | 4.5 GB | Yes |
| AMD Instinct MI325X | 4bit | 256 GB | 4.5 GB | Yes |
| AMD Instinct MI300X | 4bit | 192 GB | 4.5 GB | Yes |
| Apple M2 Ultra | 4bit | — | 4.5 GB | Yes |
| NVIDIA B200 | 4bit | 180 GB | 4.5 GB | Yes |
| NVIDIA H200 | 4bit | 141 GB | 4.5 GB | Yes |
| Apple M1 Ultra | 4bit | — | 4.5 GB | Yes |
| Apple M3 Max | 4bit | — | 4.5 GB | Yes |
| Apple M4 Max | 4bit | — | 4.5 GB | Yes |
| NVIDIA DGX Spark | 4bit | 128 GB | 4.5 GB | Yes |
| Apple M2 Max | 4bit | — | 4.5 GB | Yes |
| NVIDIA A100 80GB | 4bit | 80 GB | 4.5 GB | Yes |
| NVIDIA H100 SXM | 4bit | 80 GB | 4.5 GB | Yes |
| Apple M1 Max | 4bit | — | 4.5 GB | Yes |
| Apple M4 Pro | 4bit | — | 4.5 GB | Yes |
| Apple M3 Pro | 4bit | — | 4.5 GB | Yes |
| Apple M1 Pro | 4bit | — | 4.5 GB | Yes |
| Apple M2 Pro | 4bit | — | 4.5 GB | Yes |
| Apple M4 | 4bit | — | 4.5 GB | Yes |
| NVIDIA GeForce RTX 5090 | 4bit | 32 GB | 4.5 GB | Yes |
| Apple M2 | 4bit | — | 4.5 GB | Yes |
| Apple M3 | 4bit | — | 4.5 GB | Yes |
| NVIDIA GeForce RTX 3090 | 4bit | 24 GB | 4.5 GB | Yes |
| NVIDIA GeForce RTX 4090 | 4bit | 24 GB | 4.5 GB | Yes |
| Apple M1 | 4bit | — | 4.5 GB | Yes |
Ancestors 2
- Qwen2.5 7B Instruct7.62B
- Qwen2.5-7BQwen
This model
bartowski/Qwen2.5-7B-Instruct-GGUF
7B params
Quantizations 0
None recorded.
Descendants 0
None recorded.
Papers 0
No papers linked yet.
Repositories 0
No repositories linked yet.
As of
Rewind the record: see this entity's attributes exactly as AI Atlas knew them on a given day.
Claim history · Tags
Claims are temporal and append-only: a new observation closes the previous claim (valid_to) instead of overwriting it. Conflicting claims from different sources are kept side by side and flagged — never averaged. Methodology →
bartowski/Qwen2.5-7B-Instruct-GGUF: parameter count changed from 7615616512 to 7000000000
Parameters7.62B→7BhuggingfaceNew model: bartowski/Qwen2.5-7B-Instruct-GGUF (bartowski)
huggingface
| Source | Document | Type | Tier | Last observed | Snapshots |
|---|---|---|---|---|---|
| Hugging Face Hub (public pages, model cards, papers) | huggingface.co/bartowski/Qwen2.5-7B-Instruct-GGUF/raw/main/README.md | model_card | T2· Quality secondary | 17 min ago | 1 |
| Hugging Face Hub (public pages, model cards, papers) | huggingface.co/bartowski/Qwen2.5-7B-Instruct-GGUF | model_page | T2· Quality secondary | 1 h ago | 2 |
| Hugging Face Hub (public pages, model cards, papers) | huggingface.co/models?author=bartowski&p=0&sort=downloads | listing | T2· Quality secondary | 1 h ago | 2 |
Tier 1 = official/primary, 2 = quality secondary, 3 = community, 4 = unverified. Every snapshot is archived; see all sources and the methodology.