ArtifactquantizationFP8Open weights

tencent/Hy3-FP8

published by Tencenthuggingface.co/tencent/Hy3-FP8

The canonical model of this artifact is not resolved yet — it is listed as an artifact because its name, repo or metadata identify it as a re-packaging.

data quality42

Updated 2 h ago · first seen 11 Sept 2026

model_01M2950AZ8MJHJZQK7YR3DF0YE

File size
Format
Downloads
Published

Artifact facts

Quantization format: Source:Hugging Face Hub (public pages, model cards, papers)T2observed 11 h agomedium
Weights dtype: Source:Hugging Face Hub (public pages, model cards, papers)T2observed 11 h agomedium
File size: Source:Hugging Face Hub (public pages, model cards, papers)T2observed 11 h agomedium
Downloads: Source:Hugging Face Hub (public pages, model cards, papers)T2observed 6 h agomedium
Likes: Source:Hugging Face Hub (public pages, model cards, papers)T2observed 6 h agomedium
Hugging Face repo: Source:Hugging Face Hub (public pages, model cards, papers)T2observed 12 h agomedium
Pipeline tag: Source:Hugging Face Hub (public pages, model cards, papers)T2observed 12 h agomedium
Library name: Source:Hugging Face Hub (public pages, model cards, papers)T2observed 11 h agomedium
Gated: Source:Hugging Face Hub (public pages, model cards, papers)T2observed 11 h agomedium
License: Source:Hugging Face Hub (public pages, model cards, papers)T2observed 11 h agomedium
Release date: Source:Hugging Face Hub (public pages, model cards, papers)T2observed 11 h agomedium
Last modified: Source:Hugging Face Hub (public pages, model cards, papers)T2observed 12 h agomedium
Model card: huggingface.co/tencent/Hy3-FP8
Source:Hugging Face Hub (public pages, model cards, papers)T2observed 12 h agomedium
Tags: Source:Hugging Face Hub (public pages, model cards, papers)T2observed 11 h agomedium

Hardware fit (this packaging)

Estimated

7 of 37 device × quantization combinations fit.

Run locally: your machine →

Estimated hardware fit
Hardware	Quantization	Device memory	Est. memory	Fits
Apple M3 Ultra	4bit	—	172.3 GB est.	Yes
Mac Studio (Apple M5 Ultra)	4bit	—	172.3 GB est.	Yes
Apple M2 Ultra	4bit	—	172.3 GB est.	Yes
NVIDIA B200	4bit	180 GB	172.3 GB est.	Yes
AMD Instinct MI300X	4bit	192 GB	172.3 GB est.	Yes
AMD Instinct MI325X	4bit	256 GB	172.3 GB est.	Yes
NVIDIA DGX B200	4bit	1,440 GB	172.3 GB est.	Yes
Apple M1 Ultra	4bit	—	172.3 GB est.	No
Apple M3 Max	4bit	—	172.3 GB est.	No
Apple M4 Max	4bit	—	172.3 GB est.	No
Mac Studio (Apple M5 Max)	4bit	—	172.3 GB est.	No
MacBook Pro (Apple M5 Max)	4bit	—	172.3 GB est.	No
Apple M2 Max	4bit	—	172.3 GB est.	No
Apple M1 Max	4bit	—	172.3 GB est.	No
Apple M4 Pro	4bit	—	172.3 GB est.	No
Mac mini (Apple M5 Pro)	4bit	—	172.3 GB est.	No
MacBook Pro (Apple M5 Pro)	4bit	—	172.3 GB est.	No
Apple M3 Pro	4bit	—	172.3 GB est.	No
Apple M1 Pro	4bit	—	172.3 GB est.	No
Apple M2 Pro	4bit	—	172.3 GB est.	No
Apple M4	4bit	—	172.3 GB est.	No
iMac (Apple M4)	4bit	—	172.3 GB est.	No
Mac mini (Apple M6)	4bit	—	172.3 GB est.	No
MacBook Air (Apple M5)	4bit	—	172.3 GB est.	No
MacBook Pro (Apple M5)	4bit	—	172.3 GB est.	No
Apple M2	4bit	—	172.3 GB est.	No
Apple M3	4bit	—	172.3 GB est.	No
Apple M1	4bit	—	172.3 GB est.	No
NVIDIA GeForce RTX 3090	4bit	24 GB	172.3 GB est.	No
NVIDIA GeForce RTX 4090	4bit	24 GB	172.3 GB est.	No
NVIDIA GeForce RTX 5090	4bit	32 GB	172.3 GB est.	No
NVIDIA A100 80GB	4bit	80 GB	172.3 GB est.	No
NVIDIA H100 SXM	4bit	80 GB	172.3 GB est.	No
NVIDIA H100 NVL	4bit	94 GB	172.3 GB est.	No
NVIDIA DGX Spark	4bit	128 GB	172.3 GB est.	No
NVIDIA H200	4bit	141 GB	172.3 GB est.	No
NVIDIA H200 NVL	4bit	141 GB	172.3 GB est.	No

Assumptions (7)

Estimated, not measured: weights = parameters × bytes/param × 1.15 runtime overhead (or the observed artifact file size when one is recorded).
bytes/param: 4bit = 0.5, 8bit = 1.0, fp16 = 2.0 (uniform quantization, no per-layer exceptions).
KV cache: 2 × layers × kv_heads × head_dim × 2 bytes × context × batch when the architecture is known; otherwise 0.5 GB per 8 192 tokens (× batch), independent of architecture (GQA/MLA models need less).
A model 'fits' when the estimate is at most the device memory minus 2 GB reserved for the OS and framework.
Mixture-of-experts models are estimated on total parameters (all experts must be resident); active parameters are ignored.
Device memory uses the largest configuration when several are listed (e.g. Apple silicon tiers).
Multi-GPU: device memories are summed; interconnect bandwidth, tensor-parallel replication and pipeline bubbles are not modelled.

Provenance

Attributed facts

Source tiers

T225

Freshest observation

2 h ago

Conflicts

None

Source documents
Source	Document	Type	Tier	Last observed	Snapshots
Hugging Face Hub (public pages, model cards, papers)	huggingface.co/models?author=tencent&p=0&sort=downloads	listing	T2· Quality secondary	2 h ago	7
Hugging Face Hub (public pages, model cards, papers)	huggingface.co/tencent/Hy3-FP8/raw/main/README.md	model_card	T2· Quality secondary	5 h ago	1
Hugging Face Hub (public pages, model cards, papers)	huggingface.co/tencent/Hy3-FP8	model_page	T2· Quality secondary	6 h ago	5

Tier 1 = official/primary, 2 = quality secondary, 3 = community, 4 = unverified. Every snapshot is archived; see all sources and the methodology.