Skip to content
AI Atlas
FrameworkActive

exllamav3

turboderpgithub.com/turboderp-org/exllamav3

An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs

Updated 31 min ago · first seen 11 Sept 2026

framework_01M294FW1KPR5EXJ643WGGNYZS

Version
1.4.9
T2 · 36 min ago
Released
10 Sept 2026
T2 · 36 min ago
License
MIT
T2 · 36 min ago
Stars
1,369
T2 · 31 min ago

As of

Rewind the record: see this entity's attributes exactly as AI Atlas knew them on a given day.

Claim history · Description

1 claims · 1 propertiesShow all properties

Descriptiondescription1

Claim history for Description
ValueValid from → toStatusSourceConfidenceExtractor
An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs currentcurrentGitHub public repositories (HTML, releases.atom, raw files)T2mediumdeterministic

Claims are temporal and append-only: a new observation closes the previous claim (valid_to) instead of overwriting it. Conflicting claims from different sources are kept side by side and flagged — never averaged. Methodology →