Skip to content
AI Atlas
FrameworkActive

exllamav3

turboderpgithub.com/turboderp-org/exllamav3

An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs

Updated 11 min ago · first seen 11 Sept 2026

framework_01M294FW1KPR5EXJ643WGGNYZS

Version
1.4.9
T2 · 16 min ago
Released
10 Sept 2026
T2 · 16 min ago
License
MIT
T2 · 16 min ago
Stars
1,369
T2 · 11 min ago

Specification

License
MIT

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Created at
6 Apr 2025

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Default branch
master

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Kind
runtime

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Latest release
10 Sept 2026

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Latest release tag
1.4.9

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Latest version
1.4.9

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

License name
MIT License

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Forks
168

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium

Releases
58

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium

Stars
1,369

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium

Tags
58

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium

Watchers
26

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium

Readme url
https://raw.githubusercontent.com/turboderp-org/exllamav3/HEAD/README.md

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Releases url
https://github.com/turboderp-org/exllamav3/releases

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Each value shows its source, tier and observation time. Conflicting claims are kept side by side and flagged — never averaged. How AI Atlas records facts →

Provenance

Attributed facts

17

Source tiers

T217

Freshest observation

11 min ago

Conflicts

None