Skip to content
AI Atlas
FrameworkActive

exllamav2

turboderpgithub.com/turboderp-org/exllamav2

A fast inference library for running LLMs locally on modern consumer-class GPUs

Updated 11 min ago · first seen 11 Sept 2026

framework_01M294FP5VNJV2GS1HF822YE15

Version
0.3.2
T2 · 16 min ago
Released
9 Dec 2025
T2 · 16 min ago
License
MIT
T2 · 16 min ago
Stars
4,619
T2 · 11 min ago

Specification

License
MIT

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Created at
30 Aug 2023

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Default branch
master

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Kind
runtime

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Latest release
9 Dec 2025

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Latest release tag
0.3.2

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Latest version
0.3.2

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

License name
MIT License

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Forks
340

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium

Releases
43

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium

Stars
4,619

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium

Tags
43

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium

Watchers
33

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium

PyPI
exllamav2

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Readme url
https://raw.githubusercontent.com/turboderp-org/exllamav2/HEAD/README.md

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Releases url
https://github.com/turboderp-org/exllamav2/releases

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Each value shows its source, tier and observation time. Conflicting claims are kept side by side and flagged — never averaged. How AI Atlas records facts →

Provenance

Attributed facts

18

Source tiers

T218

Freshest observation

11 min ago

Conflicts

None