Skip to content
AI Atlas
FrameworkRetired

text-generation-inference

Hugging Facegithub.com/huggingface/text-generation-inference

Large Language Model Text Generation Inference

Updated 15 min ago · first seen 11 Sept 2026

framework_01M294F54TRCE8JE0S5B8JSMPK

Version
3.3.7
T2 · 20 min ago
Released
19 Dec 2025
T2 · 20 min ago
License
Apache-2.0
T2 · 20 min ago
Stars
10,886
T2 · 15 min ago

Specification

Status
archived

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

License
Apache-2.0

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

Created at
8 Oct 2022

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

Default branch
main

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

Homepage
http://hf.co/docs/text-generation-inference

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

Kind
runtime

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

Latest release
19 Dec 2025

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

Latest release tag
v3.3.7

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

Latest version
3.3.7

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

License name
Apache License 2.0

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

Forks
1,285

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 15 min agomedium

Releases
67

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 15 min agomedium

Stars
10,886

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 15 min agomedium

Tags
67

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 15 min agomedium

Watchers
103

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 15 min agomedium

Readme url
https://raw.githubusercontent.com/huggingface/text-generation-inference/HEAD/README.md

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

Releases url
https://github.com/huggingface/text-generation-inference/releases

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

Topics
bloom, deep-learning, falcon, gpt, inference, nlp, pytorch, starcoder, transformer

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

Each value shows its source, tier and observation time. Conflicting claims are kept side by side and flagged — never averaged. How AI Atlas records facts →

Provenance

Attributed facts

20

Source tiers

T220

Freshest observation

15 min ago

Conflicts

None