Skip to content
AI Atlas
FrameworkActive

TensorRT-LLM

NVIDIAgithub.com/NVIDIA/TensorRT-LLM

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate

Updated 15 min ago · first seen 11 Sept 2026

framework_01M294ES1YRZVZWYQP5W3K09DW

Version
1.3.0rc26
T2 · 20 min ago
Released
9 Sept 2026
T2 · 20 min ago
Stars
14,597
T2 · 15 min ago

Specification

Created at
16 Aug 2023

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

Default branch
main

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

Homepage
https://nvidia.github.io/TensorRT-LLM

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

Kind
runtime

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

Latest release
9 Sept 2026

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

Latest release tag
v1.3.0rc26

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

Latest version
1.3.0rc26

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

License name
Other

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

Forks
2,736

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 15 min agomedium

Releases
89

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 15 min agomedium

Stars
14,597

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 15 min agomedium

Tags
99

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 15 min agomedium

Watchers
122

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 15 min agomedium

PyPI
tensorrt-llm

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

Readme url
https://raw.githubusercontent.com/NVIDIA/TensorRT-LLM/HEAD/README.md

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

Releases url
https://github.com/NVIDIA/TensorRT-LLM/releases

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

Topics
blackwell, cuda, llm-serving, moe, pytorch

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 20 min agomedium

Each value shows its source, tier and observation time. Conflicting claims are kept side by side and flagged — never averaged. How AI Atlas records facts →

Provenance

Attributed facts

19

Source tiers

T219

Freshest observation

15 min ago

Conflicts

None