Skip to content
AI Atlas
FrameworkActive

lmdeploy

InternLM (Shanghai AI Laboratory)github.com/InternLM/lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Updated 11 min ago · first seen 11 Sept 2026

framework_01M294G1YECQ89606KHEDX5KJ8

Version
0.17.0
T2 · 16 min ago
Released
1 Sept 2026
T2 · 16 min ago
License
Apache-2.0
T2 · 16 min ago
Stars
8,058
T2 · 11 min ago

Specification

License
Apache-2.0

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Created at
15 Jun 2023

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Default branch
main

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Homepage
https://lmdeploy.readthedocs.io/en/latest

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Kind
runtime

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Latest release
1 Sept 2026

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Latest release tag
v0.17.0

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Latest version
0.17.0

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

License name
Apache License 2.0

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Forks
740

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium

Releases
70

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium

Stars
8,058

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium

Tags
70

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium

Watchers
57

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium

PyPI
lmdeploy

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Readme url
https://raw.githubusercontent.com/InternLM/lmdeploy/HEAD/README.md

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Releases url
https://github.com/InternLM/lmdeploy/releases

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Topics
codellama, cuda-kernels, deepspeed, fastertransformer, internlm, llama, llama2, llama3, llm, llm-inference, turbomind

Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Each value shows its source, tier and observation time. Conflicting claims are kept side by side and flagged — never averaged. How AI Atlas records facts →

Provenance

Attributed facts

20

Source tiers

T220

Freshest observation

11 min ago

Conflicts

None