Frameworks
Frameworks & runtimes
Libraries, inference engines and agent frameworks. Versions and stars are read from PyPI, GitHub and release pages — never estimated.
59 total
| Framework | Latest version | Release date | License | Stars | Language | Organization | Quality | Compare |
|---|---|---|---|---|---|---|---|---|
| lancedbDeveloper-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less. | — | — | Apache-2.0 | 11,402 | — | LanceDB | ||
| weaviateWeaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database. | v1.39.4 - HFresh recover orphaned postings through reassign-all Fix | 11 Sept 2026 | — | 16,801 | — | Weaviate | ||
| pytorch-lightningPretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes. | Lightning 2.6.6 | 10 Sept 2026 | Apache-2.0 | 31,336 | — | Lightning AI | ||
| axolotlGo ahead and axolotl questions | 0.19.0 | 10 Sept 2026 | Apache-2.0 | 12,461 | — | Axolotl AI | ||
| milvusMilvus is a high-performance, cloud-native vector database built for scalable vector ANN search | milvus-3.0.1 | 9 Sept 2026 | Apache-2.0 | 46,062 | — | Zilliz | ||
| qdrantQdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/ | 1.19.1 | 4 Sept 2026 | Apache-2.0 | 34,500 | — | Qdrant | ||
| unslothLocal UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more. | Large Performance Gains + Fixes | 9 Sept 2026 | Apache-2.0 | 76,034 | — | Unsloth | ||
| chromaSearch infrastructure for AI | 1.5.9 | 5 May 2026 | Apache-2.0 | 29,283 | — | Chroma | ||
| trlTrain transformer language models with reinforcement learning. | 1.13.0 | 10 Sept 2026 | Apache-2.0 | 19,286 | — | Hugging Face | ||
| faissA library for efficient similarity search and clustering of dense vectors. | 1.15.0 | 3 Aug 2026 | MIT | 40,893 | — | Meta AI | ||
| peft🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning. | 0.20.0 | 28 Jul 2026 | Apache-2.0 | 21,657 | — | Hugging Face | ||
| browser-useAgents that use the browser. | 0.13.10 | 4 Sept 2026 | MIT | 114,248 | — | Browser Use | ||
| diffusers🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch. | Diffusers 0.40.0: New pipelines, tensor-parallel support, improved CLI, and more | 20 Aug 2026 | Apache-2.0 | 34,497 | — | Hugging Face | ||
| pydantic-aiHow Python does AI. Agents, realtime voice, image generation, embeddings. Every model, every interface, typed end to end. | v2.42.0 (2026-09-08) | 9 Sept 2026 | MIT | 19,868 | — | Pydantic | ||
| jaxComposable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more | JAX v0.11.1 | 17 Aug 2026 | Apache-2.0 | 36,295 | — | |||
| autogenA programming framework for agentic AI | python-v0.7.5 | 30 Sept 2025 | CC-BY-4.0 | 60,939 | — | Microsoft | ||
| transformers🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training. | Release 5.17.0 | 10 Sept 2026 | Apache-2.0 | 165,129 | — | Hugging Face | ||
| pytorchTensors and Dynamic neural networks in Python with strong GPU acceleration | viable/strict/1789158535: [ROCm][CD] Add gfx1250 (MI450) to the nightly wheel arch list (#196610) | 11 Sept 2026 | — | 102,930 | — | PyTorch Foundation | ||
| crewAIFramework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks. | 1.15.21 | 9 Sept 2026 | MIT | 58,372 | — | CrewAI | ||
| aideraider is AI pair programming in your terminal | 0.86.3.dev | 12 Feb 2026 | Apache-2.0 | 48,909 | — | Aider | ||
| OpenHands🙌 OpenHands: AI-Driven Development | 1.18.0 | 11 Sept 2026 | MIT | 87,506 | — | All Hands AI | ||
| claude-codeClaude Code is an agentic coding tool that lives in your terminal, understands your codebase, and helps you code faster by executing routine tasks, explaining complex code, and handling git workflows - all through natural language commands. | 2.1.269 | 11 Sept 2026 | — | 144,775 | — | Anthropic | ||
| codexLightweight coding agent that runs in your terminal | 0.155.0-alpha.3.10 | 11 Sept 2026 | Apache-2.0 | 123,404 | — | OpenAI | ||
| litellmThe fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM] | 1.102.0-dev.2 | 11 Sept 2026 | — | 58,531 | — | BerriAI | ||
| llama_indexLlamaIndex is the document processing platform for AI | 0.14.24 | 19 Aug 2026 | MIT | 52,128 | — | LlamaIndex | ||
| langgraphBuild resilient agents. | langgraph-sdk==0.4.4 | 27 Aug 2026 | MIT | 41,477 | — | LangChain | ||
| langchainThe agent engineering platform. | langchain-core==1.6.3 | 11 Sept 2026 | MIT | 146,134 | — | LangChain | ||
| serversModel Context Protocol Servers | 2026.6.16 | 16 Jun 2026 | — | 90,252 | — | Model Context Protocol | ||
| gemini-cliAn open-source AI agent that brings the power of Gemini directly into your terminal. | Release v0.61.0-nightly.20260911.ged2ac40df | 11 Sept 2026 | Apache-2.0 | 106,926 | — | |||
| python-genaiGoogle Gen AI Python SDK provides an interface for developers to integrate Google's generative models into their Python applications. | 2.23.0 | 10 Sept 2026 | Apache-2.0 | 3,969 | — | |||
| anthropic-sdk-pythonContribute to anthropics/anthropic-sdk-python development by creating an account on GitHub. | 1.5.0 | 10 Sept 2026 | MIT | 3,899 | — | Anthropic | ||
| openai-pythonThe official Python library for the OpenAI API | 3.13.0 | 10 Sept 2026 | Apache-2.0 | 31,619 | — | OpenAI | ||
| stable-diffusion-webuiStable Diffusion web UI | 1.10.1 | 9 Feb 2025 | AGPL-3.0 | 164,897 | — | — | ||
| ComfyUIThe most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface. | 0.35.1 | 10 Sept 2026 | GPL-3.0 | 132,585 | — | Comfy Org | ||
| textgenOpen-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private. | 4.9 | 20 May 2026 | AGPL-3.0 | 47,658 | — | — | ||
| lmsLM Studio CLI | — | — | MIT | 5,284 | — | LM Studio | ||
| exoRun frontier AI locally. | 1.0.71 | 23 Apr 2026 | Apache-2.0 | 47,362 | — | EXO Labs | ||
| lmdeployLMDeploy is a toolkit for compressing, deploying, and serving LLMs. | 0.17.0 | 1 Sept 2026 | Apache-2.0 | 8,058 | — | InternLM (Shanghai AI Laboratory) | ||
| exllamav3An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs | 1.4.9 | 10 Sept 2026 | MIT | 1,369 | — | turboderp | ||
| exllamav2A fast inference library for running LLMs locally on modern consumer-class GPUs | 0.3.2 | 9 Dec 2025 | MIT | 4,619 | — | turboderp |
Stars are a GitHub metric observed at crawl time (see each framework's Sources tab for the snapshot). Versions come from PyPI or the project's release feed.