vllm-project/vllm

What it does

A high-throughput and memory-efficient inference and serving engine for LLMs

Summary based on the GitHub description (opens in a new tab)

What the README covers

• About
• Getting Started
• Contributing
• Citation
• Contact Us
• Media Kit

Getting started

Excerpt from the README · Checked 15 Oct 2026

uv pip install vllm
vllm download-kernels  # precompiled kernels for faster startup

Shown exactly as published. Top 200 Repos has not run or tested it. View in README (opens in a new tab)

Ranking trend

Global rank in each recorded snapshot. A lower number is a higher rank.

From #156 to #154 across 2 snapshots since 15 Oct 2026.

What people build with it

Related repositories

• ollama/ollama#45

  Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

  Shared topics: gpt-oss, llama, qwen, deepseek

• huggingface/transformers#52

  🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

  Shared topics: transformer, qwen, pytorch, deepseek

• cheaper-inference/OmniRoute#192

  Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 900+ …

  Shared topics: kimi, qwen, deepseek, openai

• langgenius/dify#56

  Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.

  Shared topics: deepseek, gpt, openai, llm

• rasbt/LLMs-from-scratch#124

  Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

  Shared topics: pytorch, gpt, llm

• Significant-Gravitas/AutoGPT#43

  AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

  Shared topics: gpt, openai, llm