ggml-org/llama.cpp

LLM inference in C/C++

#84 of 200
AI and Machine Learning
C++
★ 134,080

View on GitHub Website

What it does

LLM inference in C/C++

Summary based on the GitHub description (opens in a new tab)

What the README covers

llama.cpp
Quick start
Description
Supported backends
Documentation
Contributing
Acknowledgements

Getting started

Excerpt from the README · Checked 15 Oct 2026

# Download and run a model directly from Hugging Face
llama cli -hf ggml-org/Qwen3.5-0.8B-GGUF

# Launch OpenAI-compatible API server
llama serve -hf ggml-org/Qwen3.5-0.8B-GGUF

Shown exactly as published. Top 200 Repos has not run or tested it. View in README (opens in a new tab)

Ranking trend

Global rank in each recorded snapshot. A lower number is a higher rank.

Global Rank · 2 Observed Snapshots · Lower Is Better · Gaps Indicate Missing Ranks

From #81 to #84 across 2 snapshots since 15 Oct 2026.

What people build with it

No use case in the library involves this repository yet.

Suggest a use case