Top 200 ReposEXPLORER
Browse agents, categories and pages

Agent tool · ggml-org

llama.cpp

A C/C++ inference engine for open-weight models whose llama-server exposes an OpenAI-compatible API, including tool calls.

1 use cases · github.com

Local and Self-Hosted AI

Planned, not done

Give your agent a local model that can call tools, served by llama.cpp’s llama-server

llama-server from llama.cpp speaks the OpenAI chat API, and with its --jinja flag it turns model output into OpenAI-style tool calls, so agents and libraries built for hosted APIs can run on a model on your own machine.

github.comggml-org/llama.cpp

Used for similar jobs