Reported by sourceNew
Run an open-weight model locally and call it from your code
Install Ollama, pull an open model and call it through the local REST API so prompts stay on your machine.
Agent tool · Ollama
A local runtime and API for downloading and running open-weight language models on your own hardware.
Install Ollama, pull an open model and call it through the local REST API so prompts stay on your machine.
Stephen Sebastian replaced a paid cloud OCR API with Gemma 4 E4B on Ollama to pull date, amount and description from contractor invoice photos on his laptop.
Meetily records calls, transcribes them on the device with Whisper or Parakeet, and writes summaries with a local Ollama model or a cloud model you pick.
paperless-ai suggests titles, tags, correspondents and dates for documents in a Paperless-ngx archive, using a local Ollama model or a cloud LLM, with manual review and undo.