The problem
How it works
autoresearch fixes data preparation in one file and lets the agent edit only `train.py`, guided by instructions you write in `program.md`. Each experiment trains for a fixed five-minute budget and is judged on validation bits per byte; the agent keeps or discards each change and logs the results for you to review later.
Results and limitations
The README estimates about a dozen experiments per hour, or roughly a hundred overnight, on a single NVIDIA GPU.
Before you try it
It targets NVIDIA GPUs (tested on H100), results are only comparable on the same hardware, and the README runs the agent without permission prompts, so isolate the machine. GPU and agent costs add up. Results depend on your setup and were not independently reproduced by Top 200 Repos.
Tools and repositories
- Tools
- NVIDIA GPU · Python 3.10+ · uv · Claude Code or Codex
- Prerequisites
- A single NVIDIA GPU and a coding agent subscription or API key.
Try it yourself: Write a program.md for an overnight run
Fill the fields to adapt the prompt. Empty fields stay as visible [placeholders].
Help me write program.md for an autoresearch run on [GPU]. The research direction is [Research direction]. Rules for the agent: edit only train.py, never prepare.py; run each experiment within the fixed time budget; record every change, its val_bpb and a one-line rationale in [Log file]; revert any change that does not improve the metric. Stop after [Experiment cap] experiments or if three runs crash in a row. Do not install packages, access the network beyond what prepare.py already did, or touch files outside the repository. Show me the draft before I start the run.Run unattended agents only on an isolated machine or container with no access to secrets.
Related videos
About anthropics/claude-code
The SECRET Claude Code Upgrade That Has Everyone Going Nuts (Full Guide) (opens in a new tab)
The title names the project, the description links the project website.
Watch on YouTube (opens in a new tab)About openai/codex
Meet the New Codex CLI (opens in a new tab)
Published by the project’s official channel.
Watch on YouTube (opens in a new tab)About anthropics/claude-code
The only Claude Code guide you'll ever need (Opus 4.5) (opens in a new tab)
The title names the project, the description links the project website.
Watch on YouTube (opens in a new tab)Independent creators. Listing a video implies no endorsement, sponsorship or partnership.
Sources
- karpathy/autoresearch README (opens in a new tab)
Project documentation · github.com · Undated · Source checked 9 Nov 2026, 22:25 UTC
What this source supports
- Agent edits only train.py, guided by program.md
- Fixed five-minute training budget per experiment
- val_bpb metric, lower is better
- Roughly 12 experiments per hour, about 100 overnight
- Single NVIDIA GPU; tested on H100


