Expand description
Autonomous multi-hour lab loop: measure → search configs → re-measure → lock-in.
This is not an LLM rewriting kernels. It is a disciplined experimental program that:
- Explores a discrete configuration space (resident, coop, kv, mode, backend)
- Optionally re-samples the best configs (self-improvement via evidence)
- Tracks plateau / wall-clock budget
- Emits a lock-in package: best config, full CSV, methodology text, apply script
Plan: docs/plans/inference-superiority-lab-and-toolset-plan.md L4.
Structs§
- Auto
Improve Config - LabConfig
- One point in the searchable config space.
- Lock
InPackage - Trial
Result
Functions§
- default_
search_ space - Search space for recursive improvement (expandable).
- format_
lockin_ summary - run_
auto_ improve - Run the recursive lab program; write lock-in package under
cfg.out_dir. - try_
ollama_ decode_ tok_ s - Probe Ollama decode tok/s if server is up (optional; not a product dependency).