local-ai·lab
local-ai-lab — a neural network flowing into ascending learning steps

About this project

local-ai-lab teaches how modern AI actually works by building it from scratch — small, readable programs you run on your own machine. It's one piece of a broader body of work: local-first, developer-focused, AI-native tools.

The through-line

The course grew out of a simple preference that runs through everything below: software should be understandable, should run on your own hardware, and should treat AI as a primitive you control — not a remote black box. The projects span model finetuning and compression, agent and inference tooling, AI-assisted documentation, and the everyday developer utilities that hold a workflow together.

Built and maintained by Nik Reljin. The full catalog lives on GitHub; the selection here is deliberately small — the ones most relevant to the themes of this course.

Local & applied AI

Rust

finetorch

A Rust-native LLM finetuning toolkit: LoRA / QLoRA, dataset preparation, training orchestration, and evaluation — designed to run on a single GPU.
View on GitHub →
Python

shrink-llm

An end-to-end toolkit for compressing large models — quantization, pruning, and knowledge distillation — so they deploy efficiently on phones and edge devices.
View on GitHub →
Shell

ai-runner

Pick and run Ollama models on your own machine from a simple UI — local inference without the setup friction.
View on GitHub →
Go

agentvault

A CLI/TUI that manages and proxies AI agents, API keys, and instructions behind one controlled gateway.
View on GitHub →

AI-assisted developer tooling

Python

claude-docsmith

Generate user and developer documentation straight from a repository, using Anthropic Claude or a local Ollama model.
View on GitHub →
Python

docforge

Auto-generate references and end-user guides from any codebase on every push — CI-driven, and designed to be vendored as a submodule.
View on GitHub →

Developer tools

Rust

vellum

A full-TUI Markdown reader for the terminal: syntax-highlighted code, inline images, clickable links, search, and navigation history.
View on GitHub →
Python

git-pulse

A self-hosted dashboard that surfaces contributor impact, repo health, and code quality from commit analytics and PR signals.
View on GitHub →
Start Lesson 1: RAG →