Local AI Series

Under the hood.

Technical deep-dives into how note.md indexes PDFs, retrieves passages, and runs local language models — entirely on your Mac.

FeaturedArchitecture

The local AI architecture behind note.md

How on-device indexing, retrieval, and inference fit together to power semantic search, Matrix extraction, and Evidence Scan — without sending a single byte off your Mac.

8 min readRead article →
Diagram of note.md's local AI architecture
The series

One local index, four pipelines on top of it.

Each pipeline is described step by step, with the chunk sizes, models and ranking math included so you can reason about quality instead of trusting a black box. The last piece steps back and asks the question underneath all of it: what happens to your unpublished work when the AI runs somewhere else.

Local. Private. Yours.

No document, embedding, claim, or model output leaves your Mac. Download note.md and run the pipelines yourself.

Download on the App StoreFree on the App Store