Writing

Essays & explainers

Notes on agentic systems, retrieval, and shipping ML to production. Some plain, some deep.

Jun 2026

June 28, 202614 min readTransformersAttention

Attention

The word "bit" gets the same vector in "the dog bit" and "a little bit", so attention rewrites each token by letting it look at its neighbors. Query, Key, Value, scaled dot-product, causal masking, and 16 parallel heads, step by step. An animated explainer.

June 19, 20269 min readTransformersAttention

Positional Encoding

Attention reads a sentence as a bag of words, so "the dog bit the man" and "the man bit the dog" look identical to it. How a transformer learns word order, from additive embeddings to RoPE. An animated explainer.

June 6, 20268 min readNVIDIAComputer Vision

LocateAnything

NVIDIA's LocateAnything draws a whole object box in one stroke instead of one coordinate at a time. An animated, hands-on explainer.

May 2026

May 26, 202616 min readAgentsMemory

How AI agents remember

A field guide to agent memory: the kinds of memory an agent keeps, where each one lives in Postgres, when the agent reads or writes it during a single turn, and when one Postgres stops being enough.