distributed computing - Distributed Thoughts

Distributed Thoughts

Sign in Subscribe

distributed computing

A collection of 8 posts

The Inference Inversion

distributed computing

The Inference Inversion

For the past three years, the AI industry has operated under a simple assumption: more centralized compute solves everything. Bigger clusters. Bigger data centers. Bigger power contracts. The logic was intuitive and, for training workloads, largely correct. Training a frontier model requires tightly coupled GPU clusters with high-bandwidth interconnects, and

One Year of Liberation Day: What the Tariff Rollout Actually Revealed About AI Infrastructure

One Year of Liberation Day: What the Tariff Rollout Actually Revealed About AI Infrastructure

One year ago today, President Trump stood in the Rose Garden and imposed double-digit tariffs on virtually every product the United States imports. He called it "Liberation Day." Within weeks, tariff policy had changed more than 50 times. Rates spiked to 21.5%, fell, spiked again. The Supreme

The Time Value of Data

The Time Value of Data

Your data is rotting. Not metaphorically. Not in some hand-wavy "data quality matters" sense. Your data is losing measurable economic value with every hour it sits unprocessed, and the infrastructure you built to manage it has no concept of that loss. No depreciation schedule. No freshness SLOs. No

The Missing Part of the Pipeline

The Missing Part of the Pipeline

Imagine a customer support chatbot that confidently tells a user they have 365 days to return a product. The actual policy is 30 days. Every system metric is green: P95 latency at 142ms, throughput at 1.2k requests per second, eval accuracy at 94.2%, error rate at 0.02%

NVIDIA Just Showed You the $249 Future. Nobody Built the Layer That Makes It Work.

NVIDIA Just Showed You the $249 Future. Nobody Built the Layer That Makes It Work.

Well... not NOBODY :)

The Loop Is Only as Good as the Metric

The Loop Is Only as Good as the Metric

On Thursday I wrote about Karpathy's autoresearch, the 630-line training loop that runs 100 ML experiments overnight on a single GPU while you sleep. The post generated a lot of conversation, and most of it centered on the automation: agents doing research, models training themselves, the future of

The Model Is the Byproduct

The Model Is the Byproduct

Last Friday, Andrej Karpathy open-sourced a 630-line Python script and went to bed. By morning, an AI agent running on a single GPU had completed roughly 100 complete LLM training runs, each lasting exactly five minutes, autonomously modifying the neural network architecture, the optimizer, the hyperparameters, evaluating the results, keeping

Move 37

In March 2016, during the second game of a five-match series in Seoul, Google DeepMind's AlphaGo placed its 37th stone on the board against Lee Sedol, one of the greatest Go players in history. The commentators hesitated. A 9-dan professional imitating the move for the livestream audience fumbled,