ai-infrastructure - Distributed Thoughts

Distributed Thoughts

Sign in Subscribe

ai-infrastructure

A collection of 4 posts

Your 2026 Resolution: Add Context to Your Data (Before It Breaks You)

data-engineering

Your 2026 Resolution: Add Context to Your Data (Before It Breaks You)

Last week I sat in an executive review where two teams spent forty minutes arguing about "active users." Not about strategy. Not about growth. About what the number meant. One team counted anyone who logged in. The other excluded users who bounced in under 30 seconds. Neither knew

A Picture Is Worth Ten Thousand Tokens

ai-infrastructure

A Picture Is Worth Ten Thousand Tokens

DeepSeek's new OCR model achieves 97% accuracy while using one-tenth the tokens by rendering text as images. The computationally "heavy" modality turns out to be the efficient one, which should make us question some basic assumptions about how we architect these systems.

NVIDIA Bought the Bouncer: SchedMD and Where Lock-In Actually Lives

ai-infrastructure

NVIDIA Bought the Bouncer: SchedMD and Where Lock-In Actually Lives

On December 15, 2025, NVIDIA acquired SchedMD, a 40-person company based in Lehi, Utah. The price wasn't disclosed, the press release emphasized a commitment to open source, and most coverage focused on NVIDIA’s expanding software portfolio, thereby missing the point entirely. Most folks missed how huge this

NVIDIA Built the Most Powerful Chips Ever. Google Trained the World's Best AI Without Them.

ai-infrastructure

NVIDIA Built the Most Powerful Chips Ever. Google Trained the World's Best AI Without Them.

In 2020, NVIDIA released the A100 with 54 billion transistors, 80GB of memory, and 2 TB/s bandwidth. It was VERY BIG and VERY FAST(tm). In 2022, the H100 arrived with 80 billion transistors, the first Transformer Engine optimized for the neural network architecture behind ChatGPT, and performance gains