NVIDIA - Distributed Thoughts

Distributed Thoughts

Sign in Subscribe

NVIDIA

A collection of 3 posts

NVIDIA Just Showed You the $249 Future. Nobody Built the Layer That Makes It Work.

NVIDIA Just Showed You the $249 Future. Nobody Built the Layer That Makes It Work.

Well... not NOBODY :)

Six Million Cell Towers Walk Into a Data Center

Six Million Cell Towers Walk Into a Data Center

At MWC Barcelona, NVIDIA and a 130-company coalition just announced plans to turn the global telecom network into a distributed AI compute grid. Cell towers running AI inference alongside 5G traffic. The industry is spending $700 billion building new centralized data centers while ignoring the large

NVIDIA Built the Most Powerful Chips Ever. Google Trained the World's Best AI Without Them.

ai-infrastructure

NVIDIA Built the Most Powerful Chips Ever. Google Trained the World's Best AI Without Them.

In 2020, NVIDIA released the A100 with 54 billion transistors, 80GB of memory, and 2 TB/s bandwidth. It was VERY BIG and VERY FAST(tm). In 2022, the H100 arrived with 80 billion transistors, the first Transformer Engine optimized for the neural network architecture behind ChatGPT, and performance gains