โ† Reading Library / ๐Ÿš€ Science & Technology / ๐Ÿ’ก Great Inventions That Changed the World / Neural Network AI Chip (GPU/TPU)
Expand Grade: G1 Early Reader G2 Developing G3 Fluent G4 Expanding G5 Advanced
๐Ÿ’ก INVENTIONS โš™๏ธ 1999โ€“2015 CE โ€ข Massively Parallel Silicon Architecture VA Science, Engineering & History SOL

Neural Network AI Chip (GPU/TPU)

Thousands of Tiny Cores Thinking Together

Grade 3 โ€ข Fluent โ€ข 145 words
๐Ÿง‘โ€๐Ÿ”ฌ Inventor & Origin Nvidia GPU Pioneers (1999/2006) & Google TPU Team led by Norm Jouppi (2015)
โณ Year Invented 1999 Programmable GPU; 2012 Deep Learning Spark; 2015 Custom TPU
โš™๏ธ How It Works Thousands of tiny math units multiply giant grids of numbers at the exact same instant
โšก World-Changing Spark Solves quadrillions of math steps every second to power AI vision, translation, and science
Neural Network AI Chip (GPU/TPU) (1999โ€“2015 CE โ€ข Massively Parallel Silicon Architecture)
๐Ÿคฏ Mind-Blowing Fact โ€ข Grade 3

The word 'systolic' in a TPU's systolic array comes from the medical word for your heart's rhythmic pumping beatโ€”because data pulses step by step across thousands of math cells in lockstep!

โœจ Word Sparks (Grade 3 Glossary) Tap ๐Ÿ”Š to hear
matrix
Rectangular grid of numbers arranged in rows
systolic array
Grid pulsing data rhythmically between math units
transistor
Microscopic electronic switch etched onto silicon
๐Ÿช

What do lighting a 3D dragon's scales in a video game and teaching an AI to recognize puppies have in common?

1 Surprise! It's All Grid Math

Zoom in on a 3D video game character spinning on screen: to figure out where every point moves and how light bounces off every triangle, the chip multiplies huge tables of numbers called matrices. Amazingly, artificial neural networks learn by multiplying giant number tables, too!

2 The 2012 Deep Learning Spark

After Nvidia launched programmable GPUs in 1999 and opened them to science code with CUDA in 2006, three researchers trained a neural network named AlexNet on two bedroom gaming GPUs in 2012. AlexNet crushed world image-recognition records overnight!

3 Heartbeat Grids Inside TPUs

Moving numbers back and forth to memory wastes energy. So in 2015, architect Norm Jouppi's team built Google's Tensor Processing Unit around a ''โ€”a square grid that pumps numbers rhythmically from neighbor to neighbor like blood from a beating heart!

4 Powering Science Discovery

Linked by ultra-fast optical fibers in supercomputers, modern AI accelerators forecast hurricanes days earlier, map galaxies, and predict 3D shapes of life-saving medicine molecules.

๐Ÿง โšก Brain Sparks โ€ข Quick Curiosity Check ๐ŸŒŸ 0 / 2 Sparks Lit

1. Why did 3D video-game GPUs turn out to be ideal for training neural networks in 2012?

2. Why is the grid inside a TPU called a 'systolic' array?

๐ŸŒฟ๐Ÿพ Explore More 1-Page Curiosity Sparks: ๐Ÿ’ก Printing Press ๐Ÿ’ก Compass ๐Ÿ’ก Papermaking ๐Ÿ’ก Mechanical Clock ๐Ÿ’ก Eyeglasses ๐Ÿ’ก Microscope ๐Ÿ’ก Refracting Telescope ๐Ÿ’ก Reflecting Telescope ๐Ÿ’ก Mercury Thermometer ๐Ÿ’ก Barometer ๐Ÿ’ก Steam Engine ๐Ÿ’ก Spinning Jenny ๐Ÿฆ… Bald Eagle ๐Ÿ”ฌ Albert Einstein ๐ŸฅŠ Muhammad Ali โšฝ Lionel Messi โšฝ Pelรฉ ๐Ÿ›๏ธ Socrates