Google's AI Chip TPU v5p is 2.8 Times Faster in Training LLMs than its Predecessor

Google has unveiled the TPU v5p, which is 2.8 times faster than its predecessor, challenging NVIDIA's market leadership. The TPU v5p is Google's most powerful custom-designed AI accelerator, featuring 8,960 chips per unit, more than the 4,096 chips in the v4. It is claimed that the TPU v5p is four times faster than NVIDIA's A100 GPU and 3.4 to 4.8 times faster in training workloads. The TPU v5p is on par with the H100 GPU and is one of the best graphics cards on the market for AI workloads.