At today’s GTC conference keynote, Nvidia announced that its H100 Tensor Core GPU is in full production and that tech partners such as Dell, Lenovo, Cisco, Atos, Fujitsu, GIGABYTE, Hewlett-Packard Enterprise, and Supermicro will begin shipping products built around the H100 next month.
The H100, part of the “Hopper” architecture, is the most powerful AI-focused GPU Nvidia has ever made, surpassing its previous high-end chip, the A100. The H100 includes 80 billion transistors and a special “Transformer Engine” to accelerate machine learning tasks. It also supports Nvidia NVLink, which links GPUs together to multiply performance.
According to the Nvidia press release, the H100 also reportedly delivers efficiency benefits, offering the same performance as the A100 with 3.5 times better energy efficiency, 3 times lower cost of ownership, using 5 times fewer server nodes.
Nvidia expects the H100 chip to be used in a variety of industrial, health care, supercomputer, and cloud applications ranging from large language models, drug discovery, recommender systems, conversational AI, and more. Going by the track record of the earlier A100 “Ampere” architecture GPU, analysts believe the H100 chip will likely have a big impact in the AI space. It will also very likely play a role in the next generation of image synthesis models.
Nvidia announced that over 50 H100-based server models from different companies will be on the market by the end of the year. And Nvidia itself will begin integrating the H100 into its Nvidia DGX H100 enterprise systems, which pack eight H100 chips and deliver 32 petaflops of performance.
News that H100 is in full production and shipping soon may be seen as a relief to Nvidia investors. The firm’s stock had dropped in early September after it announced that the US government was placing restrictions on exports of the H100 to China, which was also where the chip was being partially developed and is being manufactured. The US allowed H100 development to resume, but the export restrictions to China and Russia are still in place.