Industry News | Upgraded cooling technology for the most powerful AI chip
2024.03.31

Recently, NVIDIA announced that it will be releasing its new Blackwell architecture B100 GPU at the upcoming GTC2024 conference.According to internal sources, the B100 achieves a significant increase in overall performance, compared to the current H-series. This GPU not only enhances HBM memory capacity and AI performance, but also introduces an innovative liquid-cooled cooling technology, replacing the previous air-cooled cooling solution. NVIDIA CEO Jen-Hsun Huang believes that immersion liquid cooling technology will become a future trend and is expected to lead the entire cooling market to revolutionise. Therefore, starting with the B100, all of NVIDIA's future products will adopt liquid cooling technology. This major technological innovation has had a profound impact on the AI server market.


NVIDIA's B100 liquid cooling project is provided by foundry Inventec. Inventec said that the AI server market will still be dominated by NVIDIA products this year, and it is expected that the B100 product will be officially mass-produced in the fourth quarter. In addition, with the popularity of high-performance applications, there is a gradual increase in the number of chips with very high heat dissipation needs, which makes liquid cooling technology an important future development of the server temperature control industry


Wall Street analyst Hans Mosesmann believes that liquid-cooling technology is the key to overcoming computing challenges, helping to pave the way for ultra-large-scale cloud services. He raised his price target on Ultra Micro Computer from $700 to $1,300 and maintains a Buy rating. This is due to Ultra Micro Computer's use of liquid-cooled server technology, which effectively cools down high-speed AI computers. This shows that the application of liquid-cooling technology in the field of AI servers is promising, or will become a major highlight of future market competition.



In short, the launch of NVIDIA's new B100 GPU marks the widespread application of liquid cooling technology in the field of AI servers. With major manufacturers following suit, liquid cooling technology is expected to lead the cooling market innovation and bring broader development space for the AI server industry. In this technological change, the vendors that take the lead in adopting liquid cooling technology will dominate the market and further promote the development of the AI server market.