Liquid cooling technology will become the next trend in AI computing power
The Nvidia Summit GTC2024, highly anticipated by the global technology community, held from March 18th to 21st. According to authoritative media reports from various sources, Nvidia is expected to launch a stunning new B100 GPU based on the Blackwell architecture at this grand event. It is understood that the new generation B100 GPU has achieved a breakthrough upgrade in heat dissipation technology, replacing the previous air cooling scheme with an advanced liquid cooling system for efficient heat dissipation. Regarding this, NVIDIA CEO Huang Renxun believes that liquid cooling technology will become the next trend in AI computing power. As a leading enterprise in the global AI and computing markets, Nvidia's product strategy undoubtedly has a profound impact on the upstream and downstream of the industry chain. This comprehensive promotion of the innovation and transformation of graphics card cooling technology is bound to activate the iterative application of liquid cooling technology.
In liquid cooling technology, liquids can directly contact the heating components inside the server (direct liquid cooling) or indirectly contact through heat pipes, cold plates, etc. for heat dissipation (indirect liquid cooling) to achieve efficient heat conduction and dissipation. Compared with air cooling , liquids have a larger specific heat capacity and better thermal conductivity, which can more effectively absorb and take away a large amount of heat. Especially for high-performance computing and large-scale data centers, they can handle the heat dissipation needs of higher power density equipment. In addition, it can reduce the energy consumption of fans and other auxiliary cooling systems, thereby improving overall energy efficiency and noise. Liquid cooling design can save valuable data center space as it allows for higher device deployment density without adding additional heat dissipation burden.
In recent years, with the continuous maturity of technologies such as artificial intelligence, big data, cloud computing, and machine vision, the demand for high-performance computing has been increasing. With the improvement of computing power performance and density, data centers require a large number of IT equipment, power supply and cooling equipment to cope with server cooling. Its energy consumption and carbon emissions are severe, and traditional air-cooled cooling is no longer sustainable. Liquid cooling is considered a better solution to solve the heat dissipation pressure of servers. For many years, the IDC industry has been exploring the balance between cooling technology performance and cost-effectiveness. Nvidia's adoption of liquid cooling technology this time not only provides strong heat dissipation guarantee for H200 chips, but also demonstrates its determination and strength in heat dissipation technology innovation.
With the continuous maturity and innovation of liquid cooling technology, it is expected that significant progress will be made in enhancing the output density of data center computing power, optimizing PUE values, and reducing noise and environmental protection in the future. At the same time, the strong support of national policies and the rapid establishment of industry standards will further promote the prosperous development of the liquid cooling market.
