The Turning Point Of The Liquid Cooling Industry Is Approaching

   With the debut of NVIDIA B100 in GTC 2024, it has transitioned from air-cooled cooling to liquid cooling. As chip power continues to rise, liquid cooling has become the preferred choice. The maximum power of a single NVIDIA DGX A100 server is about 6.5KW. With the same rack up rate, the increase in server power leads to a continuous increase in the power of the single cabinet, approaching the cooling limit of 12-15KW with air cooling. Continuing to use air cooling will lead to a sharp increase in the demand for inter row air conditioning. In high-density cooling scenarios, liquid cooling solutions have significant cost and performance advantages, and may become the best choice.
   With the increasing demand for computing power in artificial intelligence, the bank believes that liquid cooling can better meet the heat dissipation needs of AIDC, and liquid cooling is expected to accelerate deployment in AIDC scenarios. With the increasingly strict requirements of PUE, the advantages of liquid cooling and heat dissipation are gradually becoming prominent. Whether it is the demand for IDC new construction or stock renovation, liquid cooling is expected to become the first choice.