Designed for Data Center Scale Reduction in TCO and Enabling Large AI Clusters to Perform with a Lower Energy Budget, Liquid Cooling Solution Handles the Highest Wattage Servers Containing the Latest GPUs and CPUs, Resulting in Lower Costs for AI Factories – Over 2,000 Liquid Cooled Racks Delivered Since June 2024
SAN JOSE, Calif., Oct. 7, 2024 /PRNewswire/ -- Supermicro, Inc. (NASDAQ: SMCI), a Total IT Solution Provider for Cloud, AI/ML, Storage, and 5G/Edge, is announcing a complete liquid cooling solution that includes powerful Coolant Distribution Units (CDUs), cold plates, Coolant Distribution Manifolds (CDMs), cooling towers and end to end management software. This complete solution reduces ongoing power costs and Day 0 hardware acquisition and data center cooling infrastructure costs. The entire end-to-end data center scale liquid cooling solution is available directly from Supermicro.
"Supermicro continues to innovate, delivering full data center plug-and-play rack scale liquid cooling solutions," said Charles Liang, CEO and president of Supermicro. "Our complete liquid cooling solutions, including SuperCloud Composer for the entire life-cycle management of all components, are now cooling massive, state-of-the-art AI factories, reducing costs and improving performance. The combination of Supermicro deployment experience and delivering innovative technology is resulting in data center operators coming to Supermicro to meet their technical and financial goals for both the construction of greenfield sites and the modernization of existing data centers. Since Supermicro supplies all the components, the time to deployment and online are measured in weeks, not months."
Many organizations require the highest-performing GPUs and CPUs to remain competitive and need these servers to run constantly. Supermicro's ultra-dense server with dual top-bin CPUs and 8 NVIDIA HGX GPUs in just 4U with liquid cooling is the ultimate AI server needed in AI factories. When installed in a rack, this server quadruples the computing density, allowing organizations to run larger training models with a smaller data center footprint.
Supermicro recently deployed more than 100,000 GPUs with liquid cooling solution (DLC) for some of the largest AI factories ever built, as well as other CSPs. With each server approaching 12kW of power needed for AI and HPC workloads, liquid cooling is a more efficient choice to maintain the desired operating temperature for each GPU and CPU. A single AI rack now generates over 100kW of heat, which needs to be efficiently removed from the data center. Datacenter-scale liquid cooling significantly reduces the power demand for a given cluster size. Up to 40% power reduction allows you to deploy more AI servers in a fixed power envelope to increase computing power and decrease LLM time to train, which are critical for these large CSPs and AI factories.
The entire liquid cooling solution directly from Supermicro includes:
Optimally designed cold plates that allow liquid to flow through microchannels with a maximum surface area that dissipates up to 1600W for next-generation GPUs.
Specifically designed CDM (horizontal and vertical) to enable the highest GPU per rack density with up to 96 NVIDIA B200 GPUs per rack.
State-of-the-art rack-CDU solutions with increased cooling capacity of 250kW and hot swappable pumps and power supplies to avoid any downtime
Modular cooling towers tailored to cool DLC Racks with the latest energy efficient EC fan technology are ready to ship and deploy in days, enabling a faster Time-to-Online (TTO).
SuperCloud Composer life cycle management software monitors the systems, SW, CDUs, racks, and cooling towers, optimizing the operational cost and managing the integrity of liquid-cooled data centers.
Direct Liquid Cooling delivers several advantages over air cooling, including:
Up to 40% energy savings for infrastructure and 80% space savings, eliminating the need for traditional CRAC/CRAH units
Support for warm water cooling up to 113°F (45°C) and allow for the reuse of heat generated by AI systems for applications such as district heating and greenhouses.
Supermicro's leadership in Direct Liquid Cooling (DLC) technology is revolutionizing data center infrastructure towards Green Computing. From winning top industry awards to setting new efficiency benchmarks with a PUE of less than 1.1, Supermicro DLC solutions are leading in innovation and sustainability. By integrating DLC with modular cooling towers and SuperCloud Composer management software, Supermicro provides an end-to-end, complete data center scale total solution empowering CSPs and enterprise customers to achieve more with less while achieving higher operational efficiency, lower environmental impacts and much quicker TTO.
About Super Micro Computer, Inc.
Supermicro (NASDAQ: SMCI) is a global leader in Application-Optimized Total IT Solutions. Founded and operating in San Jose, California, Supermicro is committed to delivering first to market innovation for Enterprise, Cloud, AI, and 5G Telco/Edge IT Infrastructure. We are a Total IT Solutions provider with server, AI, storage, IoT, switch systems, software, and support services. Supermicro's motherboard, power, and chassis design expertise further enable our development and production, enabling next generation innovation from cloud to edge for our global customers. Our products are designed and manufactured in-house (in the US, Taiwan, and the Netherlands), leveraging global operations for scale and efficiency and optimized to improve TCO and reduce environmental impact (Green Computing). The award-winning portfolio of Server Building Block Solutions? allows customers to optimize for their exact workload and application by selecting from a broad family of systems built from our flexible and reusable building blocks that support a comprehensive set of form factors, processors, memory, GPUs, storage, networking, power, and cooling solutions (air-conditioned, free air cooling or liquid cooling).
Supermicro, Server Building Block Solutions, and We Keep IT Green are trademarks and/or registered trademarks of Super Micro Computer, Inc.
All other brands, names, and trademarks are the property of their respective owners.
