In 2008 IBM reintroduced water cooling technology into its high performance computing platform, the Power 575 Supercomputing node/system. Water cooled cold plates were used to cool the processor modules which represented about half of the total system (rack) heat load. An air-to-liquid heat exchanger was also mounted in the rear door of the rack to remove a significant fraction of the other half of the rack heat load: the heat load to air. The next generation of this platform, the Power 775 Supercomputing node/system, is a monumental leap forward in computing performance and energy efficiency. The computer node and system were designed from the start with water cooling in mind. The result, a system with greater than 96% of its heat load conducted directly to water, is a system that, together with a rear door heat exchanger, removes 100% of its heat load to water with no requirement for room air conditioning. In addition to the processor, the memory, power conversion, and I/O electronics conduct their heat to water. Included within the framework of the system is a disk storage unit (disc enclosure) containing an interboard air-to-water heat exchanger. This paper will give an overview of the water cooling system featuring the water conditioning unit and rack manifolds. Advances in technology over this system’s predecessor will be highlighted. An overview of the cooling assemblies within the server drawer (i.e., central electronics complex,) the disc enclosure, and the centralized (bulk) power conversion system will also be given. Furthermore, techniques to enhance performance and energy efficiency will also be described.

References

References
1.
Ellsworth
, Jr.,
M. J.
,
Campbell
,
L. A.
,
Simons
,
R. E.
,
Iyengar
,
M. K.
,
Schmidt
,
R. R.
, and
Chu
,
R. C.
, 2008, “
The Evolution of Water Cooling for IBM Large Server Systems: Back to the Future
,”
Proceedings of the 2008 ITherm Conference
, Orlando, FL, USA, May 28–31.
2.
Simons
,
R. E.
, 1995, “
The Evolution of IBM High Performance Cooling Technology
,”
Proceedings of the Eleventh Annual IEEE Semiconductor Thermal Measurement and Management Symposium
, pp.
102
112
.
3.
Bar-Cohen
,
A.
, 1987, “
Thermal Management of Air- and Liquid Cooled Multi-Chip Modules
,”
IEEE Trans. Compon., Hybrids Manuf. Technol.
,
10
(
2
), pp.
159
175
.
4.
Kaneko
,
K.
,
Seyama
,
K.
, and
Suzuki
,
M.
, 1990, “
LSI Packaging and Cooling Technologies for Fujitsu VP2000 Series
,”
Fujitsu Sci. Technol. J.
,
41
(
1
), pp.
12
19
.
5.
Kaneko
,
K.
,
Kuwabara
,
K.
,
Kikuchi
,
S.
, and
Kano
,
T.
, 1991, “
Hardware Technology for Fujitsu VP2000 Series
,”
Fujitsu Sci. Technol. J.
,
37
(
2
), pp.
158
168
.
6.
Kobayashi
,
F.
,
Watanabe
,
Y.
,
Yamamoto
,
M.
,
Anzai
,
A.
,
Takahashi
,
A.
,
Daikoku
,
T.
, and
Fujita
,
T.
, 1991, “
Hardware Technology for Hitachi M-880 Processor Group
,”
Proceedings of the 41st Electronic Components and Technology Conference
, pp.
693
703
.
7.
Watari
,
T.
, and
Murano
,
H.
, 1985, “
Packaging Technology for the NEC SX Supercomputer
,”
IEEE Trans. Compon., Hybrids Manuf. Technol.
,
8
(
4
), pp.
462
467
.
8.
Murano
,
H.
, and
Watari
,
T.
, 1992, “
Packaging Technology for the NEC SX-3 Supercomputers
,”
IEEE Trans. Compon., Hybrids Manuf. Technol.
,
15
(
4
), pp.
411
417
.
9.
Campbell
,
L. A.
,
Ellsworth
, Jr.,
M. J.
, and
Sinha
,
A.
, 2009, “
Analysis and Design of the IBM Power 575 Supercomputing Node Cold Plate Assembly
,”
Proceedings of the 2009 InterPACK conference
, San Francisco, CA, USA, July 19–23.
10.
Ellsworth
, Jr.,
M. J.
, 2009, “
Energy Efficiency Analyses and Comparison of Air and Water Cooled High Performance Servers
,”
Proceedings of the 2009 InterPACK Conference
, San Francisco, CA, July 19–23.
11.
Morgan
,
T. M.
, “
IBM Shows Off Power7 HPC Monster
,” The Register, November 27, 2009 (http://www.theregister.co.uk/2009/11/27/ibm_power7_hpc_server/).
12.
CBR Staff Reporter, “
IBM Finishes Building ASCI Purple Super for DOE
,” Computer Business Review, July 24, 2005, http://www.cbronline.com/news/ibm_finishes_building_asci_purple_super_for_doe.
13.
ANSYS CFX is a product of ANSYS, Inc. headquartered at 275 Technology Drive, Canonsburg, PA 15317 (http://www.ansys.com).
You do not currently have access to this content.