A closed-cycle gasoline compression ignition engine simulation near top dead center (TDC) was used to profile the performance of a parallel commercial engine computational fluid dynamics code, as it was scaled on up to 4096 cores of an IBM Blue Gene/Q supercomputer. The test case has 9 million cells near TDC, with a fixed mesh size of 0.15 mm, and was run on configurations ranging from 128 to 4096 cores. Profiling was done for a small duration of 0.11 crank angle degrees near TDC during ignition. Optimization of input/output performance resulted in a significant speedup in reading restart files, and in an over 100-times speedup in writing restart files and files for post-processing. Improvements to communication resulted in a 1400-times speedup in the mesh load balancing operation during initialization, on 4096 cores. An improved, “stiffness-based” algorithm for load balancing chemical kinetics calculations was developed, which results in an over 3-times faster run-time near ignition on 4096 cores relative to the original load balancing scheme. With this improvement to load balancing, the code achieves over 78% scaling efficiency on 2048 cores, and over 65% scaling efficiency on 4096 cores, relative to 256 cores.
Skip Nav Destination
ASME 2015 Internal Combustion Engine Division Fall Technical Conference
November 8–11, 2015
Houston, Texas, USA
Conference Sponsors:
- Internal Combustion Engine Division
ISBN:
978-0-7918-5728-1
PROCEEDINGS PAPER
Development of a Stiffness-Based Chemistry Load Balancing Scheme, and Optimization of I/O and Communication, to Enable Massively Parallel High-Fidelity Internal Combustion Engine Simulations
Janardhan Kodavasal,
Janardhan Kodavasal
Argonne National Laboratory, Argonne, IL
Search for other works by this author on:
Kevin Harms,
Kevin Harms
Argonne National Laboratory, Argonne, IL
Search for other works by this author on:
Priyesh Srivastava,
Priyesh Srivastava
Convergent Science, Inc., Madison, WI
Search for other works by this author on:
Sibendu Som,
Sibendu Som
Argonne National Laboratory, Argonne, IL
Search for other works by this author on:
Shaoping Quan,
Shaoping Quan
Convergent Science, Inc., Madison, WI
Search for other works by this author on:
Keith Richards,
Keith Richards
Convergent Science, Inc., Madison, WI
Search for other works by this author on:
Marta García
Marta García
Argonne National Laboratory, Argonne, IL
Search for other works by this author on:
Janardhan Kodavasal
Argonne National Laboratory, Argonne, IL
Kevin Harms
Argonne National Laboratory, Argonne, IL
Priyesh Srivastava
Convergent Science, Inc., Madison, WI
Sibendu Som
Argonne National Laboratory, Argonne, IL
Shaoping Quan
Convergent Science, Inc., Madison, WI
Keith Richards
Convergent Science, Inc., Madison, WI
Marta García
Argonne National Laboratory, Argonne, IL
Paper No:
ICEF2015-1035, V002T06A009; 14 pages
Published Online:
January 12, 2016
Citation
Kodavasal, J, Harms, K, Srivastava, P, Som, S, Quan, S, Richards, K, & García, M. "Development of a Stiffness-Based Chemistry Load Balancing Scheme, and Optimization of I/O and Communication, to Enable Massively Parallel High-Fidelity Internal Combustion Engine Simulations." Proceedings of the ASME 2015 Internal Combustion Engine Division Fall Technical Conference. Volume 2: Emissions Control Systems; Instrumentation, Controls, and Hybrids; Numerical Simulation; Engine Design and Mechanical Development. Houston, Texas, USA. November 8–11, 2015. V002T06A009. ASME. https://doi.org/10.1115/ICEF2015-1035
Download citation file:
14
Views
Related Proceedings Papers
Related Articles
Steady-State Calibration of a Diesel Engine in Computational Fluid Dynamics Using a Graphical Processing Unit-Based Chemistry Solver
J. Eng. Gas Turbines Power (October,2018)
Development of a Semi-implicit Solver for Detailed Chemistry in Internal Combustion Engine Simulations
J. Eng. Gas Turbines Power (January,2007)
Comparisons of Diesel PCCI Combustion Simulations Using a Representative Interactive Flamelet Model and Direct Integration of CFD With Detailed Chemistry
J. Eng. Gas Turbines Power (January,2007)
Related Chapters
Outlook
Closed-Cycle Gas Turbines: Operating Experience and Future Potential
Physiology of Human Power Generation
Design of Human Powered Vehicles
Lay-Up and Start-Up Practices
Consensus on Operating Practices for Control of Water and Steam Chemistry in Combined Cycle and Cogeneration