In Situ Visualization and Production of Extract Databases
DOI:
https://doi.org/10.14529/jsfi160402Abstract
Simulations running at high concurrency on HPC systems generate large volumes of data that are impractical to write to disk due to time and storage constraints. Applications often adapt by saving data infrequently, resulting in datasets with poor temporal resolution. This can make datasets difficult to interpret during post hoc visualization and analysis, or worse, it can lead to lost science. In Situ visualization and analysis can enable efficient production of small data products such as rendered images or surface extracts that consist of polygonal geometry plus fields. These data products are far smaller than their source data and can be processed much more economically in a traditional post hoc workflow using far fewer computational resources. We used the SENSEI and Libsim in situ infrastructures to implement rendering workflow and surface data extraction workflows in the AVF-LESLIE combustion code. These workflows were then demonstrated at high levels of concurrency and showed significant data reductions and limited impact on the simulation runtime.
References
ParaView Web Site, http://www.paraview.org, June 2010.
FieldView 16, http://www.ilight.com, September 2016.
James Ahrens, S ́ebastien Jourdain, Patrick O’Leary, John Patchett, David H. Rogers, and Mark Petersen. An image-based approach to extreme scale in situ visualization and analysis. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, SC ’14, pages 424–434, Piscataway, NJ, USA, 2014. IEEE Press.
Utkarsh Ayachit, Andrew Bauer, Earl P. N. Duque, Greg Eisenhauer, Nicola Ferrier, Junmin Gu, Kenneth Jansen, Burlen Loring, Zarija Luki ́c, Suresh Menon, Dmitriy Morozov, Patrick O’Leary, Michel Rasquin, Christopher P. Stone, Venkat Vishwanath, Gunther H. Weber, Brad J. Whitlock, Matthew Wolf, K. John Wu, and E. Wes Bethel. Performance Analysis, Design Considerations, and Applications of Extreme-scale In Situ Infrastructures. In Proceedings of SC16, Salt Lake City, UT, USA, November 2016. To appear.
Andrew C. Bauer, Berk Geveci, and Will Schroeder. The ParaView Catalyst User’s Guide v2.0. Kitware, Inc., 2015.
Henry R. Childs, E. Brugger, Brad J. Whitlock, Jeremy S. Meredith, Sean Ahern, Kathleen Biagas, Mark C. Miller, Gunther H. Weber, Cyrus Harrison, David Pugmire, Thomas Fogal, Christophe Garth, Allen Sanderson, E. Wes Bethel, Marc Durant, David Camp, Jean M. Favre, Oliver Rubel, and Paul Navratil. Visit: An end-user tool for visualizing and analyzing very large data. In High Performance Visualization: Enabling Extreme-Scale Scientific Insight, pages 357–368. Chapman and Hall, 2012.
Earl P. N. Duque, Brad J. Whitlock, Steve M. Legensky, Christopher P. Stone, Reetesh Ranjan, and Suresh Menon. The impact of in situ data processing and analytics upon scaling of cfd solvers and workflows. In 27th International Conference on Parallel Computational Fluid Dynamics, Montreal, Canada, 2015.
Qing Liu, Jeremy Logan, Yuan Tian, Hasan Abbasi, Norbert Podhorszki, Jong Youl Choi, Scott Klasky, Roselyne Tchoua, Jay Lofstead, Ron Oldfield, et al. Hello adios: the challenges and lessons of developing leadership class i/o frameworks. Concurrency and Computation: Practice and Experience, 26(7):1453–1473, 2014.
Ralph W Metcalfe, Steven A Orszag, Marc E Brachet, Suresh Menon, and James J Riley. Secondary instability of a temporally growing mixing layer. Journal of Fluid Mechanics, 184:207–243, 1987.
Will Schroeder, Ken Martin, and Bill Lorensen. The Visualization Toolkit: An Object Oriented Approach to 3D Graphics. Kitware, Inc., fourth edition, 2004. ISBN 1-930934-19-X.
Thomas M. Smith and Suresh Menon. The structure of premixed flame in a spatially evolving turbulent flow. Combustion Science and Technology, 119, 1996.
Christopher P. Stone and Suresh Menon. Open loop control of combustion instabilities in a model gas turbine combustor. Journal of Turbulence, 4, 2003.
Brad J. Whitlock, Jean M. Favre, and Jeremy S. Meredith. Parallel in situ coupling of simulation with a fully featured visualization system. In Proceedings of the 11th Eurographics conference on Parallel Graphics and Visualization, pages 101–109. Eurographics Association, 2011.
Brad J. Whitlock, James R. Forsythe, and Steve M. Legensky. In Situ Infrastructure Enhancements for Data Extract Generation. In 54th AIAA Aerospace Sciences Meeting, SciTech 2016, pages 1–12, January 2016.
Downloads
Published
How to Cite
Issue
License
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-Non Commercial 3.0 License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.