InfiniCloud 2.0: distributing High Performance Computing across continents.

Authors

  • Jakub Chrzeszczyk The Australian National University, Canberra
  • Andrew Howard The Australian National University, Canberra
  • Andrzej Chrzeszczyk Jan Kochanowski University, Kielce
  • Ben Swift The Australian National University, Canberra
  • Peter Davis The Australian National University, Canberra
  • Jonathan Low A*STAR Computational Resource Centre, Singapore
  • Tin Wee Tan National Supercomputing Centre, Singapore
  • Kenneth Ban Yong Loo Lin School of Medicine, Singapore National University of Singapore, Singapore

DOI:

https://doi.org/10.14529/jsfi160204

Abstract

InfiniCloud 2.0 is World’s first native InfiniBand High Performance Cloud distributed across four continents, spanning Asia, Australia, Europe and North America. The project provides researchers with instant access to computational, storage and network resources distributed around the globe. These resources are then used to build a geographically distributed, virtual supercomputer, complete with globally-accessible parallel file system and job scheduling.This paper describes high level design and the implementation details of InfiniCloud 2.0. A gene sequencing pipeline as well as plasma physics simulation code are used to demonstrate system’s capabilities.

References

Marek Michalewicz, David Southwell, Tin Wee Tan, Andrew Howard. InfiniCortex: concurrent supercomputing across the globe utilising trans-continental InfiniBand and Galaxy of Supercomputers. Supercomputing 2014: The International Conference for High Performance Computing, Networking, Storage and Analysis, New Orleans, USA

Gabriel Noaje, Marek Michalewicz. Around The Globe Towards Exascale: InfiniCortex Past and Present.

Kenneth Ban, Tin Wee Tan, Jakub Chrzeszczyk, Andrew Howard, and Dongyang Li. InfiniCloud: Leveraging Global InfiniCortex Fabric and OpenStack Cloud for Borderless High Performance Computing of Genomic Data and Beyond. Supercomputing Frontiers and Innovations 2015, Vol 2, No 3, Singapore.

Jonathan Low, Jakub Chrzeszczyk, Andrew Howard, Andrzej Chrzeszczyk. Performance Assessment of Infiniband HPC Cloud Instances on Intel Haswell and Intel Sandy Bridge Architectures. Supercomputing Frontiers and Innovations 2015, Vol 2, No 3, Singapore.

Marius Hillenbrand, Viktor Mauch, Jan Stoess, Konrad Miller, and Frank Bellosa. Virtual InfiniBand clusters for HPC clouds. In Proceedings of the 2nd International Workshop on Cloud Computing Platforms, page 9. ACM, 2012.

Jerome Vienne, Md Wasi-ur- Rahman, Nusrat Sharmin Islam, Hari Subramoni, D.K. Panda. Performance Analysis and Evaluation of InfiniBand FDR and 40GigE RoCE on HPC and Cloud Computing Systems. Conference: IEEE Hot Interconnects (HOTI-2012).

http://www.openstack.org/

https://github.com/gc3-uzh-ch/elasticluster

http://extempore.moso.com.au/

https://forge.puppet.com/puppetlabs/openstack

http://www.beegfs.com/

Downloads

Published

2016-09-19

How to Cite

Chrzeszczyk, J., Howard, A., Chrzeszczyk, A., Swift, B., Davis, P., Low, J., Tan, T. W., & Ban, K. (2016). InfiniCloud 2.0: distributing High Performance Computing across continents. Supercomputing Frontiers and Innovations, 3(2), 54–71. https://doi.org/10.14529/jsfi160204

Issue

Vol. 3 No. 2 (2016)

License

Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-Non Commercial 3.0 License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.

Most read articles by the same author(s)