InfiniCloud: Leveraging the Global InfiniCortex Fabric and OpenStack Cloud for Borderless High Performance Computing of Genomic Data

Kenneth Hon Kim Ban; Jakub Chrzeszczyk; Andrew Howard; Dongyang Li; Tin Wee Tan

doi:10.14529/jsfi150302

Authors

Kenneth Hon Kim Ban National University of Singapore, Singapore Institute of Molecular and Cell Biology, A*STAR, Singapore
Jakub Chrzeszczyk National Computational Infrastructure, The Australian National University, Canberra
Andrew Howard National Computational Infrastructure, The Australian National University, Canberra
Dongyang Li National Computational Infrastructure, The Australian National University, Canberra
Tin Wee Tan 1) National University of Singapore, Singapore 2) A*STAR Computational Resource Centre (A*CRC), A*STAR, Singapore

DOI:

https://doi.org/10.14529/jsfi150302

Abstract

At the Supercomputing Frontiers Conference in Singapore in 2015, A*CRC (Singapore) and NCI (Canberra, Australia) presented InfiniCloud, a geographically distributed, high performance InfiniBand HPC Cloud which aims to enable borderless processing of genomic data as part of the InfiniCortex project. This paper provides a high-level technical overview of the architecture of InfiniCloud and how it can be used for high performance computation of genomic data in geographically distant sites by encapsulation of workflows/applications in Virtual Machines (VM) coupled with on-the-fly configuration of clusters and high speed transfer of data via long range InfiniBand.

References

dsync+. http://www.obsidianresearch.com/products/software/dsync+/index.html.

ElastiCluster. https://github.com/gc3-uzh-ch/elasticluster.

Ganglia monitoring system. http://ganglia.sourceforge.net/.

IPython interactive computing. http://ipython.org/.

Open grid scheduler. http://gridscheduler.sourceforge.net/.

Openstack cloud computing platform. http://www.openstack.org.

Jakub Chrzeszczyk, Muhammad Atif, Joseph Antony, Dongyang Li, Matthew Sanderson, and Allan Williams. Perspectives on implementation of a high performance scientific cloud backed by a 56G high speed interconnect. HPC Advisory Council Event, Singapore, http://www.hpcadvisorycouncil.com/events/2014/singapore-workshop/preso/12_ANU.pdf, November 2014.

Lian J O’Meally D Deakin J Wang Z Zhang P Fujita M Patel HR Holleley CE Zhou Y Zhang X Matsubara K Waters P Graves JA Sarre SD Georges A, Li Q and Zhang G. High-coveragesequencing and annotated assembly of the genome of the Australian dragon lizard Pogona vitticeps. Gigascience, 4(45), Sep 2015. DOI: 10.1186/s13742-015-0085-2.

Marius Hillenbrand, Viktor Mauch, Jan Stoess, Konrad Miller, and Frank Bellosa. Virtual InfiniBand clusters for HPC clouds. In Proceedings of the 2nd International Workshop on Cloud Computing Platforms, page 9. ACM, 2012. DOI: 10.1145/2168697.2168706.

Andrew Howard. NCI InfiniCloud: Expanding clouds with high speed InfiniBand interconnects. http://www-lk.apan.net/meetings/Fukuoka2015/Sessions/22/NCI_Howard_InfiniCloud_APAN_Fukuoka_TAN.pdf.

Wei Huang, Jiuxing Liu, Bulent Abali, and Dhabaleswar K Panda. A case for high performance computing with virtual machines. In Proceedings of the 20th annual international conference on Supercomputing, pages 125–134. ACM, 2006. DOI: 10.1145/1183401.1183421.

Jithin Jose, Mingzhe Li, Xiaoyi Lu, Krishna Chaitanya Kandalla, Mark Daniel Arnold, and Dhabaleswar K Panda. SR-IOV support for virtualization on infiniband clusters: Early experience. In Cluster, Cloud and Grid Computing (CCGrid), 2013 13th IEEE/ACM International Symposium on, pages 385–392. IEEE, 2013. DOI: 10.1109/ccgrid.2013.76.

E. R. Mardis. A decade’s perspective on DNA sequencing technology. Nature, 470(7333):198–203, Feb 2011. DOI: 10.1038/nature09796.

Tin Wee Tan, Dominic S.H. Chien, Yuefan Deng, Seng Lim, Sing-Wu Liou, Jonathan Low, Marek Michalewicz, Gabriel Noaje, Yves Poppe, and Geok Lian Tan. InfiniCortex: A path to reach Exascale concurrent supercomputing across the globe utilising trans-continental InfiniBand and Galaxy of Supercomputers. Submitted to Supercomputing Frontiers 2015 conference proceedings, Singapore.