HCA aware Parallel Communication Library: A feasibility study for offloading MPI requirements

Authors

  • Kedar Kulkarni Centre for Development of Advanced Computing (C-DAC), Bangalore
  • Shreeya Badhe Centre for Development of Advanced Computing (C-DAC), Bangalore
  • Geetanjali Gadre Centre for Development of Advanced Computing (C-DAC), Bangalore

DOI:

https://doi.org/10.14529/jsfi160306

Abstract

Message Passing Interface (MPI) is a standardized message passing system, independent of underlying network, and the most widely used parallel programming paradigm. The communication library should make full use of the Host Channel Adapter (HCA) characteristics to maximize performance of the HPC cluster. The communication library may not able to take full advantage of the underlying network adapter, if the library is made generalized. This can have a significant impact on the performance.
Our primary goal is to develop a network dependent message passing library called a Parallel Communication Library (PCL) that will exploit C-DAC's proprietary PARAMNet HCA features for efficient message transfer. Using PCL, we intend to observe the feasibility of the network and performance enhancement for additional features. The objective is to carry out different trials by implementing additional features and analyze the implications which would give us more insight towards suitability of transport offload/onload mechanism. This experimentation would give us feedbacks for designing the next generation architecture.

References

C-DAC, PARAMNet-3 Network Interface Card (NIC) based on Gemini Co-processor. http://www.cdac.in/index.aspx?id=hpc_ss_nic

OpenFabrics Enterprise Distribution (OFED) Software Overview. https://openfabrics.org/index.php/openfabrics-software.html

Message Passing Interface (MPI) Standards. https://www.mpi-forum.org/. Last accessed: 2016-07.

PCI Express Specifications. https://pcisig.com/specifications.

OpenFabrics Interfaces Working Group (OFIWG). https://www.openfabrics.org/index.php/working-groups-overview.html/

Downloads

Published

2016-11-03

How to Cite

Kulkarni, K., Badhe, S., & Gadre, G. (2016). HCA aware Parallel Communication Library: A feasibility study for offloading MPI requirements. Supercomputing Frontiers and Innovations, 3(3), 56–60. https://doi.org/10.14529/jsfi160306