SC13 Home > SC13 Schedule > SC13 Presentation - MVAPICH-PRISM: A Proxy-Based Communication Framework Using InfiniBand and SCIF for Intel MIC Clusters

SCHEDULE: NOV 16-22, 2013

When viewing the Technical Program schedule, on the far righthand side is a column labeled "PLANNER." Use this planner to build your own schedule. Once you select an event and want to add it to your personal schedule, just click on the calendar icon of your choice (outlook calendar, ical calendar or google calendar) and that event will be stored there. As you select events in this manner, you will have your own schedule to guide you through the week.

MVAPICH-PRISM: A Proxy-Based Communication Framework Using InfiniBand and SCIF for Intel MIC Clusters

SESSION: Inter-Node Communication


TIME: 11:30AM - 12:00PM

SESSION CHAIR: Rajeev Thakur

AUTHOR(S):Sreeram Potluri, Devendar Bureddy, Khaled Hamidouche, Akshay Venkatesh, Krishna Kandalla, Hari Subramoni, Dhabaleswar K. Panda


Xeon Phi packs up to 1TFlops of performance on a single chip while providing x86_64 compatibility. InfiniBand is currently one of the most popular interconnects for supercomputing systems. The software stack on Xeon Phi allows processes to directly access the InfiniBand HCA, providing a low latency path for internode communication. However, drawbacks in state-of-the-art chipsets like Sandy Bridge limit the bandwidth available for these transfers. We propose MVAPICH-PRISM, a novel proxy-based framework to optimize communication performance on such systems. We present several designs and evaluate them using micro-benchmarks and application kernels. Our designs improve internode MPI latency between Xeon Phi processes by up to 65% and internode bandwidth by up to five times. Our designs improve the performance of MPI_Alltoall operation by up to 65%, with 256 processes. They improve the performance of 3D Stencil communication kernel and P3DFFT library by 56% and 22% with 1,024 and 512 processes, respectively.

Chair/Author Details:

Rajeev Thakur (Chair) - Argonne National Laboratory

Sreeram Potluri - Ohio State University

Devendar Bureddy - Ohio State University

Khaled Hamidouche - Ohio State University

Akshay Venkatesh - Ohio State University

Krishna Kandalla - Ohio State University

Hari Subramoni - Ohio State University

Dhabaleswar K. Panda - Ohio State University

Add to iCal  Click here to download .ics calendar file

Add to Outlook  Click here to download .vcs calendar file

Add to Google Calendarss  Click here to add event to your Google Calendar

The full paper can be found in the ACM Digital Library