SC13 Home > SC13 Schedule > SC13 Presentation - ACIC: Automatic Cloud I/O Configurator for HPC Applications

SCHEDULE: NOV 16-22, 2013

When viewing the Technical Program schedule, on the far righthand side is a column labeled "PLANNER." Use this planner to build your own schedule. Once you select an event and want to add it to your personal schedule, just click on the calendar icon of your choice (outlook calendar, ical calendar or google calendar) and that event will be stored there. As you select events in this manner, you will have your own schedule to guide you through the week.

ACIC: Automatic Cloud I/O Configurator for HPC Applications

SESSION: Performance Management of HPC Systems


TIME: 11:00AM - 11:30AM


AUTHOR(S):Mingliang Liu, Ye Jin, Jidong Zhai, Yan Zhai, Qianqian Shi, Xiaosong Ma, Wenguang Chen


The cloud has become a promising alternative to traditional HPC centers or in-house clusters. This new environment highlights the I/O bottleneck problem, typically with top-of-the-line compute instances but sub-par communication and I/O facilities. It has been observed that changing cloud I/O system configurations leads to significant variation in the performance and cost efficiency of I/O intensive HPC applications. However, storage system configuration is tedious and error-prone to do manually, even for experts. This paper proposes ACIC, which takes a given application running on a given cloud platform, and automatically searches for optimized I/O system configurations. ACIC utilizes machine learning models to perform black-box performance/cost predictions. To tackle the high-dimensional parameter exploration space unique to cloud platforms, we enable affordable, reusable, and incremental training guided by Plackett and Burman Matrices. Results with four representative applications indicate that ACIC consistently identifies near-optimal configurations among a large group of candidate settings.

Chair/Author Details:

Sadaf R. Alam (Chair) - Swiss National Supercomputing Centre

Mingliang Liu - Tsinghua University

Ye Jin - North Carolina State University

Jidong Zhai - Tsinghua University

Yan Zhai - University of Wisconsin-Madison

Qianqian Shi - Tsinghua University

Xiaosong Ma - North Carolina State University

Wenguang Chen - Tsinghua University

Add to iCal  Click here to download .ics calendar file

Add to Outlook  Click here to download .vcs calendar file

Add to Google Calendarss  Click here to add event to your Google Calendar

The full paper can be found in the ACM Digital Library