SC13 Home > SC13 Schedule > SC13 Presentation - Scaling I/O Beyond 100,000 Cores using ADIOS

SCHEDULE: NOV 16-22, 2013

When viewing the Technical Program schedule, on the far righthand side is a column labeled "PLANNER." Use this planner to build your own schedule. Once you select an event and want to add it to your personal schedule, just click on the calendar icon of your choice (outlook calendar, ical calendar or google calendar) and that event will be stored there. As you select events in this manner, you will have your own schedule to guide you through the week.

Scaling I/O Beyond 100,000 Cores using ADIOS

SESSION: Scaling I/O Beyond 100,000 Cores using ADIOS

EVENT TYPE: Tutorials

TIME: 1:30PM - 5:00PM

Presenter(s):Qing Liu, Norbert Podhorszki, Scott Klasky


As concurrency continues to increase on high-end machines, from both the number of cores and storage devices, we must look for a revolutionary way to treat I/O. As a matter of fact, one of the major roadblocks to exascale is how to write and read big datasets quickly and efficiently on high-end machines. On the other hand applications often want to process data in an efficient and flexible manner, in terms of data formats and operations performed (e.g., files, data streams). In this tutorial we will show how users can do that and get high performance with ADIOS on 100,000+ cores. Part I of this tutorial will introduce parallel I/O and the ADIOS framework to the audience. Specifically we will discus the concept of ADIOS I/O abstraction, the binary-packed file format, and I/O methods along with the benefits to applications. Since 1.4.1, ADIOS can operate on both files and data streams. Part II will include a session on how to write/read data, and how to use different I/O componentizations inside of ADIOS. Part III will show users how to take advantage of the ADIOS framework to do compression/indexing. Finally, we will discuss how to run in-situ visualization using VisIt/Paraview+ADIOS.

Chair/Presenter Details:

Qing Liu - Oak Ridge National Laboratory

Norbert Podhorszki - Oak Ridge National Laboratory

Scott Klasky - Oak Ridge National Laboratory

Add to iCal  Click here to download .ics calendar file

Add to Outlook  Click here to download .vcs calendar file

Add to Google Calendarss  Click here to add event to your Google Calendar