SC13 Home > SC13 Schedule > SC13 Presentation - Improving the I/O Throughput for Data-Intensive Scientific Applications with Efficient Compression Mechanisms

SCHEDULE: NOV 16-22, 2013

When viewing the Technical Program schedule, on the far righthand side is a column labeled "PLANNER." Use this planner to build your own schedule. Once you select an event and want to add it to your personal schedule, just click on the calendar icon of your choice (outlook calendar, ical calendar or google calendar) and that event will be stored there. As you select events in this manner, you will have your own schedule to guide you through the week.

Improving the I/O Throughput for Data-Intensive Scientific Applications with Efficient Compression Mechanisms

SESSION: Research Poster Reception

EVENT TYPE: Posters, Electronic Posters, and Education Posters

TIME: 5:15PM - 7:00PM

AUTHOR(S):Dongfang Zhao, Jian Yin, Ioan Raicu

ROOM:Mile High Pre-Function

ABSTRACT:
Today's science is generating significantly larger volume of data than before, making many scientific applications bounded on I/O rather than computation. To reduce the I/O time, data compression is getting more attractive and practical. Most of existing compression techniques are general purpose, and not particularly crafted for scientific applications. In this context, we devise a new compression algorithm by carefully exploiting the characteristics of scientific data, namely the incremental changes to the data. Our proposed algorithm segments the data with different starting points and then store only these increments -- essentially achieving both computationally and space efficiency. We design and implement a real system with the proposed algorithm at the filesystem level, so that the compression and decompression is transparent to the end users, and does not need any modification to the applications. The system is evaluated on a 1024-core IBM BlueGene/P supercomputer with the 128-node GPFS file system.

Chair/Author Details:

Dongfang Zhao - Illinois Institute of Technology

Jian Yin - Pacific Northwest National Laboratory

Ioan Raicu - Illinois Institute of Technology

Add to iCal  Click here to download .ics calendar file

Add to Outlook  Click here to download .vcs calendar file

Add to Google Calendarss  Click here to add event to your Google Calendar