SCHEDULE: NOV 16-22, 2013

When viewing the Technical Program schedule, on the far righthand side is a column labeled "PLANNER." Use this planner to build your own schedule. Once you select an event and want to add it to your personal schedule, just click on the calendar icon of your choice (outlook calendar, ical calendar or google calendar) and that event will be stored there. As you select events in this manner, you will have your own schedule to guide you through the week.

GoldRush: Resource Efficient In Situ Scientific Data Analytics Using Fine-Grained Interference Aware Execution

SESSION: In-Situ Data Analytics and Reduction

EVENT TYPE: Papers

TIME: 2:30PM - 3:00PM

SESSION CHAIR: Dimitris Nikolopoulos

AUTHOR(S):Fang Zheng, Hongfeng Yu, Can Hantas, Matthew Wolf, Greg Eisenhauer, Karsten Schwan, Hasan Abbasi, Scott Klasky

ROOM:205/207

ABSTRACT:
Severe I/O bottlenecks on High End Computing platforms call for running data analytics in situ. Demonstrating that there exist considerable resources in compute nodes unused by typical high end scientific simulations, we leverage this fact by creating an agile runtime, termed GoldRush, that can harvest those otherwise wasted, idle resources to efficiently run in situ data analytics. GoldRush uses fine-grained scheduling to steal idle resources, in ways that minimize interference between the simulation and in situ analytics. This involves recognizing the potential causes of on-node resource contention and then using scheduling methods that prevent them. Experiments with representative science applications at large scales show that resources harvested on compute nodes can be leveraged to perform useful analytics, significantly improving resource efficiency, reducing data movement costs incurred by alternate solutions, and posing negligible impact on scientific simulations.

Chair/Author Details:

Dimitris Nikolopoulos (Chair) - Queen's University Belfast

Fang Zheng - Georgia Institute of Technology

Hongfeng Yu - University of Nebraska-Lincoln

Can Hantas - Georgia Institute of Technology

Matthew Wolf - Georgia Institute of Technology

Greg Eisenhauer - Georgia Institute of Technology

Karsten Schwan - Georgia Institute of Technology

Hasan Abbasi - Oak Ridge National Laboratory

Scott Klasky - Oak Ridge National Laboratory

  Click here to download .ics calendar file

  Click here to download .vcs calendar file

  Click here to add event to your Google Calendar

The full paper can be found in the ACM Digital Library