SC13 Home > SC13 Schedule > SC13 Presentation - Exploiting Application Dynamism and Cloud Elasticity for Continuous Dataflows

SCHEDULE: NOV 16-22, 2013

When viewing the Technical Program schedule, on the far righthand side is a column labeled "PLANNER." Use this planner to build your own schedule. Once you select an event and want to add it to your personal schedule, just click on the calendar icon of your choice (outlook calendar, ical calendar or google calendar) and that event will be stored there. As you select events in this manner, you will have your own schedule to guide you through the week.

Exploiting Application Dynamism and Cloud Elasticity for Continuous Dataflows

SESSION: Cloud Resource Management and Scheduling


TIME: 2:30PM - 3:00PM


AUTHOR(S):Alok Gautam Kumbhare, Yogesh Simmhan, Viktor K. Prasanna


Contemporary continuous dataflow systems use elastic scaling on clouds to handle variable data rates to meet applications' needs while attempting to maximize resource utilization. However, virtualized clouds present an added challenge due to the variability in resource performance thereby impacting the QoS. Elastic use of cloud resources and their allocation to dataflows thus need to adapt to such infrastructure dynamism. We develop the concept of ``dynamic dataflows'' that utilizes alternate tasks and allows additional control over the dataflow's cost and QoS. We formalize an optimization problem to allow trade-off between application's value against resource cost. We present two novel heuristics based on variable sized bin-packing heuristics and evaluate them through simulations with different data profiles using VM performance traces from a private cloud. The results show that the heuristics are effective in intelligently utilizing cloud elasticity to mitigate the effect of both input data rate and performance variabilities on QoS.

Chair/Author Details:

Kate Keahey (Chair) - Argonne National Laboratory

Alok Gautam Kumbhare - University of Southern California

Yogesh Simmhan - University of Southern California

Viktor K. Prasanna - University of Southern California

Add to iCal  Click here to download .ics calendar file

Add to Outlook  Click here to download .vcs calendar file

Add to Google Calendarss  Click here to add event to your Google Calendar

The full paper can be found in the ACM Digital Library