SC13 Home > SC13 Schedule > SC13 Presentation - Cost-Effective Cloud HPC Resource Provisioning by Building Semi-Elastic Virtual Clusters

SCHEDULE: NOV 16-22, 2013

When viewing the Technical Program schedule, on the far righthand side is a column labeled "PLANNER." Use this planner to build your own schedule. Once you select an event and want to add it to your personal schedule, just click on the calendar icon of your choice (outlook calendar, ical calendar or google calendar) and that event will be stored there. As you select events in this manner, you will have your own schedule to guide you through the week.

Cost-Effective Cloud HPC Resource Provisioning by Building Semi-Elastic Virtual Clusters

SESSION: Cloud Resource Management and Scheduling


TIME: 2:00PM - 2:30PM


AUTHOR(S):Shuangcheng Niu, Jidong Zhai, Xiaosong Ma, Xiongchao Tang, Wenguang Chen


Recent studies have found cloud environments increasingly appealing for executing HPC applications, including tightly coupled parallel simulations. While public clouds offer elastic, on-demand resource provisioning and pay-as-you-go pricing, individual users setting up their on-demand virtual clusters may not be able to take full advantage of common cost-saving opportunities, such as reserved instances. In this paper, we propose a Semi-Elastic Cluster (SEC) computing model for organizations to reserve and dynamically resize a virtual cloud-based cluster. We present a set of integrated batch scheduling plus resource scaling strategies uniquely enabled by SEC, as well as an online reserved instance provisioning algorithm based on job history. Our trace-driven simulation results show that such a model has a 61.0% cost saving than individual users acquiring and managing cloud resources without causing longer average job wait time. Meanwhile, the overhead of acquiring/maintaining shared cloud instances is shown to take only a few seconds.

Chair/Author Details:

Kate Keahey (Chair) - Argonne National Laboratory

Shuangcheng Niu - Tsinghua University

Jidong Zhai - Tsinghua University

Xiaosong Ma - North Carolina State University

Xiongchao Tang - Tsinghua University

Wenguang Chen - Tsinghua University

Add to iCal  Click here to download .ics calendar file

Add to Outlook  Click here to download .vcs calendar file

Add to Google Calendarss  Click here to add event to your Google Calendar

The full paper can be found in the ACM Digital Library