Scheduling Scientific Workflows on Clouds Using a Task Duplication Approach

Lopes Genez, Thiago; Sakellariou, Rizos; Bittencourt, Luiz F.; Madeira, Edmundo R. M.; Braun, Torsten (17 December 2018). Scheduling Scientific Workflows on Clouds Using a Task Duplication Approach. In: IEEE/ACM 11th International Conference on Utility and Cloud Computing (UCC). Zürich. 17-20 Dec. 2018. 10.1109/UCC.2018.00017

Text ucc.pdf - Published Version Restricted to registered users only Available under License Publisher holds Copyright. Download (2MB)

By renting pay-as-you-go cloud resources (e.g., virtual machines) to do science, the data transfers required during the execution of data-intensive scientific workflows may be
remarkably costly not only regarding the workflow execution time (makespan) but also regarding money. As such transfers are prone to delays, they may jeopardise the makespan, stretch the period of resource rentals and, as a result, compromise budgets.
In this paper, we explore the possibility of trading some communication for computation during the scheduling production, aiming to schedule a workflow by duplicating some computation of its tasks on which other dependent-tasks critically depend upon
to lessen communication between them. This paper explores this premise by enhancing the Heterogeneous Earliest Finish Time (HEFT) algorithm and the Lookahead variant of HEFT. The proposed approach is evaluated using simulation and synthetic data from four real-world scientific workflow applications. Our proposal, which is based on task duplication, can effectively reduce the size of data transfers, which, in turn, contributes
to shortening the rental duration of the resources, in addition to minimising network traffic within the cloud.

Interest & Impact

Downloads

2 since deposited on 28 Jan 2019
0 in the past 12 months

Citations

5 Citations in Web of Science ®
6 Citations in Scopus

Search

in Google Scholar™

Services

Actions (login required)

Edit item

Actions (login required)

Edit item