Scheduling Scientific Workflows on Clouds Using a Task Duplication Approach

Lopes Genez, Thiago; Sakellariou, Rizos; Bittencourt, Luiz F.; Madeira, Edmundo R. M.; Braun, Torsten (17 December 2018). Scheduling Scientific Workflows on Clouds Using a Task Duplication Approach. In: IEEE/ACM 11th International Conference on Utility and Cloud Computing (UCC). Zürich. 17-20 Dec. 2018. 10.1109/UCC.2018.00017

[img] Text
ucc.pdf - Published Version
Restricted to registered users only
Available under License Publisher holds Copyright.

Download (2MB)

By renting pay-as-you-go cloud resources (e.g., virtual machines) to do science, the data transfers required during the execution of data-intensive scientific workflows may be
remarkably costly not only regarding the workflow execution time (makespan) but also regarding money. As such transfers are prone to delays, they may jeopardise the makespan, stretch the period of resource rentals and, as a result, compromise budgets.
In this paper, we explore the possibility of trading some communication for computation during the scheduling production, aiming to schedule a workflow by duplicating some computation of its tasks on which other dependent-tasks critically depend upon
to lessen communication between them. This paper explores this premise by enhancing the Heterogeneous Earliest Finish Time (HEFT) algorithm and the Lookahead variant of HEFT. The proposed approach is evaluated using simulation and synthetic data from four real-world scientific workflow applications. Our proposal, which is based on task duplication, can effectively reduce the size of data transfers, which, in turn, contributes
to shortening the rental duration of the resources, in addition to minimising network traffic within the cloud.

Item Type:

Conference or Workshop Item (Paper)

Division/Institute:

08 Faculty of Science > Institute of Computer Science (INF) > Communication and Distributed Systems (CDS)
08 Faculty of Science > Institute of Computer Science (INF)

UniBE Contributor:

Lopes Genez, Thiago, Braun, Torsten

Subjects:

000 Computer science, knowledge & systems
500 Science > 510 Mathematics

Language:

English

Submitter:

Dimitrios Xenakis

Date Deposited:

28 Jan 2019 10:38

Last Modified:

05 Dec 2022 15:24

Publisher DOI:

10.1109/UCC.2018.00017

BORIS DOI:

10.7892/boris.123694

URI:

https://boris.unibe.ch/id/eprint/123694

Actions (login required)

Edit item Edit item
Provide Feedback