Scheduling Scientific Workflows on Clouds Using a Task Duplication Approach

Lopes Genez, Thiago; Sakellariou, Rizos; Bittencourt, Luiz F.; Madeira, Edmundo R. M.; Braun, Torsten (17 December 2018). Scheduling Scientific Workflows on Clouds Using a Task Duplication Approach. In: IEEE/ACM 11th International Conference on Utility and Cloud Computing (UCC). Zürich. 17-20 Dec. 2018. 10.1109/UCC.2018.00017

[img] Text
ucc.pdf - Published Version
Restricted to registered users only
Available under License Publisher holds Copyright.

Download (2MB) | Request a copy

By renting pay-as-you-go cloud resources (e.g., virtual machines) to do science, the data transfers required during the execution of data-intensive scientific workflows may be remarkably costly not only regarding the workflow execution time (makespan) but also regarding money. As such transfers are prone to delays, they may jeopardise the makespan, stretch the period of resource rentals and, as a result, compromise budgets. In this paper, we explore the possibility of trading some communication for computation during the scheduling production, aiming to schedule a workflow by duplicating some computation of its tasks on which other dependent-tasks critically depend upon to lessen communication between them. This paper explores this premise by enhancing the Heterogeneous Earliest Finish Time (HEFT) algorithm and the Lookahead variant of HEFT. The proposed approach is evaluated using simulation and synthetic data from four real-world scientific workflow applications. Our proposal, which is based on task duplication, can effectively reduce the size of data transfers, which, in turn, contributes to shortening the rental duration of the resources, in addition to minimising network traffic within the cloud.

Item Type:

Conference or Workshop Item (Paper)

Division/Institute:

08 Faculty of Science > Institute of Computer Science (INF)

UniBE Contributor:

Lopes Genez, Thiago and Braun, Torsten

Subjects:

000 Computer science, knowledge & systems
500 Science > 510 Mathematics

Language:

English

Submitter:

Eirini Kalogeiton

Date Deposited:

28 Jan 2019 10:38

Last Modified:

01 Nov 2019 22:14

Publisher DOI:

10.1109/UCC.2018.00017

BORIS DOI:

10.7892/boris.123694

URI:

https://boris.unibe.ch/id/eprint/123694

Actions (login required)

Edit item Edit item
Provide Feedback