Publication: Multi-objective scheduling of extreme d...
Master data
Title: | Multi-objective scheduling of extreme data scientific workflows in Fog |
Subtitle: | |
Abstract: | The concept of “extreme data” is a recent re-incarnation of the “big data” problem, which is distinguished by the massive amounts of information that must be analyzed with strict time requirements. In the past decade, the Cloud data centers have been envisioned as the essential computing architectures for enabling extreme data workflows. However, the Cloud data centers are often geographically distributed. Such geographical distribution increases offloading latency, making it unsuitable for processing of workflows with strict latency requirements, as the data transfer times could be very high. Fog computing emerged as a promising solution to this issue, as it allows partial workflow processing in lower-network layers. Performing data processing on the Fog significantly reduces data transfer latency, allowing to meet the workflows’ strict latency requirements. However, the Fog layer is highly heterogeneous and loosely connected, which affects reliability and response time of task offloading. In this work, we investigate the potential of Fog for scheduling of extreme data workflows with strict response time requirements. Moreover, we propose a novel Pareto-based approach for task offloading in Fog, called Multi-objective Workflow Offloading (MOWO). MOWO considers three optimization objectives, namely response time, reliability, and financial cost. We evaluate MOWO workflow scheduler on a set of real-world biomedical, meteorological and astronomy workflows representing examples of extreme data application with strict latency requirements. |
Keywords: | Scheduling, Scientific workflows, Fog computing, Task offloading, Monte-Carlo simulation, Multi-objective optimization |
Publication type: | Article in journal (Authorship) |
Publication date: | 07.01.2020 (Online) |
Published by: |
Future Generation Computer Systems
Future Generation Computer Systems
(
Elsevier;
)
to publication |
Title of the series: | - |
Volume number: | - |
Issue: | - |
First publication: | Yes |
Version: | - |
Page: | pp. 1 - 37 |
Versionen
Keine Version vorhanden |
Publication date: | 07.01.2020 |
ISBN (e-book): | - |
eISSN: | 0167-739X |
DOI: | http://dx.doi.org/10.1016/j.future.2019.12.054 |
Homepage: | https://www.sciencedirect.com/science/article/pii/S0167739X19309197?via%3Dihub |
Open access |
|
Assignment
Organisation | Address | ||||
---|---|---|---|---|---|
Fakultät für Technische Wissenschaften
Institut für Informationstechnologie
|
AT - 9020 Klagenfurt am Wörthersee |
Categorisation
Subject areas | |
Research Cluster | No research Research Cluster selected |
Citation index |
Information about the citation index: Master Journal List
|
Peer reviewed |
|
Publication focus |
Classification raster of the assigned organisational units:
|
working groups |
|
Cooperations
Organisation | Address | ||
---|---|---|---|
Technische Universität Wien
|
AT - 1040 Wien |
Research activities
Projects: |
|
Publications: | No related publications |
Events: | No related events |
Lectures: | No related lectures |