A task scheduling policy for heterogeneous MapReduce cluster

Chui Ming Chiu, Sheng Wei Huang, Tzu Chi Huang, Ce-Kuen Shieh, Ming Fong Tsai, Lien Wu Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

MapReduce is a programming model and its associated run-time system proposed in 2004, which can process large scale of data in clusters with simple program logic. MapReduce has a potential problem running on a cooperative cluster which is combined with machines having different configurations. The problem will cause unexpected performance degradations and should be avoided. In this paper, a task scheduling policy is proposed to take higher utilization of all computing nodes in heterogeneous clusters.

Original languageEnglish
Title of host publicationIntelligent Systems and Applications - Proceedings of the International Computer Symposium, ICS 2014
PublisherIOS Press
Pages420-429
Number of pages10
Volume274
ISBN (Electronic)9781614994831
DOIs
Publication statusPublished - 2015
EventInternational Computer Symposium, ICS 2014 - Taichung, Taiwan
Duration: 2014 Dec 122014 Dec 14

Publication series

NameFrontiers in Artificial Intelligence and Applications
Volume274
ISSN (Print)0922-6389

Other

OtherInternational Computer Symposium, ICS 2014
CountryTaiwan
CityTaichung
Period14-12-1214-12-14

Fingerprint

Scheduling
Degradation

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence

Cite this

Chiu, C. M., Huang, S. W., Huang, T. C., Shieh, C-K., Tsai, M. F., & Chen, L. W. (2015). A task scheduling policy for heterogeneous MapReduce cluster. In Intelligent Systems and Applications - Proceedings of the International Computer Symposium, ICS 2014 (Vol. 274, pp. 420-429). (Frontiers in Artificial Intelligence and Applications; Vol. 274). IOS Press. https://doi.org/10.3233/978-1-61499-484-8-420
Chiu, Chui Ming ; Huang, Sheng Wei ; Huang, Tzu Chi ; Shieh, Ce-Kuen ; Tsai, Ming Fong ; Chen, Lien Wu. / A task scheduling policy for heterogeneous MapReduce cluster. Intelligent Systems and Applications - Proceedings of the International Computer Symposium, ICS 2014. Vol. 274 IOS Press, 2015. pp. 420-429 (Frontiers in Artificial Intelligence and Applications).
@inproceedings{caa13c55a4d941cab5870b1d56939d39,
title = "A task scheduling policy for heterogeneous MapReduce cluster",
abstract = "MapReduce is a programming model and its associated run-time system proposed in 2004, which can process large scale of data in clusters with simple program logic. MapReduce has a potential problem running on a cooperative cluster which is combined with machines having different configurations. The problem will cause unexpected performance degradations and should be avoided. In this paper, a task scheduling policy is proposed to take higher utilization of all computing nodes in heterogeneous clusters.",
author = "Chiu, {Chui Ming} and Huang, {Sheng Wei} and Huang, {Tzu Chi} and Ce-Kuen Shieh and Tsai, {Ming Fong} and Chen, {Lien Wu}",
year = "2015",
doi = "10.3233/978-1-61499-484-8-420",
language = "English",
volume = "274",
series = "Frontiers in Artificial Intelligence and Applications",
publisher = "IOS Press",
pages = "420--429",
booktitle = "Intelligent Systems and Applications - Proceedings of the International Computer Symposium, ICS 2014",
address = "Netherlands",

}

Chiu, CM, Huang, SW, Huang, TC, Shieh, C-K, Tsai, MF & Chen, LW 2015, A task scheduling policy for heterogeneous MapReduce cluster. in Intelligent Systems and Applications - Proceedings of the International Computer Symposium, ICS 2014. vol. 274, Frontiers in Artificial Intelligence and Applications, vol. 274, IOS Press, pp. 420-429, International Computer Symposium, ICS 2014, Taichung, Taiwan, 14-12-12. https://doi.org/10.3233/978-1-61499-484-8-420

A task scheduling policy for heterogeneous MapReduce cluster. / Chiu, Chui Ming; Huang, Sheng Wei; Huang, Tzu Chi; Shieh, Ce-Kuen; Tsai, Ming Fong; Chen, Lien Wu.

Intelligent Systems and Applications - Proceedings of the International Computer Symposium, ICS 2014. Vol. 274 IOS Press, 2015. p. 420-429 (Frontiers in Artificial Intelligence and Applications; Vol. 274).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - A task scheduling policy for heterogeneous MapReduce cluster

AU - Chiu, Chui Ming

AU - Huang, Sheng Wei

AU - Huang, Tzu Chi

AU - Shieh, Ce-Kuen

AU - Tsai, Ming Fong

AU - Chen, Lien Wu

PY - 2015

Y1 - 2015

N2 - MapReduce is a programming model and its associated run-time system proposed in 2004, which can process large scale of data in clusters with simple program logic. MapReduce has a potential problem running on a cooperative cluster which is combined with machines having different configurations. The problem will cause unexpected performance degradations and should be avoided. In this paper, a task scheduling policy is proposed to take higher utilization of all computing nodes in heterogeneous clusters.

AB - MapReduce is a programming model and its associated run-time system proposed in 2004, which can process large scale of data in clusters with simple program logic. MapReduce has a potential problem running on a cooperative cluster which is combined with machines having different configurations. The problem will cause unexpected performance degradations and should be avoided. In this paper, a task scheduling policy is proposed to take higher utilization of all computing nodes in heterogeneous clusters.

UR - http://www.scopus.com/inward/record.url?scp=84926444217&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84926444217&partnerID=8YFLogxK

U2 - 10.3233/978-1-61499-484-8-420

DO - 10.3233/978-1-61499-484-8-420

M3 - Conference contribution

VL - 274

T3 - Frontiers in Artificial Intelligence and Applications

SP - 420

EP - 429

BT - Intelligent Systems and Applications - Proceedings of the International Computer Symposium, ICS 2014

PB - IOS Press

ER -

Chiu CM, Huang SW, Huang TC, Shieh C-K, Tsai MF, Chen LW. A task scheduling policy for heterogeneous MapReduce cluster. In Intelligent Systems and Applications - Proceedings of the International Computer Symposium, ICS 2014. Vol. 274. IOS Press. 2015. p. 420-429. (Frontiers in Artificial Intelligence and Applications). https://doi.org/10.3233/978-1-61499-484-8-420