A task scheduling policy for heterogeneous MapReduce cluster

Chui Ming Chiu, Sheng Wei Huang, Tzu Chi Huang, Ce-Kuen Shieh, Ming Fong Tsai, Lien Wu Chen

研究成果: Conference contribution

摘要

MapReduce is a programming model and its associated run-time system proposed in 2004, which can process large scale of data in clusters with simple program logic. MapReduce has a potential problem running on a cooperative cluster which is combined with machines having different configurations. The problem will cause unexpected performance degradations and should be avoided. In this paper, a task scheduling policy is proposed to take higher utilization of all computing nodes in heterogeneous clusters.

原文English
主出版物標題Intelligent Systems and Applications - Proceedings of the International Computer Symposium, ICS 2014
編輯William Cheng-Chung Chu, Stephen Jenn-Hwa Yang, Han-Chieh Chao
發行者IOS Press
頁面420-429
頁數10
ISBN(電子)9781614994831
DOIs
出版狀態Published - 2015 一月 1
事件International Computer Symposium, ICS 2014 - Taichung, Taiwan
持續時間: 2014 十二月 122014 十二月 14

出版系列

名字Frontiers in Artificial Intelligence and Applications
274
ISSN(列印)0922-6389

Other

OtherInternational Computer Symposium, ICS 2014
國家Taiwan
城市Taichung
期間14-12-1214-12-14

指紋

Scheduling
Degradation

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence

引用此文

Chiu, C. M., Huang, S. W., Huang, T. C., Shieh, C-K., Tsai, M. F., & Chen, L. W. (2015). A task scheduling policy for heterogeneous MapReduce cluster. 於 W. C-C. Chu, S. J-H. Yang, & H-C. Chao (編輯), Intelligent Systems and Applications - Proceedings of the International Computer Symposium, ICS 2014 (頁 420-429). (Frontiers in Artificial Intelligence and Applications; 卷 274). IOS Press. https://doi.org/10.3233/978-1-61499-484-8-420
Chiu, Chui Ming ; Huang, Sheng Wei ; Huang, Tzu Chi ; Shieh, Ce-Kuen ; Tsai, Ming Fong ; Chen, Lien Wu. / A task scheduling policy for heterogeneous MapReduce cluster. Intelligent Systems and Applications - Proceedings of the International Computer Symposium, ICS 2014. 編輯 / William Cheng-Chung Chu ; Stephen Jenn-Hwa Yang ; Han-Chieh Chao. IOS Press, 2015. 頁 420-429 (Frontiers in Artificial Intelligence and Applications).
@inproceedings{caa13c55a4d941cab5870b1d56939d39,
title = "A task scheduling policy for heterogeneous MapReduce cluster",
abstract = "MapReduce is a programming model and its associated run-time system proposed in 2004, which can process large scale of data in clusters with simple program logic. MapReduce has a potential problem running on a cooperative cluster which is combined with machines having different configurations. The problem will cause unexpected performance degradations and should be avoided. In this paper, a task scheduling policy is proposed to take higher utilization of all computing nodes in heterogeneous clusters.",
author = "Chiu, {Chui Ming} and Huang, {Sheng Wei} and Huang, {Tzu Chi} and Ce-Kuen Shieh and Tsai, {Ming Fong} and Chen, {Lien Wu}",
year = "2015",
month = "1",
day = "1",
doi = "10.3233/978-1-61499-484-8-420",
language = "English",
series = "Frontiers in Artificial Intelligence and Applications",
publisher = "IOS Press",
pages = "420--429",
editor = "Chu, {William Cheng-Chung} and Yang, {Stephen Jenn-Hwa} and Han-Chieh Chao",
booktitle = "Intelligent Systems and Applications - Proceedings of the International Computer Symposium, ICS 2014",
address = "Netherlands",

}

Chiu, CM, Huang, SW, Huang, TC, Shieh, C-K, Tsai, MF & Chen, LW 2015, A task scheduling policy for heterogeneous MapReduce cluster. 於 WC-C Chu, SJ-H Yang & H-C Chao (編輯), Intelligent Systems and Applications - Proceedings of the International Computer Symposium, ICS 2014. Frontiers in Artificial Intelligence and Applications, 卷 274, IOS Press, 頁 420-429, International Computer Symposium, ICS 2014, Taichung, Taiwan, 14-12-12. https://doi.org/10.3233/978-1-61499-484-8-420

A task scheduling policy for heterogeneous MapReduce cluster. / Chiu, Chui Ming; Huang, Sheng Wei; Huang, Tzu Chi; Shieh, Ce-Kuen; Tsai, Ming Fong; Chen, Lien Wu.

Intelligent Systems and Applications - Proceedings of the International Computer Symposium, ICS 2014. 編輯 / William Cheng-Chung Chu; Stephen Jenn-Hwa Yang; Han-Chieh Chao. IOS Press, 2015. p. 420-429 (Frontiers in Artificial Intelligence and Applications; 卷 274).

研究成果: Conference contribution

TY - GEN

T1 - A task scheduling policy for heterogeneous MapReduce cluster

AU - Chiu, Chui Ming

AU - Huang, Sheng Wei

AU - Huang, Tzu Chi

AU - Shieh, Ce-Kuen

AU - Tsai, Ming Fong

AU - Chen, Lien Wu

PY - 2015/1/1

Y1 - 2015/1/1

N2 - MapReduce is a programming model and its associated run-time system proposed in 2004, which can process large scale of data in clusters with simple program logic. MapReduce has a potential problem running on a cooperative cluster which is combined with machines having different configurations. The problem will cause unexpected performance degradations and should be avoided. In this paper, a task scheduling policy is proposed to take higher utilization of all computing nodes in heterogeneous clusters.

AB - MapReduce is a programming model and its associated run-time system proposed in 2004, which can process large scale of data in clusters with simple program logic. MapReduce has a potential problem running on a cooperative cluster which is combined with machines having different configurations. The problem will cause unexpected performance degradations and should be avoided. In this paper, a task scheduling policy is proposed to take higher utilization of all computing nodes in heterogeneous clusters.

UR - http://www.scopus.com/inward/record.url?scp=84926444217&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84926444217&partnerID=8YFLogxK

U2 - 10.3233/978-1-61499-484-8-420

DO - 10.3233/978-1-61499-484-8-420

M3 - Conference contribution

AN - SCOPUS:84926444217

T3 - Frontiers in Artificial Intelligence and Applications

SP - 420

EP - 429

BT - Intelligent Systems and Applications - Proceedings of the International Computer Symposium, ICS 2014

A2 - Chu, William Cheng-Chung

A2 - Yang, Stephen Jenn-Hwa

A2 - Chao, Han-Chieh

PB - IOS Press

ER -

Chiu CM, Huang SW, Huang TC, Shieh C-K, Tsai MF, Chen LW. A task scheduling policy for heterogeneous MapReduce cluster. 於 Chu WC-C, Yang SJ-H, Chao H-C, 編輯, Intelligent Systems and Applications - Proceedings of the International Computer Symposium, ICS 2014. IOS Press. 2015. p. 420-429. (Frontiers in Artificial Intelligence and Applications). https://doi.org/10.3233/978-1-61499-484-8-420