A task scheduling policy for heterogeneous MapReduce cluster

Chui Ming Chiu; Sheng Wei Huang; Tzu Chi Huang; Ce Kuen Shieh; Ming Fong Tsai; Lien Wu Chen

doi:10.3233/978-1-61499-484-8-420

A task scheduling policy for heterogeneous MapReduce cluster

Chui Ming Chiu
, Sheng Wei Huang
, Tzu Chi Huang
, Ce Kuen Shieh
, Ming Fong Tsai
, Lien Wu Chen

Department of Electrical Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

MapReduce is a programming model and its associated run-time system proposed in 2004, which can process large scale of data in clusters with simple program logic. MapReduce has a potential problem running on a cooperative cluster which is combined with machines having different configurations. The problem will cause unexpected performance degradations and should be avoided. In this paper, a task scheduling policy is proposed to take higher utilization of all computing nodes in heterogeneous clusters.

Original language	English
Title of host publication	Intelligent Systems and Applications - Proceedings of the International Computer Symposium, ICS 2014
Editors	William Cheng-Chung Chu, Han-Chieh Chao, Stephen Jenn-Hwa Yang
Publisher	IOS Press BV
Pages	420-429
Number of pages	10
ISBN (Electronic)	9781614994831
DOIs	https://doi.org/10.3233/978-1-61499-484-8-420
Publication status	Published - 2015
Event	International Computer Symposium, ICS 2014 - Taichung, Taiwan Duration: 2014 Dec 12 → 2014 Dec 14

Publication series

Name	Frontiers in Artificial Intelligence and Applications
Volume	274
ISSN (Print)	0922-6389
ISSN (Electronic)	1879-8314

Other

Other	International Computer Symposium, ICS 2014
Country/Territory	Taiwan
City	Taichung
Period	14-12-12 → 14-12-14

All Science Journal Classification (ASJC) codes

Artificial Intelligence

Access to Document

10.3233/978-1-61499-484-8-420

Cite this

Chiu, C. M., Huang, S. W., Huang, T. C., Shieh, C. K., Tsai, M. F., & Chen, L. W. (2015). A task scheduling policy for heterogeneous MapReduce cluster. In W. C.-C. Chu, H.-C. Chao, & S. J.-H. Yang (Eds.), Intelligent Systems and Applications - Proceedings of the International Computer Symposium, ICS 2014 (pp. 420-429). (Frontiers in Artificial Intelligence and Applications; Vol. 274). IOS Press BV. https://doi.org/10.3233/978-1-61499-484-8-420

Chiu, Chui Ming ; Huang, Sheng Wei ; Huang, Tzu Chi et al. / A task scheduling policy for heterogeneous MapReduce cluster. Intelligent Systems and Applications - Proceedings of the International Computer Symposium, ICS 2014. editor / William Cheng-Chung Chu ; Han-Chieh Chao ; Stephen Jenn-Hwa Yang. IOS Press BV, 2015. pp. 420-429 (Frontiers in Artificial Intelligence and Applications).

@inproceedings{caa13c55a4d941cab5870b1d56939d39,

title = "A task scheduling policy for heterogeneous MapReduce cluster",

abstract = "MapReduce is a programming model and its associated run-time system proposed in 2004, which can process large scale of data in clusters with simple program logic. MapReduce has a potential problem running on a cooperative cluster which is combined with machines having different configurations. The problem will cause unexpected performance degradations and should be avoided. In this paper, a task scheduling policy is proposed to take higher utilization of all computing nodes in heterogeneous clusters.",

author = "Chiu, \{Chui Ming\} and Huang, \{Sheng Wei\} and Huang, \{Tzu Chi\} and Shieh, \{Ce Kuen\} and Tsai, \{Ming Fong\} and Chen, \{Lien Wu\}",

year = "2015",

doi = "10.3233/978-1-61499-484-8-420",

language = "English",

series = "Frontiers in Artificial Intelligence and Applications",

publisher = "IOS Press BV",

pages = "420--429",

editor = "Chu, \{William Cheng-Chung\} and Han-Chieh Chao and Yang, \{Stephen Jenn-Hwa\}",

booktitle = "Intelligent Systems and Applications - Proceedings of the International Computer Symposium, ICS 2014",

}

Chiu, CM, Huang, SW, Huang, TC, Shieh, CK, Tsai, MF & Chen, LW 2015, A task scheduling policy for heterogeneous MapReduce cluster. in WC-C Chu, H-C Chao & SJ-H Yang (eds), Intelligent Systems and Applications - Proceedings of the International Computer Symposium, ICS 2014. Frontiers in Artificial Intelligence and Applications, vol. 274, IOS Press BV, pp. 420-429, International Computer Symposium, ICS 2014, Taichung, Taiwan, 14-12-12. https://doi.org/10.3233/978-1-61499-484-8-420

A task scheduling policy for heterogeneous MapReduce cluster. / Chiu, Chui Ming; Huang, Sheng Wei; Huang, Tzu Chi et al.
Intelligent Systems and Applications - Proceedings of the International Computer Symposium, ICS 2014. ed. / William Cheng-Chung Chu; Han-Chieh Chao; Stephen Jenn-Hwa Yang. IOS Press BV, 2015. p. 420-429 (Frontiers in Artificial Intelligence and Applications; Vol. 274).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - A task scheduling policy for heterogeneous MapReduce cluster

AU - Chiu, Chui Ming

AU - Huang, Sheng Wei

AU - Huang, Tzu Chi

AU - Shieh, Ce Kuen

AU - Tsai, Ming Fong

AU - Chen, Lien Wu

PY - 2015

Y1 - 2015

N2 - MapReduce is a programming model and its associated run-time system proposed in 2004, which can process large scale of data in clusters with simple program logic. MapReduce has a potential problem running on a cooperative cluster which is combined with machines having different configurations. The problem will cause unexpected performance degradations and should be avoided. In this paper, a task scheduling policy is proposed to take higher utilization of all computing nodes in heterogeneous clusters.

AB - MapReduce is a programming model and its associated run-time system proposed in 2004, which can process large scale of data in clusters with simple program logic. MapReduce has a potential problem running on a cooperative cluster which is combined with machines having different configurations. The problem will cause unexpected performance degradations and should be avoided. In this paper, a task scheduling policy is proposed to take higher utilization of all computing nodes in heterogeneous clusters.

UR - https://www.scopus.com/pages/publications/84926444217

UR - https://www.scopus.com/pages/publications/84926444217#tab=citedBy

U2 - 10.3233/978-1-61499-484-8-420

DO - 10.3233/978-1-61499-484-8-420

M3 - Conference contribution

AN - SCOPUS:84926444217

T3 - Frontiers in Artificial Intelligence and Applications

SP - 420

EP - 429

BT - Intelligent Systems and Applications - Proceedings of the International Computer Symposium, ICS 2014

A2 - Chu, William Cheng-Chung

A2 - Chao, Han-Chieh

A2 - Yang, Stephen Jenn-Hwa

PB - IOS Press BV

T2 - International Computer Symposium, ICS 2014

Y2 - 12 December 2014 through 14 December 2014

ER -

Chiu CM, Huang SW, Huang TC, Shieh CK, Tsai MF, Chen LW. A task scheduling policy for heterogeneous MapReduce cluster. In Chu WCC, Chao HC, Yang SJH, editors, Intelligent Systems and Applications - Proceedings of the International Computer Symposium, ICS 2014. IOS Press BV. 2015. p. 420-429. (Frontiers in Artificial Intelligence and Applications). doi: 10.3233/978-1-61499-484-8-420

A task scheduling policy for heterogeneous MapReduce cluster

Abstract

Publication series

Other

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this