Automatic self-suspended task for a mapreduce system on cloud computing

Tzu Chi Huang, Ce-Kuen Shieh, Sheng Wei Huang, Chui Ming Chiu, Tyng Yeu Liang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

A MapReduce system gradually becomes an essential technology to achieve the large scale computing on cloud computing. A MapReduce system currently is designed to distribute tasks over nodes in a cloud according to manual configurations of slot numbers in nodes. However, a MapReduce system may have the performance degradation due to the inappropriate configuration of the slot number, because the slot number can not exactly reflect the performance of the node. A MapReduce system can utilize the Automatic Self-Suspended Task (ASST) proposed in this paper to alleviate the performance degradation due to the inappropriate configuration of the slot number in a node on cloud computing. In experiments of this paper, a MapReduce system is proved to have a better performance with the help of ASST for various applications on cloud computing.

Original languageEnglish
Title of host publicationTrends and Applications in Knowledge Discovery and Data Mining - PAKDD 2014 International Workshops
Subtitle of host publicationDANTH, BDM, MobiSocial, BigEC, CloudSD, MSMV-MBI, SDA, DMDA-Health, ALSIP, SocNet, DMBIH, BigPMA, Revised Selected Papers
EditorsWen-Chih Peng, Haixun Wang, Zhi-Hua Zhou, Tu Bao Ho, Vincent S. Tseng, Arbee L.P. Chen, James Bailey
PublisherSpringer Verlag
Pages257-268
Number of pages12
ISBN (Electronic)9783319131856
DOIs
Publication statusPublished - 2014 Jan 1
EventInternational Workshops on Data Mining and Decision Analytics for Public Health, Biologically Inspired Data Mining Techniques, Mobile Data Management, Mining, and Computing on Social Networks, Big Data Science and Engineering on E-Commerce, Cloud Service Discovery, MSMV-MBI, Scalable Dats Analytics, Data Mining and Decision Analytics for Public Health and Wellness, Algorithms for Large-Scale Information Processing in Knowledge Discovery, Data Mining in Social Networks, Data Mining in Biomedical informatics and Healthcare, Pattern Mining and Application of Big Data in conjunction with 18th Pacific-Asia Conference on Knowledge Discovery and Data Mining, PAKDD 2014 - Tainan, Taiwan
Duration: 2014 May 132014 May 16

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume8643
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

OtherInternational Workshops on Data Mining and Decision Analytics for Public Health, Biologically Inspired Data Mining Techniques, Mobile Data Management, Mining, and Computing on Social Networks, Big Data Science and Engineering on E-Commerce, Cloud Service Discovery, MSMV-MBI, Scalable Dats Analytics, Data Mining and Decision Analytics for Public Health and Wellness, Algorithms for Large-Scale Information Processing in Knowledge Discovery, Data Mining in Social Networks, Data Mining in Biomedical informatics and Healthcare, Pattern Mining and Application of Big Data in conjunction with 18th Pacific-Asia Conference on Knowledge Discovery and Data Mining, PAKDD 2014
CountryTaiwan
CityTainan
Period14-05-1314-05-16

Fingerprint

MapReduce
Cloud computing
Cloud Computing
Degradation
Vertex of a graph
Configuration
Experiments
Computing
Experiment

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Huang, T. C., Shieh, C-K., Huang, S. W., Chiu, C. M., & Liang, T. Y. (2014). Automatic self-suspended task for a mapreduce system on cloud computing. In W-C. Peng, H. Wang, Z-H. Zhou, T. B. Ho, V. S. Tseng, A. L. P. Chen, & J. Bailey (Eds.), Trends and Applications in Knowledge Discovery and Data Mining - PAKDD 2014 International Workshops: DANTH, BDM, MobiSocial, BigEC, CloudSD, MSMV-MBI, SDA, DMDA-Health, ALSIP, SocNet, DMBIH, BigPMA, Revised Selected Papers (pp. 257-268). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8643). Springer Verlag. https://doi.org/10.1007/978-3-319-13186-3_25
Huang, Tzu Chi ; Shieh, Ce-Kuen ; Huang, Sheng Wei ; Chiu, Chui Ming ; Liang, Tyng Yeu. / Automatic self-suspended task for a mapreduce system on cloud computing. Trends and Applications in Knowledge Discovery and Data Mining - PAKDD 2014 International Workshops: DANTH, BDM, MobiSocial, BigEC, CloudSD, MSMV-MBI, SDA, DMDA-Health, ALSIP, SocNet, DMBIH, BigPMA, Revised Selected Papers. editor / Wen-Chih Peng ; Haixun Wang ; Zhi-Hua Zhou ; Tu Bao Ho ; Vincent S. Tseng ; Arbee L.P. Chen ; James Bailey. Springer Verlag, 2014. pp. 257-268 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{023f4def4fb248699db9a4fed0c073b1,
title = "Automatic self-suspended task for a mapreduce system on cloud computing",
abstract = "A MapReduce system gradually becomes an essential technology to achieve the large scale computing on cloud computing. A MapReduce system currently is designed to distribute tasks over nodes in a cloud according to manual configurations of slot numbers in nodes. However, a MapReduce system may have the performance degradation due to the inappropriate configuration of the slot number, because the slot number can not exactly reflect the performance of the node. A MapReduce system can utilize the Automatic Self-Suspended Task (ASST) proposed in this paper to alleviate the performance degradation due to the inappropriate configuration of the slot number in a node on cloud computing. In experiments of this paper, a MapReduce system is proved to have a better performance with the help of ASST for various applications on cloud computing.",
author = "Huang, {Tzu Chi} and Ce-Kuen Shieh and Huang, {Sheng Wei} and Chiu, {Chui Ming} and Liang, {Tyng Yeu}",
year = "2014",
month = "1",
day = "1",
doi = "10.1007/978-3-319-13186-3_25",
language = "English",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "257--268",
editor = "Wen-Chih Peng and Haixun Wang and Zhi-Hua Zhou and Ho, {Tu Bao} and Tseng, {Vincent S.} and Chen, {Arbee L.P.} and James Bailey",
booktitle = "Trends and Applications in Knowledge Discovery and Data Mining - PAKDD 2014 International Workshops",
address = "Germany",

}

Huang, TC, Shieh, C-K, Huang, SW, Chiu, CM & Liang, TY 2014, Automatic self-suspended task for a mapreduce system on cloud computing. in W-C Peng, H Wang, Z-H Zhou, TB Ho, VS Tseng, ALP Chen & J Bailey (eds), Trends and Applications in Knowledge Discovery and Data Mining - PAKDD 2014 International Workshops: DANTH, BDM, MobiSocial, BigEC, CloudSD, MSMV-MBI, SDA, DMDA-Health, ALSIP, SocNet, DMBIH, BigPMA, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 8643, Springer Verlag, pp. 257-268, International Workshops on Data Mining and Decision Analytics for Public Health, Biologically Inspired Data Mining Techniques, Mobile Data Management, Mining, and Computing on Social Networks, Big Data Science and Engineering on E-Commerce, Cloud Service Discovery, MSMV-MBI, Scalable Dats Analytics, Data Mining and Decision Analytics for Public Health and Wellness, Algorithms for Large-Scale Information Processing in Knowledge Discovery, Data Mining in Social Networks, Data Mining in Biomedical informatics and Healthcare, Pattern Mining and Application of Big Data in conjunction with 18th Pacific-Asia Conference on Knowledge Discovery and Data Mining, PAKDD 2014, Tainan, Taiwan, 14-05-13. https://doi.org/10.1007/978-3-319-13186-3_25

Automatic self-suspended task for a mapreduce system on cloud computing. / Huang, Tzu Chi; Shieh, Ce-Kuen; Huang, Sheng Wei; Chiu, Chui Ming; Liang, Tyng Yeu.

Trends and Applications in Knowledge Discovery and Data Mining - PAKDD 2014 International Workshops: DANTH, BDM, MobiSocial, BigEC, CloudSD, MSMV-MBI, SDA, DMDA-Health, ALSIP, SocNet, DMBIH, BigPMA, Revised Selected Papers. ed. / Wen-Chih Peng; Haixun Wang; Zhi-Hua Zhou; Tu Bao Ho; Vincent S. Tseng; Arbee L.P. Chen; James Bailey. Springer Verlag, 2014. p. 257-268 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8643).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Automatic self-suspended task for a mapreduce system on cloud computing

AU - Huang, Tzu Chi

AU - Shieh, Ce-Kuen

AU - Huang, Sheng Wei

AU - Chiu, Chui Ming

AU - Liang, Tyng Yeu

PY - 2014/1/1

Y1 - 2014/1/1

N2 - A MapReduce system gradually becomes an essential technology to achieve the large scale computing on cloud computing. A MapReduce system currently is designed to distribute tasks over nodes in a cloud according to manual configurations of slot numbers in nodes. However, a MapReduce system may have the performance degradation due to the inappropriate configuration of the slot number, because the slot number can not exactly reflect the performance of the node. A MapReduce system can utilize the Automatic Self-Suspended Task (ASST) proposed in this paper to alleviate the performance degradation due to the inappropriate configuration of the slot number in a node on cloud computing. In experiments of this paper, a MapReduce system is proved to have a better performance with the help of ASST for various applications on cloud computing.

AB - A MapReduce system gradually becomes an essential technology to achieve the large scale computing on cloud computing. A MapReduce system currently is designed to distribute tasks over nodes in a cloud according to manual configurations of slot numbers in nodes. However, a MapReduce system may have the performance degradation due to the inappropriate configuration of the slot number, because the slot number can not exactly reflect the performance of the node. A MapReduce system can utilize the Automatic Self-Suspended Task (ASST) proposed in this paper to alleviate the performance degradation due to the inappropriate configuration of the slot number in a node on cloud computing. In experiments of this paper, a MapReduce system is proved to have a better performance with the help of ASST for various applications on cloud computing.

UR - http://www.scopus.com/inward/record.url?scp=84915798498&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84915798498&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-13186-3_25

DO - 10.1007/978-3-319-13186-3_25

M3 - Conference contribution

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 257

EP - 268

BT - Trends and Applications in Knowledge Discovery and Data Mining - PAKDD 2014 International Workshops

A2 - Peng, Wen-Chih

A2 - Wang, Haixun

A2 - Zhou, Zhi-Hua

A2 - Ho, Tu Bao

A2 - Tseng, Vincent S.

A2 - Chen, Arbee L.P.

A2 - Bailey, James

PB - Springer Verlag

ER -

Huang TC, Shieh C-K, Huang SW, Chiu CM, Liang TY. Automatic self-suspended task for a mapreduce system on cloud computing. In Peng W-C, Wang H, Zhou Z-H, Ho TB, Tseng VS, Chen ALP, Bailey J, editors, Trends and Applications in Knowledge Discovery and Data Mining - PAKDD 2014 International Workshops: DANTH, BDM, MobiSocial, BigEC, CloudSD, MSMV-MBI, SDA, DMDA-Health, ALSIP, SocNet, DMBIH, BigPMA, Revised Selected Papers. Springer Verlag. 2014. p. 257-268. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-13186-3_25