Performance analysis using petri net based mapreduce model in heterogeneous clusters

Sheng Tzong Cheng, Hsi Chuan Wang, Yin Jun Chen, Chen Fei Chen

研究成果: Conference contribution

1 引文 斯高帕斯(Scopus)

摘要

Currently, big data and large-scale data processing techniques has become an important developing area. MapReduce is an enabling technology of cloud computing. Hadoop is one of the most popular MapReduce implementation, which is the target platform in this paper. When running a MapReduce job, programmers however cannot acquire the information about how to finetune the parameters of application. Moreover, programmers need much time on finding the most suitable parameters. This paper evaluates execution processes in MapReduce and form SPN-MR model with Stochastic Petri Net. In order to analyze the performance of SPN-MR, formulas of mean delay time in each time transition are defined. SPN-MR simulates the elapsed time of any MapReduce jobs with known input data sizes and then reduces time cost in performance tuning. SPN-MR carried out several actual test benchmarks. The results showed the average error rate is within 5 percent. Therefore, it can provide effective performance evaluation reports for MapReduce programmers.

原文English
主出版物標題Advances in Web-Based Learning - ICWL 2013 Workshops - USL 2013, IWSLL 2013, KMEL 2013, IWCWL 2013, WIL 2013, and IWEEC 2013, Revised Selected Papers
編輯Qing Li, Rynson Lau, Dickson K.W. Chiu, Timothy K. Shih, Chu-Sing Yang, Elvira Popescu, Minhong Wang, Demetrios G. Sampson
發行者Springer Verlag
頁面170-179
頁數10
ISBN(電子)9783662463147
DOIs
出版狀態Published - 2015 一月 1
事件12th International Conference on Web-Based Learning, ICWL 2013, held with 1st International Workshop on Ubiquitous Social Learning, USL 2013, International Workshop on Smart Living and Learning, IWSLL 2013, International Workshop on Cloud Computing for Web-Based Learning, IWCWL 2013, International Workshop on Web Intelligence and Learning, WIL 2013, International Workshop on E-book and Education Cloud, IWEEC 2013 and 3rd International Symposium on Knowledge Management and E-Learning, KMEL 2013 - Kenting, Taiwan
持續時間: 2013 十月 62013 十月 9

出版系列

名字Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
8390
ISSN(列印)0302-9743
ISSN(電子)1611-3349

Other

Other12th International Conference on Web-Based Learning, ICWL 2013, held with 1st International Workshop on Ubiquitous Social Learning, USL 2013, International Workshop on Smart Living and Learning, IWSLL 2013, International Workshop on Cloud Computing for Web-Based Learning, IWCWL 2013, International Workshop on Web Intelligence and Learning, WIL 2013, International Workshop on E-book and Education Cloud, IWEEC 2013 and 3rd International Symposium on Knowledge Management and E-Learning, KMEL 2013
國家Taiwan
城市Kenting
期間13-10-0613-10-09

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

指紋 深入研究「Performance analysis using petri net based mapreduce model in heterogeneous clusters」主題。共同形成了獨特的指紋。

引用此