Performance analysis using petri net based mapreduce model in heterogeneous clusters

Sheng Tzong Cheng, Hsi Chuan Wang, Yin Jun Chen, Chen Fei Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Currently, big data and large-scale data processing techniques has become an important developing area. MapReduce is an enabling technology of cloud computing. Hadoop is one of the most popular MapReduce implementation, which is the target platform in this paper. When running a MapReduce job, programmers however cannot acquire the information about how to finetune the parameters of application. Moreover, programmers need much time on finding the most suitable parameters. This paper evaluates execution processes in MapReduce and form SPN-MR model with Stochastic Petri Net. In order to analyze the performance of SPN-MR, formulas of mean delay time in each time transition are defined. SPN-MR simulates the elapsed time of any MapReduce jobs with known input data sizes and then reduces time cost in performance tuning. SPN-MR carried out several actual test benchmarks. The results showed the average error rate is within 5 percent. Therefore, it can provide effective performance evaluation reports for MapReduce programmers.

Original languageEnglish
Title of host publicationAdvances in Web-Based Learning - ICWL 2013 Workshops - USL 2013, IWSLL 2013, KMEL 2013, IWCWL 2013, WIL 2013, and IWEEC 2013, Revised Selected Papers
EditorsQing Li, Rynson Lau, Dickson K.W. Chiu, Timothy K. Shih, Chu-Sing Yang, Elvira Popescu, Minhong Wang, Demetrios G. Sampson
PublisherSpringer Verlag
Pages170-179
Number of pages10
ISBN (Electronic)9783662463147
DOIs
Publication statusPublished - 2015
Event12th International Conference on Web-Based Learning, ICWL 2013, held with 1st International Workshop on Ubiquitous Social Learning, USL 2013, International Workshop on Smart Living and Learning, IWSLL 2013, International Workshop on Cloud Computing for Web-Based Learning, IWCWL 2013, International Workshop on Web Intelligence and Learning, WIL 2013, International Workshop on E-book and Education Cloud, IWEEC 2013 and 3rd International Symposium on Knowledge Management and E-Learning, KMEL 2013 - Kenting, Taiwan
Duration: 2013 Oct 62013 Oct 9

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume8390
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other12th International Conference on Web-Based Learning, ICWL 2013, held with 1st International Workshop on Ubiquitous Social Learning, USL 2013, International Workshop on Smart Living and Learning, IWSLL 2013, International Workshop on Cloud Computing for Web-Based Learning, IWCWL 2013, International Workshop on Web Intelligence and Learning, WIL 2013, International Workshop on E-book and Education Cloud, IWEEC 2013 and 3rd International Symposium on Knowledge Management and E-Learning, KMEL 2013
Country/TerritoryTaiwan
CityKenting
Period13-10-0613-10-09

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'Performance analysis using petri net based mapreduce model in heterogeneous clusters'. Together they form a unique fingerprint.

Cite this