CURT MapReduce: Caching and utilizing results of tasks for mapreduce on cloud computing

Tzu Chi Huang, Kuo Chih Chu, Xue Yan Zeng, Jhe Ru Chen, Ce Kuen Shieh

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

When cloud computing works for applications such as iterative applications, geographic map rendering applications, and news or URL ranking applications in order to process big data with MapReduce, it has many chances to process duplicate or similar datasets appearing in input data or intermediate data. Since processing duplicate datasets wastes many resources in clouds, cloud computing can be enhanced by the proposed CURT MapReduce system, i.e. a MapReduce system capable of caching and utilizing results of tasks, in order to avoid overheads of executing tasks to process duplicate datasets. According to real experiment observations of GREP, Radix Sort and Word Count in this paper, cloud computing gets great performance improvement from the help of the CURT MapReduce system in comparison to the native MapReduce system.

Original languageEnglish
Title of host publicationProceedings - 2016 IEEE 2nd International Conference on Multimedia Big Data, BigMM 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages149-154
Number of pages6
ISBN (Electronic)9781509021789
DOIs
Publication statusPublished - 2016 Aug 16
Event2nd IEEE International Conference on Multimedia Big Data, BigMM 2016 - Taipei, Taiwan
Duration: 2016 Apr 202016 Apr 22

Publication series

NameProceedings - 2016 IEEE 2nd International Conference on Multimedia Big Data, BigMM 2016

Other

Other2nd IEEE International Conference on Multimedia Big Data, BigMM 2016
Country/TerritoryTaiwan
CityTaipei
Period16-04-2016-04-22

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Information Systems
  • Media Technology

Fingerprint

Dive into the research topics of 'CURT MapReduce: Caching and utilizing results of tasks for mapreduce on cloud computing'. Together they form a unique fingerprint.

Cite this