CURT MapReduce: Caching and utilizing results of tasks for mapreduce on cloud computing

Tzu Chi Huang, Kuo Chih Chu, Xue Yan Zeng, Jhe Ru Chen, Ce Kuen Shieh

研究成果: Conference contribution

1 引文 斯高帕斯(Scopus)

摘要

When cloud computing works for applications such as iterative applications, geographic map rendering applications, and news or URL ranking applications in order to process big data with MapReduce, it has many chances to process duplicate or similar datasets appearing in input data or intermediate data. Since processing duplicate datasets wastes many resources in clouds, cloud computing can be enhanced by the proposed CURT MapReduce system, i.e. a MapReduce system capable of caching and utilizing results of tasks, in order to avoid overheads of executing tasks to process duplicate datasets. According to real experiment observations of GREP, Radix Sort and Word Count in this paper, cloud computing gets great performance improvement from the help of the CURT MapReduce system in comparison to the native MapReduce system.

原文English
主出版物標題Proceedings - 2016 IEEE 2nd International Conference on Multimedia Big Data, BigMM 2016
發行者Institute of Electrical and Electronics Engineers Inc.
頁面149-154
頁數6
ISBN(電子)9781509021789
DOIs
出版狀態Published - 2016 8月 16
事件2nd IEEE International Conference on Multimedia Big Data, BigMM 2016 - Taipei, Taiwan
持續時間: 2016 4月 202016 4月 22

出版系列

名字Proceedings - 2016 IEEE 2nd International Conference on Multimedia Big Data, BigMM 2016

Other

Other2nd IEEE International Conference on Multimedia Big Data, BigMM 2016
國家/地區Taiwan
城市Taipei
期間16-04-2016-04-22

All Science Journal Classification (ASJC) codes

  • 訊號處理
  • 資訊系統
  • 媒體技術

指紋

深入研究「CURT MapReduce: Caching and utilizing results of tasks for mapreduce on cloud computing」主題。共同形成了獨特的指紋。

引用此