Providing caches for reduce tasks in a MapReduce cloud

Tzu Chi Huang, Kuo Chih Chu, Jhe Ru Chen, Xue Yan Zeng, Ce Kuen Shieh

研究成果: Conference contribution

2 引文 斯高帕斯(Scopus)

摘要

A MapReduce cloud is the key to the success of cloud computing nowadays by the capability of processing large datasets simultaneously on nodes in a cloud. However, a MapReduce cloud may waste many CPU resources to frequently process similar intermediate data in its Reduce tasks because specific intermediate data is always moved to specific Slave nodes. A MapReduce cloud can utilize the proposed idea of supporting the cache mechanism for Reduce tasks to avoid unnecessary computation. In experiments, a MapReduce cloud is proved to get great performance improvement from the help of the cache mechanism when running CPU-intensive applications. Accordingly, a MapReduce cloud can be justified to have the extension of the cache mechanism proposed in this paper.

原文English
主出版物標題Proceedings of 2016 IEEE International Conference on Big Data Analysis, ICBDA 2016
發行者Institute of Electrical and Electronics Engineers Inc.
ISBN(電子)9781467395908
DOIs
出版狀態Published - 2016 7月 12
事件2016 IEEE International Conference on Big Data Analysis, ICBDA 2016 - Hangzhou, China
持續時間: 2016 3月 122016 3月 14

出版系列

名字Proceedings of 2016 IEEE International Conference on Big Data Analysis, ICBDA 2016

Other

Other2016 IEEE International Conference on Big Data Analysis, ICBDA 2016
國家/地區China
城市Hangzhou
期間16-03-1216-03-14

All Science Journal Classification (ASJC) codes

  • 電腦網路與通信
  • 電腦科學應用
  • 資訊系統
  • 資訊系統與管理

指紋

深入研究「Providing caches for reduce tasks in a MapReduce cloud」主題。共同形成了獨特的指紋。

引用此