Providing caches for reduce tasks in a MapReduce cloud

Tzu Chi Huang, Kuo Chih Chu, Jhe Ru Chen, Xue Yan Zeng, Ce Kuen Shieh

研究成果: Conference contribution

1 引文 斯高帕斯(Scopus)

摘要

A MapReduce cloud is the key to the success of cloud computing nowadays by the capability of processing large datasets simultaneously on nodes in a cloud. However, a MapReduce cloud may waste many CPU resources to frequently process similar intermediate data in its Reduce tasks because specific intermediate data is always moved to specific Slave nodes. A MapReduce cloud can utilize the proposed idea of supporting the cache mechanism for Reduce tasks to avoid unnecessary computation. In experiments, a MapReduce cloud is proved to get great performance improvement from the help of the cache mechanism when running CPU-intensive applications. Accordingly, a MapReduce cloud can be justified to have the extension of the cache mechanism proposed in this paper.

原文English
主出版物標題Proceedings of 2016 IEEE International Conference on Big Data Analysis, ICBDA 2016
發行者Institute of Electrical and Electronics Engineers Inc.
ISBN(電子)9781467395908
DOIs
出版狀態Published - 2016 七月 12
事件2016 IEEE International Conference on Big Data Analysis, ICBDA 2016 - Hangzhou, China
持續時間: 2016 三月 122016 三月 14

出版系列

名字Proceedings of 2016 IEEE International Conference on Big Data Analysis, ICBDA 2016

Other

Other2016 IEEE International Conference on Big Data Analysis, ICBDA 2016
國家China
城市Hangzhou
期間16-03-1216-03-14

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Computer Science Applications
  • Information Systems
  • Information Systems and Management

指紋 深入研究「Providing caches for reduce tasks in a MapReduce cloud」主題。共同形成了獨特的指紋。

  • 引用此

    Huang, T. C., Chu, K. C., Chen, J. R., Zeng, X. Y., & Shieh, C. K. (2016). Providing caches for reduce tasks in a MapReduce cloud. 於 Proceedings of 2016 IEEE International Conference on Big Data Analysis, ICBDA 2016 [7509834] (Proceedings of 2016 IEEE International Conference on Big Data Analysis, ICBDA 2016). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICBDA.2016.7509834