Variable-sized map and locality-aware reduce on public-resource grids

Po Cheng Chen, Yen Liang Su, Jyh Biau Chang, Ce Kuen Shieh

研究成果: Conference contribution

5 引文 斯高帕斯(Scopus)

摘要

This paper presents a grid-enabled MapReduce framework called "Ussop". Ussop provides its users with a set of C-language based MapReduce APIs and an efficient runtime system for exploiting the computing resources available on public-resource grids. Considering the volatility nature of the grid environment, Ussop introduces two novel task scheduling algorithms, namely: Variable-Sized Map Scheduling (VSMS) and Locality-Aware Reduce Scheduling (LARS). VSMS dynamically adjusts the size of the map tasks according to the computing power of grid nodes. Moreover, LARS minimizes the data transfer cost of exchanging the intermediate data over a wide-area network. The experimental results indicate that both VSMS and LARS achieved superior performance than the conventional scheduling algorithms.

原文English
主出版物標題Advances in Grid and Pervasive Computing - 5th International Conference, GPC 2010, Proceedings
頁面234-243
頁數10
DOIs
出版狀態Published - 2010 6月 25
事件5th International Conference on Advances in Grid and Pervasive Computing, GPC 2010 - Hualien, Taiwan
持續時間: 2010 5月 102010 5月 13

出版系列

名字Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
6104 LNCS
ISSN(列印)0302-9743
ISSN(電子)1611-3349

Other

Other5th International Conference on Advances in Grid and Pervasive Computing, GPC 2010
國家/地區Taiwan
城市Hualien
期間10-05-1010-05-13

All Science Journal Classification (ASJC) codes

  • 理論電腦科學
  • 一般電腦科學

指紋

深入研究「Variable-sized map and locality-aware reduce on public-resource grids」主題。共同形成了獨特的指紋。

引用此