Memory-mapped file approach for on-demand data co-allocation on grids

Po Cheng Chen, Jyh Biau Chang, Yi Chang Zhuang, Ce-Kuen Shieh, Tyng Yeu Liangd

研究成果: Conference contribution

1 引文 斯高帕斯(Scopus)

摘要

Grid data sharing systems usually provide a dataintensive application with either a pre-staging mechanism or an on-demand access mechanism to access shared data. Pre-staging systems simultaneously download an entire shared file from multiple data sources even when only a tiny file fragment is required. Such systems consume unnecessary data transmission time and storage space. On-demand access systems, on the other hand, download only the required fragments from a single data source. Such systems unfortunately do not fully exploit available network bandwidth. This paper presents a data sharing system, designated as the OnDemand data Co-Allocation (ODCA). ODCA facilitates an unmodified legacy applications to transparently access shared data by using native I/O system calls. ODCA transfers only the necessary fragments on user demand, thereby reducing data transmission time, avoiding wasted network bandwidth and wasted storage space. Moreover, ODCA reduces data waiting time by downloading the file fragments from multiple data sources. Experimental results show ODCA successfully reduces turnaround time in dataintensive applications.

原文English
主出版物標題2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGRID 2009
頁面300-307
頁數8
DOIs
出版狀態Published - 2009 十月 13
事件2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGRID 2009 - Shanghai, China
持續時間: 2009 五月 182009 五月 21

出版系列

名字2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGRID 2009

Other

Other2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGRID 2009
國家/地區China
城市Shanghai
期間09-05-1809-05-21

All Science Journal Classification (ASJC) codes

  • 電腦科學應用
  • 軟體

指紋

深入研究「Memory-mapped file approach for on-demand data co-allocation on grids」主題。共同形成了獨特的指紋。

引用此