Reducing file-related network traffic in TreadMarks via parallel file input/output

Ce Kuen Shieh, Su Cheong Mac, Bor Jyh Shieh

Research output: Contribution to journalArticlepeer-review

Abstract

In this paper, we describe the implementation of a parallel file I/O system on TreadMarks, a page-based software Distributed Shared Memory (DSM) system built on a network of workstations. The main goal of our parallel file I/O system is to reduce file-related network traffic in TreadMarks. This prototype employs our previously proposed variable data distribution scheme, which distributes the file blocks among the nodes according to the application's access pattern, and delayed file access mechanism, which delays the transfer of a requested file block across the network until the block is actually used during computation. Currently, our parallel file I/O system is combined into the user-level library of TreadMarks, with minor modification of TreadMarks' code. Due to our UNIX-like interface, the existing TreadMarks programs require very little modifications. The performance improvement of our prototype on Successive Over Relaxation is quite satisfactory while that on Matrix Multiplication is less significant.

Original languageEnglish
Pages (from-to)569-583
Number of pages15
JournalJournal of Information Science and Engineering
Volume15
Issue number4
Publication statusPublished - 1999 Jul

All Science Journal Classification (ASJC) codes

  • Software
  • Human-Computer Interaction
  • Hardware and Architecture
  • Library and Information Sciences
  • Computational Theory and Mathematics

Fingerprint

Dive into the research topics of 'Reducing file-related network traffic in TreadMarks via parallel file input/output'. Together they form a unique fingerprint.

Cite this