Mapping Functions and Data Redistribution for Parallel Files Articles uri icon

authors

  • ISAILA, FLORIN DANIEL
  • TICHY, WALTER F

publication date

  • December 2008

start page

  • 213

end page

  • 236

issue

  • 3

volume

  • 46

International Standard Serial Number (ISSN)

  • 0920-8542

Electronic International Standard Serial Number (EISSN)

  • 1573-0484

abstract

  • Data distribution in memory or on disks is an important factor influencing the performance of parallel applications. On the other hand, programs or systems, like a parallel file system, frequently redistribute data between memory and disks. This paper presents a generalization of previous approaches of the redistribution problem. We introduce algorithms for mapping between two arbitrary distributions of a data set. The algorithms are optimized for multidimensional array partitions. We motivate our approach and present potential utilizations. The paper also presents a case study, the employment of mapping functions, and redistribution algorithms in a parallel file system.[Número especial dedicado a: High Performance Scientific and Engineering Computing]