Mapping Functions and Data Redistribution for Parallel Files Articles
Overview
published in
- JOURNAL OF SUPERCOMPUTING Journal
publication date
- December 2008
start page
- 213
end page
- 236
issue
- 3
volume
- 46
Digital Object Identifier (DOI)
International Standard Serial Number (ISSN)
- 0920-8542
Electronic International Standard Serial Number (EISSN)
- 1573-0484
abstract
- Data distribution in memory or on disks is an important factor influencing the performance of parallel applications. On the other hand, programs or systems, like a parallel file system, frequently redistribute data between memory and disks. This paper presents a generalization of previous approaches of the redistribution problem. We introduce algorithms for mapping between two arbitrary distributions of a data set. The algorithms are optimized for multidimensional array partitions. We motivate our approach and present potential utilizations. The paper also presents a case study, the employment of mapping functions, and redistribution algorithms in a parallel file system.[NĂºmero especial dedicado a: High Performance Scientific and Engineering Computing]