A Linear Algebra Framework for Static High Performance Fortran Code Distribution

Issue title: High Performance Fortran Comes of Age

Article type: Research Article

Authors: ANCOURT, CORINNE | COELHO, FABIEN | IRIGOIN, FRANÇOIS | KERYELL, RONAN

Affiliations: Centre de Recherche en Informatique, École Nationale Supérieure des Mines de Paris, 35, rue Saint-Honoré, F-77305 Fontainebleau cedex, France; e-mail: [email protected]

Abstract: High Performance Fortran (HPF) was developed to support data parallel programming for single-instruction multiple-data (SIMD) and multiple-instruction multiple-data (MIMD) machines with distributed memory. The programmer is provided a familiar uniform logical address space and specifies the data distribution by directives. The compiler then exploits these directives to allocate arrays in the local memories, to assign computations to elementary processors, and to migrate data between processors when required. We show here that linear algebra is a powerful framework to encode HPF directives and to synthesize distributed code with space-efficient array allocation, tight loop bounds, and vectorized communications for INDEPENDENT loops. The generated code includes traditional optimizations such as guard elimination, message vectorization and aggregation, and overlap analysis. The systematic use of an affine framework makes it possible to prove the compilation scheme correct.

Journal: Scientific Programming, vol. 6, no. 1, pp. 3-27, 1997