Mapping Tree-shaped Workflows on Memory-heterogeneous Architectures - ENS de Lyon - École normale supérieure de Lyon Accéder directement au contenu
Rapport (Rapport De Recherche) Année : 2022

Mapping Tree-shaped Workflows on Memory-heterogeneous Architectures

Placement de workflows de type arbre sur des architectures à mémoire hétérogène

Résumé

Directed acyclic graphs are commonly used to model scientific workflows, by expressing dependencies between tasks, as well as the resource requirements of the workflow. As a special case, rooted directed trees occur in several applications, for instance in sparse matrix computations. Since typical workflows are modeled by huge trees, it is crucial to schedule them efficiently, so that their execution time (or makespan) is minimized. Furthermore, it might be beneficial to distribute the execution on several compute nodes, hence increasing the available memory, and allowing us to parallelize parts of the execution. To exploit the heterogeneity of modern clusters in this context, we investigate the partitioning and mapping of tree-shaped workflows on target architectures where each processor can have a different memory size. Our three-step heuristic adapts and extends previous work for homogeneous clusters [Gou et al., TPDS 2020]. The changes we propose concern the assignment to processors (which considers the different memory sizes) and the availability of suitable processors when splitting or merging subtrees. We evaluate our approach with extensive simulations and demonstrate that exploiting the heterogeneity in the cluster reduces the makespan significantly compared to the state of the art for homogeneous memory.
Fichier principal
Vignette du fichier
RR-9458.pdf (775.76 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03581418 , version 1 (19-02-2022)

Identifiants

  • HAL Id : hal-03581418 , version 1

Citer

Svetlana Kulagina, Henning Meyerhenke, Anne Benoit. Mapping Tree-shaped Workflows on Memory-heterogeneous Architectures. [Research Report] RR-9458, Inria Grenoble Rhône-Alpes. 2022, pp.1-20. ⟨hal-03581418⟩
118 Consultations
128 Téléchargements

Partager

Gmail Facebook X LinkedIn More