Hi:
What would be the optimal rank to node mapping that would maximize on-node, in memory, communication vs off-node communication? It's easy to figure out a good mapping for intra-domain communication as the processor grid is rectangular. But the inter-domain communication pattern is likely more complex: many-to-few or few-to-many depending on the way the information flows between domains (coarser to finer or finer to coarser).
Any advice would be appreciated. Thank you!
What would be the optimal rank to node mapping that would maximize on-node, in memory, communication vs off-node communication? It's easy to figure out a good mapping for intra-domain communication as the processor grid is rectangular. But the inter-domain communication pattern is likely more complex: many-to-few or few-to-many depending on the way the information flows between domains (coarser to finer or finer to coarser).
Any advice would be appreciated. Thank you!