Sensitivity of Parallel Applications to Large Differences in Bandwidth and Latency in Two-Layer Interconnects
This paper studies application performance on systems with strongly non-uniform remote memory access. In current generation NUMAs the speed difference between the slowest and fastest link in an interconnect---the "NUMA gap"---is typically less than an order of magnitude, and many conventio...
Main Authors: | , , , |
---|---|
Other Authors: | |
Format: | Text |
Language: | English |
Published: |
1999
|
Subjects: | |
Online Access: | http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.35.7495 http://www.cs.vu.nl/~kielmann/papers/fgcs00.ps.gz |
id |
ftciteseerx:oai:CiteSeerX.psu:10.1.1.35.7495 |
---|---|
record_format |
openpolar |
spelling |
ftciteseerx:oai:CiteSeerX.psu:10.1.1.35.7495 2023-05-15T17:53:46+02:00 Sensitivity of Parallel Applications to Large Differences in Bandwidth and Latency in Two-Layer Interconnects Aske Plaat Henri E. Bal Rutger F. H. Hofman Thilo Kielmann The Pennsylvania State University CiteSeerX Archives 1999 application/postscript http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.35.7495 http://www.cs.vu.nl/~kielmann/papers/fgcs00.ps.gz en eng http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.35.7495 http://www.cs.vu.nl/~kielmann/papers/fgcs00.ps.gz Metadata may be used without restrictions as long as the oai identifier remains attached to it. http://www.cs.vu.nl/~kielmann/papers/fgcs00.ps.gz wide-area networks application sensitivity cluster computing Orca text 1999 ftciteseerx 2016-01-08T00:18:03Z This paper studies application performance on systems with strongly non-uniform remote memory access. In current generation NUMAs the speed difference between the slowest and fastest link in an interconnect---the "NUMA gap"---is typically less than an order of magnitude, and many conventional parallel programs achieve good performance. We study how different NUMA gaps influence application performance, up to and including typical wide-area latencies and bandwidths. We find that for gaps larger than those of current generation NUMAs, performance suffers considerably (for applications that were designed for a uniform access interconnect). For many applications, however, performance can be greatly improved with comparatively simple changes: traffic over slow links can be reduced by making communication patterns hierarchical---like the interconnect. We find that in four out of our six applications the size of the gap can be increased by an order of magnitude or more without severel. Text Orca Unknown |
institution |
Open Polar |
collection |
Unknown |
op_collection_id |
ftciteseerx |
language |
English |
topic |
wide-area networks application sensitivity cluster computing Orca |
spellingShingle |
wide-area networks application sensitivity cluster computing Orca Aske Plaat Henri E. Bal Rutger F. H. Hofman Thilo Kielmann Sensitivity of Parallel Applications to Large Differences in Bandwidth and Latency in Two-Layer Interconnects |
topic_facet |
wide-area networks application sensitivity cluster computing Orca |
description |
This paper studies application performance on systems with strongly non-uniform remote memory access. In current generation NUMAs the speed difference between the slowest and fastest link in an interconnect---the "NUMA gap"---is typically less than an order of magnitude, and many conventional parallel programs achieve good performance. We study how different NUMA gaps influence application performance, up to and including typical wide-area latencies and bandwidths. We find that for gaps larger than those of current generation NUMAs, performance suffers considerably (for applications that were designed for a uniform access interconnect). For many applications, however, performance can be greatly improved with comparatively simple changes: traffic over slow links can be reduced by making communication patterns hierarchical---like the interconnect. We find that in four out of our six applications the size of the gap can be increased by an order of magnitude or more without severel. |
author2 |
The Pennsylvania State University CiteSeerX Archives |
format |
Text |
author |
Aske Plaat Henri E. Bal Rutger F. H. Hofman Thilo Kielmann |
author_facet |
Aske Plaat Henri E. Bal Rutger F. H. Hofman Thilo Kielmann |
author_sort |
Aske Plaat |
title |
Sensitivity of Parallel Applications to Large Differences in Bandwidth and Latency in Two-Layer Interconnects |
title_short |
Sensitivity of Parallel Applications to Large Differences in Bandwidth and Latency in Two-Layer Interconnects |
title_full |
Sensitivity of Parallel Applications to Large Differences in Bandwidth and Latency in Two-Layer Interconnects |
title_fullStr |
Sensitivity of Parallel Applications to Large Differences in Bandwidth and Latency in Two-Layer Interconnects |
title_full_unstemmed |
Sensitivity of Parallel Applications to Large Differences in Bandwidth and Latency in Two-Layer Interconnects |
title_sort |
sensitivity of parallel applications to large differences in bandwidth and latency in two-layer interconnects |
publishDate |
1999 |
url |
http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.35.7495 http://www.cs.vu.nl/~kielmann/papers/fgcs00.ps.gz |
genre |
Orca |
genre_facet |
Orca |
op_source |
http://www.cs.vu.nl/~kielmann/papers/fgcs00.ps.gz |
op_relation |
http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.35.7495 http://www.cs.vu.nl/~kielmann/papers/fgcs00.ps.gz |
op_rights |
Metadata may be used without restrictions as long as the oai identifier remains attached to it. |
_version_ |
1766161470869995520 |