Practical cloud evaluation from a Nordic eScience user perspective
In this paper, we describe the findings of the NEON project - a cross-Nordic - Sweden, Norway, Denmark, Finland and Iceland - project evaluating the usefulness of private versus public cloud services for HPC users. Our findings are briefly that private cloud technology is not mature enough yet to pr...
Published in: | Proceedings of the 5th international workshop on Virtualization technologies in distributed computing - VTDC '11 |
---|---|
Main Authors: | , , , , , , , , , , |
Format: | Other Non-Article Part of Journal/Newspaper |
Language: | English |
Published: |
Association for Computing Machinery
2011
|
Subjects: | |
Online Access: | https://curis.ku.dk/portal/da/publications/practical-cloud-evaluation-from-a-nordic-escience-user-perspective(00652732-b1cd-48d3-83bd-bf9d828230d0).html https://doi.org/10.1145/1996121.1996129 |
id |
ftcopenhagenunip:oai:pure.atira.dk:publications/00652732-b1cd-48d3-83bd-bf9d828230d0 |
---|---|
record_format |
openpolar |
spelling |
ftcopenhagenunip:oai:pure.atira.dk:publications/00652732-b1cd-48d3-83bd-bf9d828230d0 2023-05-15T16:52:00+02:00 Practical cloud evaluation from a Nordic eScience user perspective Edlund, Åke Koopmans, Maarten Shah, Zeeshan Ali Livenson, Ilja Orellana, Frederik Kommeri, Jukka Tuisku, Miika Lehtovuori, Pekka Hansen, Klaus Marius Neukirchen, Helmut Hvannberg, Ebba 2011 https://curis.ku.dk/portal/da/publications/practical-cloud-evaluation-from-a-nordic-escience-user-perspective(00652732-b1cd-48d3-83bd-bf9d828230d0).html https://doi.org/10.1145/1996121.1996129 eng eng Association for Computing Machinery info:eu-repo/semantics/closedAccess Edlund , Å , Koopmans , M , Shah , Z A , Livenson , I , Orellana , F , Kommeri , J , Tuisku , M , Lehtovuori , P , Hansen , K M , Neukirchen , H & Hvannberg , E 2011 , Practical cloud evaluation from a Nordic eScience user perspective . in Proceedings of the 5th international workshop on Virtualization technologies in distributed computing . Association for Computing Machinery , pp. 29-37 , 5th International Workshop on Virtualization Technologies in Distributed Computing , San Jose , United States , 08/06/2011 . https://doi.org/10.1145/1996121.1996129 /dk/atira/pure/core/keywords/TheFacultyOfScience Faculty of Science computer contributionToPeriodical 2011 ftcopenhagenunip https://doi.org/10.1145/1996121.1996129 2021-09-23T17:56:53Z In this paper, we describe the findings of the NEON project - a cross-Nordic - Sweden, Norway, Denmark, Finland and Iceland - project evaluating the usefulness of private versus public cloud services for HPC users. Our findings are briefly that private cloud technology is not mature enough yet to provide a transparent user experience. It is expected that this will be the case mid 2012. The cost efficiency of both public and private cloud should be continuously monitored as there is a strong downward trend. This conclusion is supported by NEON experimenting as well as larger initiatives e.g. StratusLab reports. Public cloud technology is mature enough but lacks certain features that will be necessary to include cloud resources in a transparent manner in a national infrastructure like the Norwegian NOTUR (www.notur.no) case, e.g. with respect to quota management. These features are expected to emerge in 2011 via third party management software and in the best of breed public cloud services. Public clouds are competitive in the low end for non-HPC jobs (low memory, low number of cores) on price. A significant fraction (ca. 20%) of the jobs running on the current Nordic supercomputer infrastructure are potentially suitable for cloud-like technology. This holds in particular for singlethreaded or single-node jobs with small/medium memory requirements and non-intensive I/O. There is a backlog of real supercomputer jobs that suffers from the non-HPC jobs on the supercomputer infrastructure. Off-loading these non-HPC jobs to a public cloud would effectively add supercomputing capacity. Another finding is that available storage capacity is not accessible in a user-friendly way; most storage clouds are only accessible via programmable interfaces. A number of experiments and piloting are presented to support these claims. Other Non-Article Part of Journal/Newspaper Iceland University of Copenhagen: Research Norway Proceedings of the 5th international workshop on Virtualization technologies in distributed computing - VTDC '11 29 |
institution |
Open Polar |
collection |
University of Copenhagen: Research |
op_collection_id |
ftcopenhagenunip |
language |
English |
topic |
/dk/atira/pure/core/keywords/TheFacultyOfScience Faculty of Science computer |
spellingShingle |
/dk/atira/pure/core/keywords/TheFacultyOfScience Faculty of Science computer Edlund, Åke Koopmans, Maarten Shah, Zeeshan Ali Livenson, Ilja Orellana, Frederik Kommeri, Jukka Tuisku, Miika Lehtovuori, Pekka Hansen, Klaus Marius Neukirchen, Helmut Hvannberg, Ebba Practical cloud evaluation from a Nordic eScience user perspective |
topic_facet |
/dk/atira/pure/core/keywords/TheFacultyOfScience Faculty of Science computer |
description |
In this paper, we describe the findings of the NEON project - a cross-Nordic - Sweden, Norway, Denmark, Finland and Iceland - project evaluating the usefulness of private versus public cloud services for HPC users. Our findings are briefly that private cloud technology is not mature enough yet to provide a transparent user experience. It is expected that this will be the case mid 2012. The cost efficiency of both public and private cloud should be continuously monitored as there is a strong downward trend. This conclusion is supported by NEON experimenting as well as larger initiatives e.g. StratusLab reports. Public cloud technology is mature enough but lacks certain features that will be necessary to include cloud resources in a transparent manner in a national infrastructure like the Norwegian NOTUR (www.notur.no) case, e.g. with respect to quota management. These features are expected to emerge in 2011 via third party management software and in the best of breed public cloud services. Public clouds are competitive in the low end for non-HPC jobs (low memory, low number of cores) on price. A significant fraction (ca. 20%) of the jobs running on the current Nordic supercomputer infrastructure are potentially suitable for cloud-like technology. This holds in particular for singlethreaded or single-node jobs with small/medium memory requirements and non-intensive I/O. There is a backlog of real supercomputer jobs that suffers from the non-HPC jobs on the supercomputer infrastructure. Off-loading these non-HPC jobs to a public cloud would effectively add supercomputing capacity. Another finding is that available storage capacity is not accessible in a user-friendly way; most storage clouds are only accessible via programmable interfaces. A number of experiments and piloting are presented to support these claims. |
format |
Other Non-Article Part of Journal/Newspaper |
author |
Edlund, Åke Koopmans, Maarten Shah, Zeeshan Ali Livenson, Ilja Orellana, Frederik Kommeri, Jukka Tuisku, Miika Lehtovuori, Pekka Hansen, Klaus Marius Neukirchen, Helmut Hvannberg, Ebba |
author_facet |
Edlund, Åke Koopmans, Maarten Shah, Zeeshan Ali Livenson, Ilja Orellana, Frederik Kommeri, Jukka Tuisku, Miika Lehtovuori, Pekka Hansen, Klaus Marius Neukirchen, Helmut Hvannberg, Ebba |
author_sort |
Edlund, Åke |
title |
Practical cloud evaluation from a Nordic eScience user perspective |
title_short |
Practical cloud evaluation from a Nordic eScience user perspective |
title_full |
Practical cloud evaluation from a Nordic eScience user perspective |
title_fullStr |
Practical cloud evaluation from a Nordic eScience user perspective |
title_full_unstemmed |
Practical cloud evaluation from a Nordic eScience user perspective |
title_sort |
practical cloud evaluation from a nordic escience user perspective |
publisher |
Association for Computing Machinery |
publishDate |
2011 |
url |
https://curis.ku.dk/portal/da/publications/practical-cloud-evaluation-from-a-nordic-escience-user-perspective(00652732-b1cd-48d3-83bd-bf9d828230d0).html https://doi.org/10.1145/1996121.1996129 |
geographic |
Norway |
geographic_facet |
Norway |
genre |
Iceland |
genre_facet |
Iceland |
op_source |
Edlund , Å , Koopmans , M , Shah , Z A , Livenson , I , Orellana , F , Kommeri , J , Tuisku , M , Lehtovuori , P , Hansen , K M , Neukirchen , H & Hvannberg , E 2011 , Practical cloud evaluation from a Nordic eScience user perspective . in Proceedings of the 5th international workshop on Virtualization technologies in distributed computing . Association for Computing Machinery , pp. 29-37 , 5th International Workshop on Virtualization Technologies in Distributed Computing , San Jose , United States , 08/06/2011 . https://doi.org/10.1145/1996121.1996129 |
op_rights |
info:eu-repo/semantics/closedAccess |
op_doi |
https://doi.org/10.1145/1996121.1996129 |
container_title |
Proceedings of the 5th international workshop on Virtualization technologies in distributed computing - VTDC '11 |
container_start_page |
29 |
_version_ |
1766042127233449984 |