Towards a coherent Data Life Cycle in Astroparticle Physics
Abstract The German-Russian Astroparticle Data Life Cycle Initiative (GRADLCI) aims to develop a data life cycle (DLC), namely a clearly defined and maximally automated data processing pipeline for a combined analysis of data from the experiment KASCADE-Grande (Karlsruhe, Germany) and experiments in...
Published in: | Journal of Physics: Conference Series |
---|---|
Main Authors: | , , , , , , |
Format: | Article in Journal/Newspaper |
Language: | unknown |
Published: |
IOP Publishing
2020
|
Subjects: | |
Online Access: | http://dx.doi.org/10.1088/1742-6596/1525/1/012070 https://iopscience.iop.org/article/10.1088/1742-6596/1525/1/012070/pdf https://iopscience.iop.org/article/10.1088/1742-6596/1525/1/012070 |
id |
crioppubl:10.1088/1742-6596/1525/1/012070 |
---|---|
record_format |
openpolar |
spelling |
crioppubl:10.1088/1742-6596/1525/1/012070 2024-06-02T08:15:09+00:00 Towards a coherent Data Life Cycle in Astroparticle Physics Tokareva, V Haungs, A Kang, D Kostunin, D Polgart, F Wochele, D Wochele, J 2020 http://dx.doi.org/10.1088/1742-6596/1525/1/012070 https://iopscience.iop.org/article/10.1088/1742-6596/1525/1/012070/pdf https://iopscience.iop.org/article/10.1088/1742-6596/1525/1/012070 unknown IOP Publishing http://creativecommons.org/licenses/by/3.0/ https://iopscience.iop.org/info/page/text-and-data-mining Journal of Physics: Conference Series volume 1525, issue 1, page 012070 ISSN 1742-6588 1742-6596 journal-article 2020 crioppubl https://doi.org/10.1088/1742-6596/1525/1/012070 2024-05-07T14:02:59Z Abstract The German-Russian Astroparticle Data Life Cycle Initiative (GRADLCI) aims to develop a data life cycle (DLC), namely a clearly defined and maximally automated data processing pipeline for a combined analysis of data from the experiment KASCADE-Grande (Karlsruhe, Germany) and experiments installed at the Tunka Valley in Russia (TAIGA). The important features of such an astroparticle DLC include scalability for handling large amounts of data, heterogeneous data integration, and exploiting parallel and distributed computing at every possible stage of the data processing. In this work we provide an overview of the technical challenges and solutions worked out so far by the GRADLCI group in the framework of a far-reaching analysis and data center. We will touch the peculiarities of data management in astroparticle physics and employing distributed computing for simulations and physics analyses in this field. Article in Journal/Newspaper taiga IOP Publishing Journal of Physics: Conference Series 1525 1 012070 |
institution |
Open Polar |
collection |
IOP Publishing |
op_collection_id |
crioppubl |
language |
unknown |
description |
Abstract The German-Russian Astroparticle Data Life Cycle Initiative (GRADLCI) aims to develop a data life cycle (DLC), namely a clearly defined and maximally automated data processing pipeline for a combined analysis of data from the experiment KASCADE-Grande (Karlsruhe, Germany) and experiments installed at the Tunka Valley in Russia (TAIGA). The important features of such an astroparticle DLC include scalability for handling large amounts of data, heterogeneous data integration, and exploiting parallel and distributed computing at every possible stage of the data processing. In this work we provide an overview of the technical challenges and solutions worked out so far by the GRADLCI group in the framework of a far-reaching analysis and data center. We will touch the peculiarities of data management in astroparticle physics and employing distributed computing for simulations and physics analyses in this field. |
format |
Article in Journal/Newspaper |
author |
Tokareva, V Haungs, A Kang, D Kostunin, D Polgart, F Wochele, D Wochele, J |
spellingShingle |
Tokareva, V Haungs, A Kang, D Kostunin, D Polgart, F Wochele, D Wochele, J Towards a coherent Data Life Cycle in Astroparticle Physics |
author_facet |
Tokareva, V Haungs, A Kang, D Kostunin, D Polgart, F Wochele, D Wochele, J |
author_sort |
Tokareva, V |
title |
Towards a coherent Data Life Cycle in Astroparticle Physics |
title_short |
Towards a coherent Data Life Cycle in Astroparticle Physics |
title_full |
Towards a coherent Data Life Cycle in Astroparticle Physics |
title_fullStr |
Towards a coherent Data Life Cycle in Astroparticle Physics |
title_full_unstemmed |
Towards a coherent Data Life Cycle in Astroparticle Physics |
title_sort |
towards a coherent data life cycle in astroparticle physics |
publisher |
IOP Publishing |
publishDate |
2020 |
url |
http://dx.doi.org/10.1088/1742-6596/1525/1/012070 https://iopscience.iop.org/article/10.1088/1742-6596/1525/1/012070/pdf https://iopscience.iop.org/article/10.1088/1742-6596/1525/1/012070 |
genre |
taiga |
genre_facet |
taiga |
op_source |
Journal of Physics: Conference Series volume 1525, issue 1, page 012070 ISSN 1742-6588 1742-6596 |
op_rights |
http://creativecommons.org/licenses/by/3.0/ https://iopscience.iop.org/info/page/text-and-data-mining |
op_doi |
https://doi.org/10.1088/1742-6596/1525/1/012070 |
container_title |
Journal of Physics: Conference Series |
container_volume |
1525 |
container_issue |
1 |
container_start_page |
012070 |
_version_ |
1800739253126168576 |