The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events
International audience The ATLAS EventIndex system comprises the catalogue of all events collected, processed or generated by the ATLAS experiment at the CERN LHC accelerator, and all associated software tools to collect, store and query this information. ATLAS records several billion particle inter...
Published in: | Computing and Software for Big Science |
---|---|
Main Authors: | , , , , , , , , , , , , , , , , , , , , , , , , |
Other Authors: | , |
Format: | Article in Journal/Newspaper |
Language: | English |
Published: |
HAL CCSD
2023
|
Subjects: | |
Online Access: | https://hal.science/hal-03877874 https://doi.org/10.1007/s41781-023-00096-8 |
id |
ftccsdartic:oai:HAL:hal-03877874v1 |
---|---|
record_format |
openpolar |
spelling |
ftccsdartic:oai:HAL:hal-03877874v1 2023-06-18T03:43:20+02:00 The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events Barberis, Dario Alexandrov, Igor Alexandrov, Evgeny Baranowski, Zbigniew Canali, Luca Cherepanova, Elizaveta Dimitrov, Gancho Favareto, Andrea Fernández Casaní, Álvaro Gallas, Elizabeth Montoro, Carlos García González de la Hoz, Santiago Hřivnáč, Julius Iakovlev, Alexander Kazymov, Andrei Mineev, Mikhail Prokoshin, Fedor Rybkin, Grigori Salt, José Sánchez, Javier Sorokoletov, Roman Többicke, Rainer Vasileva, Petya Villaplana Perez, Miguel Yuan, Ruijun Laboratoire de Physique des 2 Infinis Irène Joliot-Curie (IJCLab) Institut National de Physique Nucléaire et de Physique des Particules du CNRS (IN2P3)-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS) 2023 https://hal.science/hal-03877874 https://doi.org/10.1007/s41781-023-00096-8 en eng HAL CCSD info:eu-repo/semantics/altIdentifier/arxiv/2211.08293 info:eu-repo/semantics/altIdentifier/doi/10.1007/s41781-023-00096-8 hal-03877874 https://hal.science/hal-03877874 ARXIV: 2211.08293 doi:10.1007/s41781-023-00096-8 INSPIRE: 2182387 Comput.Softw.Big Sci. https://hal.science/hal-03877874 Comput.Softw.Big Sci., 2023, 7 (1), pp.2. ⟨10.1007/s41781-023-00096-8⟩ particle interaction ATLAS accelerator CERN Lab programming tracks CERN LHC Coll [INFO]Computer Science [cs] [PHYS.HEXP]Physics [physics]/High Energy Physics - Experiment [hep-ex] info:eu-repo/semantics/article Journal articles 2023 ftccsdartic https://doi.org/10.1007/s41781-023-00096-8 2023-06-04T00:22:15Z International audience The ATLAS EventIndex system comprises the catalogue of all events collected, processed or generated by the ATLAS experiment at the CERN LHC accelerator, and all associated software tools to collect, store and query this information. ATLAS records several billion particle interactions every year of operation, processes them for analysis and generates even larger simulated data samples; a global catalogue is needed to keep track of the location of each event record and be able to search and retrieve specific events for in-depth investigations. Each EventIndex record includes summary information on the event itself and the pointers to the files containing the full event. Most components of the EventIndex system are implemented using BigData open-source tools. This paper describes the architectural choices and their evolution in time, as well as the past, current and foreseen future implementations of all EventIndex components. Article in Journal/Newspaper The Pointers Archive ouverte HAL (Hyper Article en Ligne, CCSD - Centre pour la Communication Scientifique Directe) Computing and Software for Big Science 7 1 |
institution |
Open Polar |
collection |
Archive ouverte HAL (Hyper Article en Ligne, CCSD - Centre pour la Communication Scientifique Directe) |
op_collection_id |
ftccsdartic |
language |
English |
topic |
particle interaction ATLAS accelerator CERN Lab programming tracks CERN LHC Coll [INFO]Computer Science [cs] [PHYS.HEXP]Physics [physics]/High Energy Physics - Experiment [hep-ex] |
spellingShingle |
particle interaction ATLAS accelerator CERN Lab programming tracks CERN LHC Coll [INFO]Computer Science [cs] [PHYS.HEXP]Physics [physics]/High Energy Physics - Experiment [hep-ex] Barberis, Dario Alexandrov, Igor Alexandrov, Evgeny Baranowski, Zbigniew Canali, Luca Cherepanova, Elizaveta Dimitrov, Gancho Favareto, Andrea Fernández Casaní, Álvaro Gallas, Elizabeth Montoro, Carlos García González de la Hoz, Santiago Hřivnáč, Julius Iakovlev, Alexander Kazymov, Andrei Mineev, Mikhail Prokoshin, Fedor Rybkin, Grigori Salt, José Sánchez, Javier Sorokoletov, Roman Többicke, Rainer Vasileva, Petya Villaplana Perez, Miguel Yuan, Ruijun The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events |
topic_facet |
particle interaction ATLAS accelerator CERN Lab programming tracks CERN LHC Coll [INFO]Computer Science [cs] [PHYS.HEXP]Physics [physics]/High Energy Physics - Experiment [hep-ex] |
description |
International audience The ATLAS EventIndex system comprises the catalogue of all events collected, processed or generated by the ATLAS experiment at the CERN LHC accelerator, and all associated software tools to collect, store and query this information. ATLAS records several billion particle interactions every year of operation, processes them for analysis and generates even larger simulated data samples; a global catalogue is needed to keep track of the location of each event record and be able to search and retrieve specific events for in-depth investigations. Each EventIndex record includes summary information on the event itself and the pointers to the files containing the full event. Most components of the EventIndex system are implemented using BigData open-source tools. This paper describes the architectural choices and their evolution in time, as well as the past, current and foreseen future implementations of all EventIndex components. |
author2 |
Laboratoire de Physique des 2 Infinis Irène Joliot-Curie (IJCLab) Institut National de Physique Nucléaire et de Physique des Particules du CNRS (IN2P3)-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS) |
format |
Article in Journal/Newspaper |
author |
Barberis, Dario Alexandrov, Igor Alexandrov, Evgeny Baranowski, Zbigniew Canali, Luca Cherepanova, Elizaveta Dimitrov, Gancho Favareto, Andrea Fernández Casaní, Álvaro Gallas, Elizabeth Montoro, Carlos García González de la Hoz, Santiago Hřivnáč, Julius Iakovlev, Alexander Kazymov, Andrei Mineev, Mikhail Prokoshin, Fedor Rybkin, Grigori Salt, José Sánchez, Javier Sorokoletov, Roman Többicke, Rainer Vasileva, Petya Villaplana Perez, Miguel Yuan, Ruijun |
author_facet |
Barberis, Dario Alexandrov, Igor Alexandrov, Evgeny Baranowski, Zbigniew Canali, Luca Cherepanova, Elizaveta Dimitrov, Gancho Favareto, Andrea Fernández Casaní, Álvaro Gallas, Elizabeth Montoro, Carlos García González de la Hoz, Santiago Hřivnáč, Julius Iakovlev, Alexander Kazymov, Andrei Mineev, Mikhail Prokoshin, Fedor Rybkin, Grigori Salt, José Sánchez, Javier Sorokoletov, Roman Többicke, Rainer Vasileva, Petya Villaplana Perez, Miguel Yuan, Ruijun |
author_sort |
Barberis, Dario |
title |
The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events |
title_short |
The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events |
title_full |
The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events |
title_fullStr |
The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events |
title_full_unstemmed |
The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events |
title_sort |
atlas eventindex: a bigdata catalogue for all atlas experiment events |
publisher |
HAL CCSD |
publishDate |
2023 |
url |
https://hal.science/hal-03877874 https://doi.org/10.1007/s41781-023-00096-8 |
genre |
The Pointers |
genre_facet |
The Pointers |
op_source |
Comput.Softw.Big Sci. https://hal.science/hal-03877874 Comput.Softw.Big Sci., 2023, 7 (1), pp.2. ⟨10.1007/s41781-023-00096-8⟩ |
op_relation |
info:eu-repo/semantics/altIdentifier/arxiv/2211.08293 info:eu-repo/semantics/altIdentifier/doi/10.1007/s41781-023-00096-8 hal-03877874 https://hal.science/hal-03877874 ARXIV: 2211.08293 doi:10.1007/s41781-023-00096-8 INSPIRE: 2182387 |
op_doi |
https://doi.org/10.1007/s41781-023-00096-8 |
container_title |
Computing and Software for Big Science |
container_volume |
7 |
container_issue |
1 |
_version_ |
1769009673324724224 |