The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events

International audience The ATLAS EventIndex system comprises the catalogue of all events collected, processed or generated by the ATLAS experiment at the CERN LHC accelerator, and all associated software tools to collect, store and query this information. ATLAS records several billion particle inter...

Full description

Bibliographic Details
Published in:Computing and Software for Big Science
Main Authors: Barberis, Dario, Alexandrov, Igor, Alexandrov, Evgeny, Baranowski, Zbigniew, Canali, Luca, Cherepanova, Elizaveta, Dimitrov, Gancho, Favareto, Andrea, Fernández Casaní, Álvaro, Gallas, Elizabeth, Montoro, Carlos García, González de la Hoz, Santiago, Hřivnáč, Julius, Iakovlev, Alexander, Kazymov, Andrei, Mineev, Mikhail, Prokoshin, Fedor, Rybkin, Grigori, Salt, José, Sánchez, Javier, Sorokoletov, Roman, Többicke, Rainer, Vasileva, Petya, Villaplana Perez, Miguel, Yuan, Ruijun
Other Authors: Laboratoire de Physique des 2 Infinis Irène Joliot-Curie (IJCLab), Institut National de Physique Nucléaire et de Physique des Particules du CNRS (IN2P3)-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)
Format: Article in Journal/Newspaper
Language:English
Published: HAL CCSD 2023
Subjects:
Online Access:https://hal.science/hal-03877874
https://doi.org/10.1007/s41781-023-00096-8
id ftuniparissaclay:oai:HAL:hal-03877874v1
record_format openpolar
spelling ftuniparissaclay:oai:HAL:hal-03877874v1 2024-09-15T18:39:02+00:00 The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events Barberis, Dario Alexandrov, Igor Alexandrov, Evgeny Baranowski, Zbigniew Canali, Luca Cherepanova, Elizaveta Dimitrov, Gancho Favareto, Andrea Fernández Casaní, Álvaro Gallas, Elizabeth Montoro, Carlos García González de la Hoz, Santiago Hřivnáč, Julius Iakovlev, Alexander Kazymov, Andrei Mineev, Mikhail Prokoshin, Fedor Rybkin, Grigori Salt, José Sánchez, Javier Sorokoletov, Roman Többicke, Rainer Vasileva, Petya Villaplana Perez, Miguel Yuan, Ruijun Laboratoire de Physique des 2 Infinis Irène Joliot-Curie (IJCLab) Institut National de Physique Nucléaire et de Physique des Particules du CNRS (IN2P3)-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS) 2023 https://hal.science/hal-03877874 https://doi.org/10.1007/s41781-023-00096-8 en eng HAL CCSD Springer info:eu-repo/semantics/altIdentifier/arxiv/2211.08293 info:eu-repo/semantics/altIdentifier/doi/10.1007/s41781-023-00096-8 hal-03877874 https://hal.science/hal-03877874 ARXIV: 2211.08293 doi:10.1007/s41781-023-00096-8 INSPIRE: 2182387 ISSN: 2510-2036 EISSN: 2510-2044 Computing and Software for Big Science https://hal.science/hal-03877874 Computing and Software for Big Science, 2023, 7 (1), pp.2. ⟨10.1007/s41781-023-00096-8⟩ particle interaction ATLAS accelerator CERN Lab programming tracks CERN LHC Coll [INFO]Computer Science [cs] [PHYS.HEXP]Physics [physics]/High Energy Physics - Experiment [hep-ex] info:eu-repo/semantics/article Journal articles 2023 ftuniparissaclay https://doi.org/10.1007/s41781-023-00096-8 2024-08-30T01:48:52Z International audience The ATLAS EventIndex system comprises the catalogue of all events collected, processed or generated by the ATLAS experiment at the CERN LHC accelerator, and all associated software tools to collect, store and query this information. ATLAS records several billion particle interactions every year of operation, processes them for analysis and generates even larger simulated data samples; a global catalogue is needed to keep track of the location of each event record and be able to search and retrieve specific events for in-depth investigations. Each EventIndex record includes summary information on the event itself and the pointers to the files containing the full event. Most components of the EventIndex system are implemented using BigData open-source tools. This paper describes the architectural choices and their evolution in time, as well as the past, current and foreseen future implementations of all EventIndex components. Article in Journal/Newspaper The Pointers Archives ouvertes de Paris-Saclay Computing and Software for Big Science 7 1
institution Open Polar
collection Archives ouvertes de Paris-Saclay
op_collection_id ftuniparissaclay
language English
topic particle
interaction
ATLAS
accelerator
CERN Lab
programming
tracks
CERN LHC Coll
[INFO]Computer Science [cs]
[PHYS.HEXP]Physics [physics]/High Energy Physics - Experiment [hep-ex]
spellingShingle particle
interaction
ATLAS
accelerator
CERN Lab
programming
tracks
CERN LHC Coll
[INFO]Computer Science [cs]
[PHYS.HEXP]Physics [physics]/High Energy Physics - Experiment [hep-ex]
Barberis, Dario
Alexandrov, Igor
Alexandrov, Evgeny
Baranowski, Zbigniew
Canali, Luca
Cherepanova, Elizaveta
Dimitrov, Gancho
Favareto, Andrea
Fernández Casaní, Álvaro
Gallas, Elizabeth
Montoro, Carlos García
González de la Hoz, Santiago
Hřivnáč, Julius
Iakovlev, Alexander
Kazymov, Andrei
Mineev, Mikhail
Prokoshin, Fedor
Rybkin, Grigori
Salt, José
Sánchez, Javier
Sorokoletov, Roman
Többicke, Rainer
Vasileva, Petya
Villaplana Perez, Miguel
Yuan, Ruijun
The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events
topic_facet particle
interaction
ATLAS
accelerator
CERN Lab
programming
tracks
CERN LHC Coll
[INFO]Computer Science [cs]
[PHYS.HEXP]Physics [physics]/High Energy Physics - Experiment [hep-ex]
description International audience The ATLAS EventIndex system comprises the catalogue of all events collected, processed or generated by the ATLAS experiment at the CERN LHC accelerator, and all associated software tools to collect, store and query this information. ATLAS records several billion particle interactions every year of operation, processes them for analysis and generates even larger simulated data samples; a global catalogue is needed to keep track of the location of each event record and be able to search and retrieve specific events for in-depth investigations. Each EventIndex record includes summary information on the event itself and the pointers to the files containing the full event. Most components of the EventIndex system are implemented using BigData open-source tools. This paper describes the architectural choices and their evolution in time, as well as the past, current and foreseen future implementations of all EventIndex components.
author2 Laboratoire de Physique des 2 Infinis Irène Joliot-Curie (IJCLab)
Institut National de Physique Nucléaire et de Physique des Particules du CNRS (IN2P3)-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)
format Article in Journal/Newspaper
author Barberis, Dario
Alexandrov, Igor
Alexandrov, Evgeny
Baranowski, Zbigniew
Canali, Luca
Cherepanova, Elizaveta
Dimitrov, Gancho
Favareto, Andrea
Fernández Casaní, Álvaro
Gallas, Elizabeth
Montoro, Carlos García
González de la Hoz, Santiago
Hřivnáč, Julius
Iakovlev, Alexander
Kazymov, Andrei
Mineev, Mikhail
Prokoshin, Fedor
Rybkin, Grigori
Salt, José
Sánchez, Javier
Sorokoletov, Roman
Többicke, Rainer
Vasileva, Petya
Villaplana Perez, Miguel
Yuan, Ruijun
author_facet Barberis, Dario
Alexandrov, Igor
Alexandrov, Evgeny
Baranowski, Zbigniew
Canali, Luca
Cherepanova, Elizaveta
Dimitrov, Gancho
Favareto, Andrea
Fernández Casaní, Álvaro
Gallas, Elizabeth
Montoro, Carlos García
González de la Hoz, Santiago
Hřivnáč, Julius
Iakovlev, Alexander
Kazymov, Andrei
Mineev, Mikhail
Prokoshin, Fedor
Rybkin, Grigori
Salt, José
Sánchez, Javier
Sorokoletov, Roman
Többicke, Rainer
Vasileva, Petya
Villaplana Perez, Miguel
Yuan, Ruijun
author_sort Barberis, Dario
title The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events
title_short The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events
title_full The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events
title_fullStr The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events
title_full_unstemmed The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events
title_sort atlas eventindex: a bigdata catalogue for all atlas experiment events
publisher HAL CCSD
publishDate 2023
url https://hal.science/hal-03877874
https://doi.org/10.1007/s41781-023-00096-8
genre The Pointers
genre_facet The Pointers
op_source ISSN: 2510-2036
EISSN: 2510-2044
Computing and Software for Big Science
https://hal.science/hal-03877874
Computing and Software for Big Science, 2023, 7 (1), pp.2. ⟨10.1007/s41781-023-00096-8⟩
op_relation info:eu-repo/semantics/altIdentifier/arxiv/2211.08293
info:eu-repo/semantics/altIdentifier/doi/10.1007/s41781-023-00096-8
hal-03877874
https://hal.science/hal-03877874
ARXIV: 2211.08293
doi:10.1007/s41781-023-00096-8
INSPIRE: 2182387
op_doi https://doi.org/10.1007/s41781-023-00096-8
container_title Computing and Software for Big Science
container_volume 7
container_issue 1
_version_ 1810483428458496000