IceCube File Catalog

IceCube is a cubic kilometer neutrino detector located at the south pole. Metadata for files in IceCube have traditionally been handled on an application by application basis, with no user-facing access. There has been no unified view of data files, and users often query the filesystem to locate fil...

Full description

Bibliographic Details
Published in:EPJ Web of Conferences
Main Authors: Brik Vladimir, Meade Patrick, Merino Gonzalo, Oertlin Jan, Schultz David, Skarlupka Heath
Format: Article in Journal/Newspaper
Language:English
Published: EDP Sciences 2019
Subjects:
Online Access:https://doi.org/10.1051/epjconf/201921404055
https://doaj.org/article/4673fa2aa7514411832992ff68951b4c
id ftdoajarticles:oai:doaj.org/article:4673fa2aa7514411832992ff68951b4c
record_format openpolar
spelling ftdoajarticles:oai:doaj.org/article:4673fa2aa7514411832992ff68951b4c 2023-05-15T18:22:07+02:00 IceCube File Catalog Brik Vladimir Meade Patrick Merino Gonzalo Oertlin Jan Schultz David Skarlupka Heath 2019-01-01T00:00:00Z https://doi.org/10.1051/epjconf/201921404055 https://doaj.org/article/4673fa2aa7514411832992ff68951b4c EN eng EDP Sciences https://www.epj-conferences.org/articles/epjconf/pdf/2019/19/epjconf_chep2018_04055.pdf https://doaj.org/toc/2100-014X 2100-014X doi:10.1051/epjconf/201921404055 https://doaj.org/article/4673fa2aa7514411832992ff68951b4c EPJ Web of Conferences, Vol 214, p 04055 (2019) Physics QC1-999 article 2019 ftdoajarticles https://doi.org/10.1051/epjconf/201921404055 2022-12-31T07:58:49Z IceCube is a cubic kilometer neutrino detector located at the south pole. Metadata for files in IceCube have traditionally been handled on an application by application basis, with no user-facing access. There has been no unified view of data files, and users often query the filesystem to locate files. Recently effort has been put into creating a unified view in a central metadata catalog. Going for a simple solution, we created a userfacing REST API backed by a NoSQL database. All major data producers add their metadata to this central catalog. Schema generation is identified as an important aspect of multi-application metadata services. Article in Journal/Newspaper South pole Directory of Open Access Journals: DOAJ Articles South Pole EPJ Web of Conferences 214 04055
institution Open Polar
collection Directory of Open Access Journals: DOAJ Articles
op_collection_id ftdoajarticles
language English
topic Physics
QC1-999
spellingShingle Physics
QC1-999
Brik Vladimir
Meade Patrick
Merino Gonzalo
Oertlin Jan
Schultz David
Skarlupka Heath
IceCube File Catalog
topic_facet Physics
QC1-999
description IceCube is a cubic kilometer neutrino detector located at the south pole. Metadata for files in IceCube have traditionally been handled on an application by application basis, with no user-facing access. There has been no unified view of data files, and users often query the filesystem to locate files. Recently effort has been put into creating a unified view in a central metadata catalog. Going for a simple solution, we created a userfacing REST API backed by a NoSQL database. All major data producers add their metadata to this central catalog. Schema generation is identified as an important aspect of multi-application metadata services.
format Article in Journal/Newspaper
author Brik Vladimir
Meade Patrick
Merino Gonzalo
Oertlin Jan
Schultz David
Skarlupka Heath
author_facet Brik Vladimir
Meade Patrick
Merino Gonzalo
Oertlin Jan
Schultz David
Skarlupka Heath
author_sort Brik Vladimir
title IceCube File Catalog
title_short IceCube File Catalog
title_full IceCube File Catalog
title_fullStr IceCube File Catalog
title_full_unstemmed IceCube File Catalog
title_sort icecube file catalog
publisher EDP Sciences
publishDate 2019
url https://doi.org/10.1051/epjconf/201921404055
https://doaj.org/article/4673fa2aa7514411832992ff68951b4c
geographic South Pole
geographic_facet South Pole
genre South pole
genre_facet South pole
op_source EPJ Web of Conferences, Vol 214, p 04055 (2019)
op_relation https://www.epj-conferences.org/articles/epjconf/pdf/2019/19/epjconf_chep2018_04055.pdf
https://doaj.org/toc/2100-014X
2100-014X
doi:10.1051/epjconf/201921404055
https://doaj.org/article/4673fa2aa7514411832992ff68951b4c
op_doi https://doi.org/10.1051/epjconf/201921404055
container_title EPJ Web of Conferences
container_volume 214
container_start_page 04055
_version_ 1766201472931856384