IceCube File Catalog

IceCube is a cubic kilometer neutrino detector located at the south pole. Metadata for files in IceCube have traditionally been handled on an application by application basis, with no user-facing access. There has been no unified view of data files, and users often query the filesystem to locate fil...

Full description

Bibliographic Details
Published in:EPJ Web of Conferences
Main Authors: Brik Vladimir, Meade Patrick, Merino Gonzalo, Oertlin Jan, Schultz David, Skarlupka Heath
Format: Article in Journal/Newspaper
Language:English
Published: EDP Sciences 2019
Subjects:
Online Access:https://doi.org/10.1051/epjconf/201921404055
https://doaj.org/article/4673fa2aa7514411832992ff68951b4c
Description
Summary:IceCube is a cubic kilometer neutrino detector located at the south pole. Metadata for files in IceCube have traditionally been handled on an application by application basis, with no user-facing access. There has been no unified view of data files, and users often query the filesystem to locate files. Recently effort has been put into creating a unified view in a central metadata catalog. Going for a simple solution, we created a userfacing REST API backed by a NoSQL database. All major data producers add their metadata to this central catalog. Schema generation is identified as an important aspect of multi-application metadata services.