IceCube File Catalog
IceCube is a cubic kilometer neutrino detector located at the south pole. Metadata for files in IceCube have traditionally been handled on an application by application basis, with no user-facing access. There has been no unified view of data files, and users often query the filesystem to locate fil...
Published in: | EPJ Web of Conferences |
---|---|
Main Authors: | , , , , , |
Format: | Article in Journal/Newspaper |
Language: | English |
Published: |
EDP Sciences
2019
|
Subjects: | |
Online Access: | https://doi.org/10.1051/epjconf/201921404055 https://doaj.org/article/4673fa2aa7514411832992ff68951b4c |
id |
ftdoajarticles:oai:doaj.org/article:4673fa2aa7514411832992ff68951b4c |
---|---|
record_format |
openpolar |
spelling |
ftdoajarticles:oai:doaj.org/article:4673fa2aa7514411832992ff68951b4c 2023-05-15T18:22:07+02:00 IceCube File Catalog Brik Vladimir Meade Patrick Merino Gonzalo Oertlin Jan Schultz David Skarlupka Heath 2019-01-01T00:00:00Z https://doi.org/10.1051/epjconf/201921404055 https://doaj.org/article/4673fa2aa7514411832992ff68951b4c EN eng EDP Sciences https://www.epj-conferences.org/articles/epjconf/pdf/2019/19/epjconf_chep2018_04055.pdf https://doaj.org/toc/2100-014X 2100-014X doi:10.1051/epjconf/201921404055 https://doaj.org/article/4673fa2aa7514411832992ff68951b4c EPJ Web of Conferences, Vol 214, p 04055 (2019) Physics QC1-999 article 2019 ftdoajarticles https://doi.org/10.1051/epjconf/201921404055 2022-12-31T07:58:49Z IceCube is a cubic kilometer neutrino detector located at the south pole. Metadata for files in IceCube have traditionally been handled on an application by application basis, with no user-facing access. There has been no unified view of data files, and users often query the filesystem to locate files. Recently effort has been put into creating a unified view in a central metadata catalog. Going for a simple solution, we created a userfacing REST API backed by a NoSQL database. All major data producers add their metadata to this central catalog. Schema generation is identified as an important aspect of multi-application metadata services. Article in Journal/Newspaper South pole Directory of Open Access Journals: DOAJ Articles South Pole EPJ Web of Conferences 214 04055 |
institution |
Open Polar |
collection |
Directory of Open Access Journals: DOAJ Articles |
op_collection_id |
ftdoajarticles |
language |
English |
topic |
Physics QC1-999 |
spellingShingle |
Physics QC1-999 Brik Vladimir Meade Patrick Merino Gonzalo Oertlin Jan Schultz David Skarlupka Heath IceCube File Catalog |
topic_facet |
Physics QC1-999 |
description |
IceCube is a cubic kilometer neutrino detector located at the south pole. Metadata for files in IceCube have traditionally been handled on an application by application basis, with no user-facing access. There has been no unified view of data files, and users often query the filesystem to locate files. Recently effort has been put into creating a unified view in a central metadata catalog. Going for a simple solution, we created a userfacing REST API backed by a NoSQL database. All major data producers add their metadata to this central catalog. Schema generation is identified as an important aspect of multi-application metadata services. |
format |
Article in Journal/Newspaper |
author |
Brik Vladimir Meade Patrick Merino Gonzalo Oertlin Jan Schultz David Skarlupka Heath |
author_facet |
Brik Vladimir Meade Patrick Merino Gonzalo Oertlin Jan Schultz David Skarlupka Heath |
author_sort |
Brik Vladimir |
title |
IceCube File Catalog |
title_short |
IceCube File Catalog |
title_full |
IceCube File Catalog |
title_fullStr |
IceCube File Catalog |
title_full_unstemmed |
IceCube File Catalog |
title_sort |
icecube file catalog |
publisher |
EDP Sciences |
publishDate |
2019 |
url |
https://doi.org/10.1051/epjconf/201921404055 https://doaj.org/article/4673fa2aa7514411832992ff68951b4c |
geographic |
South Pole |
geographic_facet |
South Pole |
genre |
South pole |
genre_facet |
South pole |
op_source |
EPJ Web of Conferences, Vol 214, p 04055 (2019) |
op_relation |
https://www.epj-conferences.org/articles/epjconf/pdf/2019/19/epjconf_chep2018_04055.pdf https://doaj.org/toc/2100-014X 2100-014X doi:10.1051/epjconf/201921404055 https://doaj.org/article/4673fa2aa7514411832992ff68951b4c |
op_doi |
https://doi.org/10.1051/epjconf/201921404055 |
container_title |
EPJ Web of Conferences |
container_volume |
214 |
container_start_page |
04055 |
_version_ |
1766201472931856384 |