IceProd - a dataset management system for IceCube: update

IceCube is a cubic kilometer neutrino detector located at the south pole. IceProd is IceCube’s internal dataset management system, keeping track of where, when, and how jobs run. It schedules jobs from submitted datasets to HTCondor, keeping track of them at every stage of the lifecycle. Many update...

Full description

Bibliographic Details
Published in:EPJ Web of Conferences
Main Authors: Schultz David, Díaz Vélez Juan Carlos
Format: Article in Journal/Newspaper
Language:English
Published: EDP Sciences 2019
Subjects:
Online Access:https://doi.org/10.1051/epjconf/201921403058
https://doaj.org/article/165b3a8e432948a9bb34752d53a1d15a
Description
Summary:IceCube is a cubic kilometer neutrino detector located at the south pole. IceProd is IceCube’s internal dataset management system, keeping track of where, when, and how jobs run. It schedules jobs from submitted datasets to HTCondor, keeping track of them at every stage of the lifecycle. Many updates have happened in the last years to improve stability and scalability, as well as increase user access. Along the way, the IceProd codebase switched from Python 2 to Python 3.