Skip to content

Datasets in flight

Steven Timm edited this page Jan 21, 2025 · 6 revisions

Introduction

This page is meant to track the various datasets that data management is tracking on their way to tape that are not fully there yet. This will be for quick status in the DUNE Data Management meeting

Raw data

Iceberg--have metadata on files , need to get ingestd working to read iceberg01

Trigger primitives from hd-protodune are all on tape but do they still need to be on disk? pending query to CRAB

Pending Merges

hd-protodune-det-reco (Jake). Almost done just a few more files fardet-LE (Aaron). Samples 1 and 2 merged, sample 3 doesn't need to be merged

Completed productions

fardet hd/vd 2023:

still have reco2_ana.root files on disk, will we merge? Per Dom Brailsford we should save these files, waiting on him to determine if we should try to merge or tar.

Mostly-completed productions

hd-protodune-det-reco keepup

Have to merge ntuples and put them to tape

Productions in flight

fardet LE production

User datasets

Pantelis Melis

TMS stuff at NERSC--Steve in contact with Michael Dolce have given him instructions on how to make metadata. Tammy says there may be another set of files out there other than these.