Skip to content

Datasets in flight

Steven Timm edited this page Feb 24, 2025 · 10 revisions

Introduction

This page is meant to track the various datasets that data management is tracking on their way to tape that are not fully there yet. This will be for quick status in the DUNE Data Management meeting

Raw data

Iceberg--have metadata on files , need to get ingestd working to read iceberg01

2x2 are likely to run some light injection runs but we don't know when exactly.

Trigger primitives from hd-protodune are all on tape but do they still need to be on disk?
protodune conveners say yes, they will eventually analyze them. open to a plan where all are not on disk at once.

Pending Merges

hd-protodune-det-reco (Jake). Done fardet-LE (Aaron). Samples 1 and 2 merged, sample 6, 7 will eventually need to be merged samples 3-5,8-10 done but need rules to get them on to tape.

Completed productions

fardet hd/vd 2023:

Have to hadd these files to make them big enough.. Heidi's script should work.

Mostly-completed productions

PDSPProd4a 0.5 GeV (Jake) Completed and merged but not on tape yet.

Productions in flight

fardet LE production See above.

User datasets

Pantelis Melis

TMS stuff at NERSC--Steve in contact with Michael Dolce have given him instructions on how to make metadata. Tammy says there may be another set of files out there other than these.