Skip to content

Location of key ProtoDUNE Data Management Services

Steven Timm edited this page Jun 22, 2024 · 3 revisions

Ingest daemons

protodune-ingestd-np02.cern.ch:

This one currently set to look at all /data areas of np04-srv-001 and np04-srv-005
Dumps data to /eos/experiment/neutplatform/protodune/dune/dropbox/np02 Local URL visible only from CERN http://protodune-ingestd-np02.cern.ch:8086/ingest-daemon-np02/ Within Fermilab VPN and at CERN can be accessed http://protodune-gw.cern.ch:8080/ingest-daemon-np02/ Despite its name, almost all of the NP04 beam data is coming through np04-srv-005 so we expect this ingest daemon to be the more used one of the two.

protodune-ingestd-np04.cern.ch:

This one currently set to look at all the main data areas np04-srv-002 through np04-srv-004, /data? top level directories.
Currently dumps data to /eos/experiment/neutplatform/protodune/dune/dropbox/np02. local URL visible only from CERN http://protodune-ingestd-np04.cern.ch:8094/ingest-daemon-np04/

Within Fermilab VPN can be accessed http://protodune-gw.cern.ch:8080/ingest-daemon-np04/ (this is the NGINX server)

Via ssh tunnel from offsite cern/fermilab ssh -l lxplus.cern.ch -L 8080:protodune-gw.cern.ch:8080 then http://127.0.0.1:8080/ingest-daemon-np04

Declaration daemons

protodune-declad-np02.cern.ch:

Reading the /eos/experiment/neutplatform/protodune/dune/dropbox/np02 directory.

At CERN can be accessed directly http://protodune-declad-np02.cern.ch:8091/declad-np02/ on Fermi VPN can be accessed http://protodune-gw.cern.ch:8080/declad-np02/ anywhere else via ssh tunnel as above http://127.0.0.1:8080/declad-np02/

protodune-declad-np04.cern.ch:

Reading the /eos/experiment/neutplatform/protodune/dune/test/dropbox directory. which is the place where all the dress rehearsal data is coming.

At CERN can be accessed directly http://protodune-declad-np04.cern.ch:8089/declad-np04/ on Fermi VPN (and at CERN) can be accessed http://protodune-gw.cern.ch:8080/declad-np04/ anywhere else via ssh tunnel as above http://127.0.0.1:8080/declad-np04/

MetaCat

https://metacat.fnal.gov:9443/dune_meta_prod/app/gui much more documentation at https://metacat.readthedocs.io

Rucio

rucio_host = https://dune-rucio.fnal.gov

Internal rucio monitoring https://landscape.fnal.gov/monitor/d/ngBq2aQmk/rucio-internal?orgId=1&from=now-6M&to=now&var-deployment=rucio_dune_okd