---
# System prepended metadata

title: DUNE DAQ cvmfs repo
tags: [DAQ, sysadmin, artdaq, protoDUNE]

---

# DUNE DAQ cvmfs repo
###### tags: `DAQ` `protoDUNE` `sysadmin` `artdaq`

## Discussion with Fermilab CVMFS experts

* Talked to Dave Dykstra on 1/17;
* Size of all Fermilab hosted repos is ~4.5TB on a 16TB disk; 4.5TB can be further shrunk by removing the deleted files;
* When publishing files to CVMFS repo:
	* Go to a Fermilab publisher node;
	* Files will be be transfered to OSG's stratum1 server;
	* Once files are in OSG's stratum1, Fermilab and other sites stratum1 server will get the updates;
	* OSG's stratum1 has three ports server different kind of clients:
		* 8000 for other stratum1 servers;
		* 8001 for cvmfs clients;
		* 8002 for special stratum1 servers, e.g. those on HPC sites, and possibly DUNE's stratum1 for FD DAQ in the future;
* There is no overhead of setting up a separate repo in cvmfs;
* Main consideration of having DAQ repo together with offline would be how the dedicated stratum1 server for DUNE FD DAQ will be set up and if the software from offline repo is needed by DAQ;
* Decide to start with having DUNE DAQ repo in `/cvmfs/dune.opensciencegrid.org` with offline; but have them in a self-contained directory so that they can easily move out to a separate repo if necessary;
* Plan to have DUNE UPS products and artdaq in cvmfs.



## Publish DAQ software to DUNE CVMFS repo

## Manuals

* [Here](https://cvmfs.readthedocs.io/en/stable/) is the official documentation;
* [Relevant instructions](https://cvmfs.readthedocs.io/en/stable/cpt-repository-gateway.html) about repository gateway and publishers.

## Procedures

* login to `oasiscfs.fnal.gov` as `cvmfsdune`;
* refer to scripts under `~/bin` for:
	* check (`dune-check`)
	* delete (`dune-rm`)
	* publish (`dune-sync`, and `dunedaq-sync`)
	* tag and rollback (`dune-tags`)
	* split (`dune-split`) 
 * add directories to `.cvmfsdirtab`, generated by `dune-sync`; this script only needs to be run once after the change;
 * obtain valid kerberos ticket for `dingpf@FNAL.GOV`;
 * made `dunedaq-sync` which rsyncs staging area from `docker-bd.fnal.gov:/home/dingpf/cvmfs_dune`, and run the transaction.
