Skip to content

Full Transfer Process

Jump to bottom
Katie mason edited this page Mar 29, 2021 · 16 revisions

Welcome to the singularity-xrootd wiki! This wiki will walk through each step of transferring files from Fermilab to tufts and getting them ready to use.

Summary

These instructions have the specific case of members of the Tufts group in mind when providing example instructions. We use the meitner machine here to build the containers. A similar process will work on any local computer. For first time users setting up pre-reqs, contact [Taritree.Wongjirad@tufts.edu] for assistance setting up accounts. For assistance on most other steps, contact [katie.mason@tufts.edu]. For assistance specifically merging large file sets, contact [Joshua.Mills@tufts.edu].

pre-reqs

  • account with sudo access on the meitner machine - or other machine with singularity (v 2.7)
  • account on the Tufts-grid
  • a FNAL account

Steps

Each step has been given its own page

  1. Pre-stage the data set (FNAL)

  2. Make the pathlist file (FNAL)

  3. Setup certificates (FNAL)

  4. Create singularity container (meitner)

  5. Setup on Tufts and Transfer Files (Tufts)

  6. Merge the files (Tufts)

  7. Get the POT of transferred files (FNAL)

  8. Data Management (Tufts)

    a. Remove or decide to preserve individual files

    b. Clean up Transfer directory

    c. Move merged files to SharePoint

Clone this wiki locally