Tape Archive
NHR PERM
The tape archive is available for NHR users.
It is mounted at /mnt/snfs-hpc-hsm with a symlink from /perm.
The tape archive is using the StorNext Shared Storage File System from Quantum.
It has a HDD cache (which is the capacity displayed by df), and the data from the cache is then written to a large library of magnetic tapes that can grow to multiple PiB.
This data store is very reliable and can be used as a short-term archive over the lifetime of your project. For long term archival (10 years) of scientific results (e.g. to follow the rules for good scientific practice) please download the data to your home institution instead or transfer to the GWDG Archive (AHOME) if you are a member of an eligible institution. Opening a file can take several minutes because of the very high latency of a tape library.
GWDG Archive (AHOME)
Members of the following institutions:
- Georg-August-University of Göttingen
- Universitätsmedizin Göttingen (UMG)
- Max-Planck Gesellschaft (MPG)
- Deutsches Primatenzentrum (DPZ)
- Gesellschaft für wissenschaftliche Datenverarbeitung mbH Göttingen (GWDG)
have access to the GWDG Archive (AHOME) under the Academic Cloud username associated with their institutional account. It is not accessible from the regular HPC compute or login nodes, but there are dedicated frontend nodes that can be used to transfer data between this location and the HPC filesystems. See Using non-HPC Storage from GWDG for more information.
Usage
For reasons of efficiency and performance, small files and/or complex directory structures should not be transferred to the archive directly. Please aggregate your data into compressed tarballs or other archive containers with a maximum size of 5.5 TiB before copying your data to the archive. For large data, a good target size is 1-2 TiB per file because such files will usually not be split across more than one tape.