Swestore (iRODS)

Location

You can find your project here /snic.se/projects/

Warning

Files are NOT backed up, but all files do have a off-site replica at another SNIC site.

Swestore (iRODS) is a national, distributed, robust, flexible and expandable system aimed at storing large amounts of data produced by various Swedish research projects. PDC provides parts of the storage infrastructure, several critical system services, operational staff and end user support. For more information, see the SNIC Swestore resource information https://www.snic.se/resources/swestore/ and SNIC Swestore documentation http://docs.snic.se/wiki/Swestore

Key features

  • Storage size: is defined by project allocation that you own, usually divided in small, medium and large.

  • File access speed: relatively slow access to files (not good for files being accessed by parallel computation)

  • Backup: files are not backed up but they all are stored in the system in two replicas on two different site.

  • Access from Beskow: files on Swestore are not accessible from Beskow’s compute nodes (so any data or program files that you need for running pograms on Beskow must be stored/staged in Lustre)

  • Access from Tegner: files on Swestore can not be accessed from Tegner’s compute nodes (so any data or program files that you need for running pograms on Beskow must be stored/staged in Lustre)

  • File access: Swestore iRODS has its own implementation of Access Control Lists (ACLs). Swestore can be accessed in several different ways.

    • from PDC: we advice you to use PDC transfer nodes. For more information please check here.
    • from rest of the world: you have possibility to choose your own prefered way to talk to Swestore. For more information please check here.

Introduction

iRODS is a data management tool. With iRODS you can store data in a unified namespace using multiple storage resources, to replicate data so that copies exist on multiple systems, and to store checksums and arbitrary metadata with a file.

Command-line Usage

The iRODS command-line utilities are referred to as “iCommands”. If you have SNIC Swestore allocation, please check File transfer section on how to transfer or manage files with iCommands.