Data Protection Procedure

Procedure

As part of the computational resources, MSI offers a number of storage options, which can be utilized to aid in research functions. Storage is offered as scratch space and non-scratch space, the key difference being that the non-scratch areas have additional safeguards for data security.

Data Protection on Non-Scratch File Systems
While scratch file systems tend to be locally available on HPC resources, the non-scratch file system are ubiquitous throughout MSI resources. The non-scratch file systems feature a number of data protection safeguards:

  • Online snapshots -- non-scratch systems offer one or more online snapshots of data fixed in time (provided the file system technology supports such snapshots). These snapshots can be used to recover most files or data which are accidently lost.
  • Offline incremental backups -- non-scratch file systems also feature offline, periodic incremental backups which are retained for an extended period of time.
  • Hardware protection -- the non-scratch file systems generally use enterprise-class storage systems with features that allow for failure detection and timely replacement of failed components.    
  • Backup systems are carefully monitored and issues are timely addressed.

 

Data Protection on Scratch File Systems
The scratch file systems include both global and local file systems. Most MSI computational resources feature a global scratch file system with basic data projection. The local scratch systems usually offer no data protection. On local scratch systems, data should be copied in and out as needed for the duration of jobs only. On local scratch systems, once a job has finished (by any measure) the local scratch systems are immediately purged of any data. Data on global scratch systems is purged regularly based upon the age of the data stored there. Stale data will be deleted on scratch file systems without notice to users. Exceptions can be arranged for extended periods of global scratch storage. 

Related Information

Related Policies
Data Protection Policy
Policy Index