Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Update backup data and planning

...

  • The backup scripts are stored in /u3/scripts;

  • The log files for these scripts are stored in /u3/scripts/logs; These logs are rotated on dafnenfs from logrotated and the config file is in /etc/logrotate.d/nfs_rsync logrotate (check last point);

  • The script u2_backup.sh is responsible to create a backup of /u2/dcs in /u3 and launch nfs_rsync.sh script to rsync data to nascoda1. The u2_backup.sh script is launched by crontab on host dafnenfs every day (see Table 2 for details);
  • The script nfs_rsync.sh is responsible to rsync the data from the host where it is launched to nascoda1. It will send an email to Paolo Ciuffetti at his end to inform him on the backup status. It is launched by crontab on host danteweb danteweb and vlmonitor01 vldafneafp every day (see Table 2 for details);
  • The host dafnenfs share /u3/scripts; danteweb and vlmonitor01 vldafneafp mount that folder via NFS on boot (folder present in /etc/fstab);
  • The host dafnenfs has a custom configuration for logrotate present in /etc/logrotate.d/nfs_rsync to rotate log files generated by these scripts. It will rotate all log files every day, keeping them compressed in /u3/scripts/logs/old folder for 5 days.

...

HostFolderBackup Folder (nascoda1/2)Description
dafnenfs/etcserver_data/dafnenfs/etcConfiguration files
dafnenfs/data/disklessdisklessFilesystem for VMIC diskless clients
dafnenfs/data/export/exec/Solaris_9_sparc.all/usrforce_usrUser Filesystem for Force diskless clients
dafnenfs/data/export/rootforce_rootRoot Filesystem for Force diskless clients
dafnenfs/data/export/swapforce_swapSWAP for Force diskless clients
dafnenfs/data/u1u1
dafnenfs/data/u2u2Control system, home folders (dafne, vmic e VMs) and other files
dafnenfs/data/u3u3LVTemp, /data/u2 backup and other sensible files
dafnenfs/siddhartasiddhartaData written from Siddharta experiment and from DAFNE
dafnenfs/data/backup_linacslmonitor-slmonitorFolder for A. Stellavllinacctr001 VM backup (not backed up)

danteweb/etcserver_data/danteweb/etcConfiguration files
danteweb/optserver_data/danteweb/optService scripts and data, including a crontab snapshot
danteweb/var/lib/mysqlserver_data/danteweb/mysqlDatabase files (backup disabled; to be re-enabled soon)
danteweb/var/wwwserver_data/danteweb/var/wwwWeb files (backup disabled; to be re-enabled soon)

vldafneafpvlmonitor01/etcserver_data/vlmonitor01vldafneafp/etcConfiguration files
vlmonitor01vldafneafp/optsrvserver_data/vlmonitor01vldafneafp/optCustom scripts (with Nagios custom plugins)
vlmonitor01/var/spool/nagiosserver_data/vlmonitor01/var/spool/nagiosNagios home (with public/private keys)
srvAPPLE DEVIL's FILESYSTEM data shared via AFP

Table 1 - data folders

Backup planning

...

ServerBackup frequencyTimeDescription
dafnenfsdaily01:30Create a backup of u2/dcs in u3 and then launch rsync script
dantewebdaily01:10Launch rsync script
vlmonitor01vldafneafpdaily02:01:05Launch rsync script

Table 2 - Backup planning

...

Backups are planned on NAS nascoda1.lnf.infn.it (LAT room) and rsynced on NAS nascoda2 nasda.lnf.infn.it (Control Lab, Building 2, Room 117) with following planning (including single volume snapshots):

Source NASDestination NASOperationFrequencyTimeDescription
nascoda1localData volume snapshotSmart VersioningDaily-00:05Snapshot kept for 1 month
nascoda1nascoda2NAS system volume snapshot and replicaDaily00:55Local NAS system volume snapshot and replica on nascoda2
nascoda1localserver_data volume snapshotWeekly (Sunday)01:05Snapshot kept for 1 month
Hourly snapshots: 24
Daily snapshots: 7
Weekly snapshots: 5
Monthly snapshots: 12
nascoda1nasdaData nascoda1nascoda2Data and configuration volume syncDaily04:00rsync data from nascoda1 to nascoda2 of all volumes
nascoda2localData volume snapshotDaily00:05Snapshot kept fpr 1 month
nascoda2nascoda1NAS system volume snapshot and replicaDaily00:55Local NAS system volume snapshot and replica on nascoda1
nascoda2localserver_data volume snapshotWeekly (Sunday)01:05Snapshot kept fpr 1 month
nasda/nascoda folder

Table 3 - Snapshot and replica planning

Monthly manual backup

Manual backup made every month (.tar.gz) of all data folder and saved in shared folder "DCS Backups" on nascoda1.lnf.infn.it

Recover data from backup

Read this documentation page.

...