This runs a remote backup via ssh to a mounted file system (ext4 or btrfs). It does de-duplication at the file level; that is, the first backup copies everything, subsequent backups only copy the changed files and hard link to the unchanged files. RAID storage systems like NetApp de-duplicate at the block level but the snapshot paradigm is very similar.<\/p>\n
#!\/bin\/bash\r\n\r\nhostname=\"kmac\"\r\nnow=`date \"+%Y-%m-%dT%H:%M:%S\"`\r\n\r\necho -e \"\\n\\nBackup of $hostname on `date`\"\r\n\r\n#check args, set backupdir\r\nif [ $# -lt 1 ]; then\r\n echo \"$0: missing path operand\"\r\n echo \"Usage: $0 DEST\"\r\n exit 1;\r\nfi\r\nbackupdir=$1\r\n\r\n#make sure the destination dir is there\r\nif [ ! -d $backupdir\/$hostname ]; then\r\n mkdir $backupdir\/$hostname\r\nfi\r\n\r\n#run the backup\r\nrsync -aHA --stats --delete \\\r\n--rsh 'ssh -c arcfour128' \\\r\n--exclude \/boot \\\r\n--exclude \/proc \\\r\n--exclude \/sys \\\r\n--exclude \/srv\/ProgrammersFiles \\\r\n--exclude \/media \\\r\n--exclude \/dev \\\r\n--exclude \/tmp \\\r\n--exclude \/run \\\r\n--exclude \/mnt \\\r\n--exclude \/opt \\\r\n--exclude \/exports \\\r\n--exclude \/var\/lock \\\r\n--exclude \/var\/run \\\r\n--exclude='ExcludeFromBackup' \\\r\n--link-dest=..\/current \\\r\n$hostname:\/ \\\r\n$backupdir\/$hostname\/back-$now\r\n\r\n#update the \"current\" soft link\r\nrm $backupdir\/$hostname\/current\r\nln -s back-$now $backupdir\/$hostname\/current\r\n\r\n#prune backups\r\n#After ten days we only keep weekly\r\nfor daysago in `seq 11 90`;\r\ndo\r\n date=`date --date=\"$daysago days ago\" \"+%Y-%m-%d\"`\r\n dow=`date --date=\"$date\" \"+%a\"`\r\n eom=`date --date=\"$[daysago-1] days ago\" \"+%-d\"` #1 if it's the end of the month\r\n if [ \"$dow\" == \"Fri\" ]; then\r\n continue; fi\r\n if [ \"$eom\" == \"1\" ]; then\r\n continue; fi\r\n\r\n rm -rf $backupdir\/$hostname\/back-$date*\r\ndone\r\n\r\n#After 90 days we only keep monthly\r\nfor daysago in `seq 91 365`;\r\ndo\r\n date=`date --date=\"$daysago days ago\" \"+%Y-%m-%d\"`\r\n eom=`date --date=\"$[daysago-1] days ago\" \"+%-d\"` #1 if it's the end of the month\r\n if [ \"$eom\" == \"1\" ]; then\r\n continue; fi\r\n\r\n rm -rf $backupdir\/$hostname\/back-$date*\r\ndone\r\n<\/pre>\n","protected":false},"excerpt":{"rendered":"This runs a remote backup via ssh to a mounted file system (ext4 or btrfs). It does de-duplication at the file level; that is, the first backup copies everything, subsequent backups only copy the changed files and hard link to the unchanged files. RAID storage systems like NetApp de-duplicate at the block level but the … Continue reading remote backup<\/span>