This bash script is designed to backup the filesystems here at PyeNet. This script was developed to surround and manipulate the DAR (Disk ARchive) utility as needed for the filesystems. The version 3, shown here, has a rotation system added and a modified log file routine.
DAR is designed to backup filesystems to disk or CD/DVD media. For more details, and downloading, visit the home page of DAR. However check your distribution's installable software to see if they have included a version of DAR.
Features of this bash script are:
Basic overview of what the script does:
Install the DAR utiltiy as per the current instructions. Note that this script is using the compression feature of DAR so if you do compile from the sources make sure that this option is compiled in.
Once the utility is installed check the location of the dar binary using the command whereis dar and confirm that this is correct in the appropriate line in the script.
Install the sendEmail script as per it's README file. Basically as root copy the file to the /usr/local/bin directory. Set the file as executable and it is ready to go (assuming you have a recent version of PERL installed).
Logged back in as a non-root user and running the sendEmail command should produce a listing of the options required to correctly run sendEmail. This confirms it is installed correctly.
Run the command whereis sendEmail to confirm the location and check this is correct in the script.
Copy the example configuration file to a filename that indicates the data being backed up. As explained in the comments within the configuration file, the name given to the file is also the base name used for the backup files once things get underway.
Go through each configuration line changing it as needed by your backup requirements. Each option is documented in the configuration file itself.
To run the backup from the command line the following syntax is used ./do_backup_v3 <config_filename>. It is suggested to set up a configuration file that backs up a test directory first. Once this is working change it to backup a real one.
Once this is all completed adding an entry to the root users CRONTAB will make sure that the backup is performed on a regular basis.
Things I would like to add:
Cheers Jim
Disclaimer - Please note that this system is working well on my servers and configuration. I can not be responsible for it working, or not working, on your configuration as I do not know what your configuration is. However if you do find any issues please let me know so I can find a solution to them.
Note that even though the lines below flow off the edge of the page they will copy and paste into an editor AOK.
#!/bin/bash
#########################################################################################
# Backup routine using DAR
#
# This will backup the directories specified to a local disk and then
# to a remote mounted location
#
# Invocation: do_backup_v3 configuration_file
#
# (c) 2005,2006,2007 Jim Pye - PyeNet Universal
#
# Version History:
# Version 1, Feb 2005
# - Using original backup script as a starting point
# - Added copy of backup file to second location
#
# Version 2, Dec 2005
# - Modified to make more variables to make modifications of script easier
# - Also added the loop thru the SRC_DIRS array to make the script more compact
# - Added the Directory space checks
# - Added the ability to control whether the backup creates subdirs for each backup
# or not
# - Moved the variables to seperate configuration file to allow for an even more generic
# script
#
# - Feb 2006
# - Changed the email subject line from host name to backup name to make it a bit easier to
# see which backup the message is for when there are more than one coming from a
# host.
#
# Version 3, Aug 2006
# - Backup rotation system added
# - Changed the disk free calculation from using df to stat as an issue was seen if space
# in directory path
# - Tidied up format of log file to make little easier to read
#
# Version 3.1, Sept 2006
# - Modified log file so new log is appended to beginning of file and only current log
# is emailed.
#
# TODOs
#
# - Need to output the error message returned by each command to the logfile
# to aid in troubleshooting
#
#
#########################################################################################
# Script Begins...
#
# Setup variables to use later on
#
# Utilities used in script
# The full path is required to the utility commands as this script is intended to be run
# under a CRON job
# The location of each of these utilities needs to be confirmed before running script
#
DATE=/bin/date
TAIL=/usr/bin/tail
CUT=/usr/bin/cut
MOUNT=/bin/mount
GREP=/bin/grep
DU=/usr/bin/du
STAT=/usr/bin/stat
MKDIR=/bin/mkdir
CP=/bin/cp
CAT="/bin/cat"
MOVE="/bin/mv"
SENDEMAIL=/usr/local/bin/sendEmail
DAR=/usr/bin/dar
#
# Check to see if configuration file is specified on the command line.
# If so, use it to populate variables needed for script, if not error out...
#
# The name used for the configuration file is also used to specify the name of the backup
# being performed. This name is used as the base for the directories and filename for the
# backup
if [ -z "$1" ]; then
echo "do_backup: Oops, you forgot to specify the configuration file I am to use"
exit 1
else
if [ ! -f "$1" ] || [ ! -r "$1" ]; then
echo "do_backup: There is a problem accessing the file: $1"
echo " Please make sure this file exists and is readable"
exit 1
else
BACKUP_FULL_NAME="$1"
. "$1"
fi
fi
function thou_sep
{
# THOU_SEP defines the character to be used as the seperator
THOU_SEP=","
## Declare Display Number as a string equal to number entered
declare +i DISP_NUM=$1
# Find the length of the Display Number variable
declare -i LGTH_DISP_NUM=${#DISP_NUM}
#Set up a variable to contain the part of the string being worked on and the thousands separator
SEP_NUM=""
# Loop thru cutting the number string into 3 character chunks and add the thousands separator
until [ $(($LGTH_DISP_NUM < 3)) = 1 ] ; do
CURRENT_PART=${DISP_NUM:$LGTH_DISP_NUM-3}
DISP_NUM=${DISP_NUM%$CURRENT_PART}
SEP_NUM="$THOU_SEP$CURRENT_PART$SEP_NUM"
LGTH_DISP_NUM=$(($LGTH_DISP_NUM - 3))
done
# Add the last chunk to the beginning of the number to be displayed
DISP_NUM=$DISP_NUM$SEP_NUM
# However if the number of digits in the number entered is divisible by 3 it will have a leading
# thousands separator, this will remove it
DISP_NUM=${DISP_NUM#$THOU_SEP}
# Display the separated number
echo "$DISP_NUM"
}
function log_rotate
{
# Rotate the log file by appending the archive file to the current .out.log file then renaming
# the .out.log file to the .log archive file. Effectively putting the newer log information at the
# beginning.
$CAT $LOGFILE_ARCHIVE >> $LOGFILE_LOC
$MOVE $LOGFILE_LOC $LOGFILE_ARCHIVE
}
# Strip off the path to get the name of this backup from the filename of the configuration file used.
BACKUP_NAME=${BACKUP_FULL_NAME##/*/}
# Logfile Name - This is the name of log file based on the combination of the directory specified
# in the configuration file, the name of the backup and the string -backup.log
LOGFILE_LOC="$LOGFILE_DIR/$BACKUP_NAME-backup.out.log"
LOGFILE_ARCHIVE="$LOGFILE_DIR/$BACKUP_NAME-backup.log"
# CURDATE_EMAIL is used for the time stamp in emails and logfiles
CURDATE_EMAIL="$($DATE +%Y%m%d-%H%M)"
# CURDATE is set to FullBackup here. This will be the name of the subdirectory created if we
# are not using rotation. If rotation is being used this will be overridden.
CURDATE="FullBackup"
# Backup Rotation System
# For this to work correctly the backup must be scheduled to happen in the morning
# The directory name used is indicating the date of data the backup contains
# not the day the backup was performed. To change this to the date the backup was
# performed remove the -d yesterday from the DATE commands below.
# If the ROTATE is not empty then the backup is to be in the rotation system
# If the ROTATE is empty then the backup will be not be rotated and each backup will
# overwrite previous backup. The CURDATE is left as FullBackup in this case.
if [ -n "$ROTATE" ]; then
# Set CURDATE to the day of the week. We use yesterday as the backup will be performed
# in the morning of the next day. The CURDATE variable will be overidden if the day
# happens to be either the first of the month (monthly) or end of the working week
# ie. Saturday (weekly)
CURDATE="$($DATE -d yesterday +%A)"
CURDAYOFMONTHNUM=$($DATE +%_d)
CURDAYOFWEEKNUM=$($DATE +%u)
# Check for first of Month if it is then we need to make this the
# Full monthly backup for the previous month
if [ $CURDAYOFMONTHNUM -eq 1 ]; then
echo "Doing Monthly Backup for: $($DATE -d yesterday +%B)"
CURDATE="$($DATE -d yesterday +%B-%Y)-Monthly"
else
# If today is Saturday then we are doing the Weekly backup and
# need to find which week number we are in.
if [ $CURDAYOFWEEKNUM -eq 6 ]; then
if [ $CURDAYOFMONTHNUM -lt 8 ]; then
CURDATE="Friday-Week1"
elif [ $CURDAYOFMONTHNUM -lt 15 ]; then
CURDATE="Friday-Week2"
elif [ $CURDAYOFMONTHNUM -lt 22 ]; then
CURDATE="Friday-Week3"
elif [ $CURDAYOFMONTHNUM -lt 29 ]; then
CURDATE="Friday-Week4"
else
CURDATE="Friday-Week5"
fi
fi
fi
fi
###########################################
#
# Actual backup procedure from here on...
#
###########################################
# Create a header for current backup job in the logfile, we append current job to log
echo " " >> $LOGFILE_LOC
echo "=*=*=*= $CURDATE backup of $BACKUP_NAME from $LOC_SYSTEM_NAME =*=*=*=" >> $LOGFILE_LOC
echo " " >> $LOGFILE_LOC
echo -n "Started backup job at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
echo " " >> $LOGFILE_LOC
echo "do_backup: Checking backup destinations mounted OK"
echo -n "Checking backup destinations mounted OK at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
# Check for and mount local mount point
echo "do_backup: Checking that local filesystem $LOC_MOUNT_POINT is mounted"
echo -n " Checking that local filesystem $LOC_MOUNT_POINT is mounted at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
if ! $GREP -E [[:space:]]$LOC_MOUNT_POINT[[:space:]] /etc/mtab
then
echo "do_backup: $LOC_MOUNT_POINT not mounted, trying to mount"
if ! $MOUNT $LOC_MOUNT_POINT
then
echo "do_backup: Failed to mount $LOC_MOUNT_POINT"
echo -n "!!!*** WARNING ***!!! Failed to mount $LOC_MOUNT_POINT at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
$SENDEMAIL -f $EMAIL_FROM \
-t $EMAIL_TO \
-u "*** FAILED!!! *** $BACKUP_NAME Backup of $LOC_SYSTEM_NAME" \
-m "$CURDATE backup of $BACKUP_NAME from $LOC_SYSTEM_NAME *** FAILED *** : $CURDATE_EMAIL.\n\nReason: Failed to mount $LOC_MOUNT_POINT" \
-s $EMAIL_SERVER \
-a $LOGFILE_LOC
`log_rotate`
exit 1
fi
fi
echo "do_backup: $LOC_MOUNT_POINT is mounted AOK"
echo -n " $LOC_MOUNT_POINT is mounted AOK at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
# Check for, and mount. remote mount point for the copy later on. Doing this here
# to make sure operator sees login prompt. We test at end of backup to make
# sure that the remote mount point is still available before trying to copy the files
echo "do_backup: Checking that remote filesystem $REM_MOUNT_POINT is mounted"
echo -n " Checking that remote filesystem $REM_MOUNT_POINT is mounted at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
if ! $GREP -E [[:space:]]$REM_MOUNT_POINT[[:space:]] /etc/mtab
then
echo "do_backup: $REM_MOUNT_POINT not mounted, trying to mount"
echo " "
echo "Please enter login password for user account on $REM_SYSTEM_NAME machine"
if ! $MOUNT $REM_MOUNT_POINT
then
echo "do_backup: Failed to mount $REM_MOUNT_POINT"
echo -n "!!!*** WARNING ***!!! Failed to mount $REM_MOUNT_POINT at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
$SENDEMAIL -f $EMAIL_FROM \
-t $EMAIL_TO \
-u "*** FAILED!!! *** $BACKUP_NAME Backup of $LOC_SYSTEM_NAME" \
-m "$CURDATE backup of $BACKUP_NAME from $LOC_SYSTEM_NAME *** FAILED *** : $CURDATE_EMAIL.\n\nReason: Failed to mount $REM_MOUNT_POINT" \
-s $EMAIL_SERVER \
-a $LOGFILE_LOC
`log_rotate`
exit 1
fi
fi
echo "do_backup: $REM_MOUNT_POINT is mounted AOK"
echo -n " $REM_MOUNT_POINT is mounted AOK at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
echo -n "Finished checking mounted filesystems at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
echo " " >> $LOGFILE_LOC
# Check disk space available at the destination directories
# Using the stat utility for this
# The %f format is the free blocks
# The %s is the block size in bytes
# The -f means stat reports on the filesystem itself instead of the filename specified
echo "do_backup: Checking backup size and free space available"
echo -n "Checking estimated backup size and free space available at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
# Local Destination
echo "Local Dest Dir is: $LOC_DEST_DIR"
declare -i REAL_LOC_DISK_FREE=$(($($STAT -f -c%f "$LOC_DEST_DIR")*$(($($STAT -f -c%s "$LOC_DEST_DIR")))))
# Adjust REAL_LOC_DISK_FREE if the local destination directory exists as this backup is
# going to overwrite the previous one.
if [ -d "$LOC_DEST_DIR/$BACKUP_NAME/$CURDATE" ]; then
REAL_LOC_DISK_FREE=$REAL_LOC_DISK_FREE+$($DU "$LOC_DEST_DIR/$BACKUP_NAME/$CURDATE" -h -c -b | $TAIL -n1 | $CUT -f1)
fi
# Convert raw number into thousands separated number for display
DISPLAY_REAL_LOC_DISK_FREE=`thou_sep $REAL_LOC_DISK_FREE`
echo "do_backup: $DISPLAY_REAL_LOC_DISK_FREE bytes available at the local destination"
echo -n " $DISPLAY_REAL_LOC_DISK_FREE bytes available at the local destination at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
# Remote Destination
declare -i REAL_REM_DISK_FREE=$(($($STAT -f -c%f "$REM_DEST_DIR")*$(($($STAT -f -c%s "$REM_DEST_DIR")))))
# Adjust REAL_REM_DISK_FREE if the remote destination directory exists as this backup is
# going to overwrite the previous one.
if [ -d "$REM_DEST_DIR/$BACKUP_NAME/$CURDATE" ]; then
REAL_REM_DISK_FREE=$REAL_REM_DISK_FREE+$($DU "$REM_DEST_DIR/$BACKUP_NAME/$CURDATE" -h -c -b | $TAIL -n1 | $CUT -f1)
fi
# Convert raw number into thousands separated number for display
DISPLAY_REAL_REM_DISK_FREE=`thou_sep $REAL_REM_DISK_FREE`
echo "do_backup: $DISPLAY_REAL_REM_DISK_FREE bytes available at the remote destination"
echo -n " $DISPLAY_REAL_REM_DISK_FREE bytes available at the remote destination at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
# Check the possible size of the backup dirs
declare -i TOTAL_DIR_SIZE=0
for EACH_SRC_DIR in "${SRC_DIRS[@]}"; do
declare -i DIR_SIZE=$($DU "$EACH_SRC_DIR" -h -c -b | $TAIL -n1 | $CUT -f1)
# echo "do_backup: $EACH_SRC_DIR = $DIR_SIZE"
TOTAL_DIR_SIZE=$TOTAL_DIR_SIZE+$DIR_SIZE
done
# Convert raw number into thousands separated number for display
DISPLAY_TOTAL_DIR_SIZE=`thou_sep $TOTAL_DIR_SIZE`
echo "do_backup: $DISPLAY_TOTAL_DIR_SIZE bytes is the estimated size of the backup"
echo -n " $DISPLAY_TOTAL_DIR_SIZE bytes is the estimated size of the backup at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
# Calculate if the backup is going to fit on the destination
# Note that the calculated size of the data to be backed up is going to be bigger than the actual
# data as it does not take into account the DAR utility compression or the files it will not
# backup. But this means there should be plenty of spare space after backup has completed
if (( ($REAL_LOC_DISK_FREE < $TOTAL_DIR_SIZE) || ($REAL_REM_DISK_FREE < $TOTAL_DIR_SIZE) )) ; then
echo "do_backup: BooHoooo not enough space left to backup files..."
echo " " >> $LOGFILE_LOC
echo -n "!!!*** WARNING ***!!! Not enough disk space to complete backup at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
$SENDEMAIL -f $EMAIL_FROM \
-t $EMAIL_TO \
-u "*** FAILED!!! *** $BACKUP_NAME Backup of $LOC_SYSTEM_NAME" \
-m "$CURDATE backup of $BACKUP_NAME from $LOC_SYSTEM_NAME *** FAILED *** : $CURDATE_EMAIL.\n\nReason: No space for backup file.\n\nEstimated backup size: $DISPLAY_TOTAL_DIR_SIZE.\nLocal space available: $DISPLAY_REAL_LOC_DISK_FREE.\nRemote space available: $DISPLAY_REAL_REM_DISK_FREE." \
-s $EMAIL_SERVER \
-a $LOGFILE_LOC
`log_rotate`
exit 1
else
echo "do_backup: Yahooo we have enough space to backup files..."
echo -n " Looks like we are good to go... at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
fi
echo "do_backup: Done checking size of backup data and free disk space"
echo -n "Done checking size of data and free disk space at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
echo " " >> $LOGFILE_LOC
# Checking to see if the local destination directory exists, if not creates it
echo "do_backup: Checking if local backup destination directory $CURDATE exists"
echo -n "Checking if local backup destination directory $CURDATE exists at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
if [ ! -d $LOC_DEST_DIR/$BACKUP_NAME/$CURDATE ]; then
echo "do_backup: Creating local destination directory $LOC_DEST_DIR/$BACKUP_NAME/$CURDATE"
echo -n " Creating local destination directory $LOC_DEST_DIR/$BACKUP_NAME/$CURDATE at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
# Create Local destination directory
if ! $MKDIR -p $LOC_DEST_DIR/$BACKUP_NAME/$CURDATE
then
echo "do_backup: Failed to create $LOC_DEST_DIR/$BACKUP_NAME/$CURDATE on local $LOC_MOUNT_POINT"
echo -n "!!!*** WARNING ***!!! Failed to create $LOC_DEST_DIR/$BACKUP_NAME/$CURDATE on local $LOC_MOUNT_POINT at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
$SENDEMAIL -f $EMAIL_FROM \
-t $EMAIL_TO \
-u "*** FAILED!!! *** $BACKUP_NAME Backup of $LOC_SYSTEM_NAME" \
-m "$CURDATE backup of $BACKUP_NAME from $LOC_SYSTEM_NAME *** FAILED *** : $CURDATE_EMAIL.\n\nReason: Failed to create $LOC_DEST_DIR/$BACKUP_NAME/$CURDATE on local $LOC_MOUNT_POINT" \
-s $EMAIL_SERVER \
-a $LOGFILE_LOC
`log_rotate`
exit 1
fi
echo "do_backup: Created local destination dir $LOC_DEST_DIR/$BACKUP_NAME/$CURDATE"
echo -n " Created local destination dir $LOC_DEST_DIR/$BACKUP_NAME/$CURDATE at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
fi
echo "do_backup: Done checking if local backup destination directory exists"
echo -n "Done checking if local backup destination directory exists at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
echo " " >> $LOGFILE_LOC
# Loop thru each of the source directories performing the backup
######
# DAR Options used
#
# -v = verbose
# -w = no warn on overwriting slice files
# -s = slice file size 2147483640 =/= 2G
# -z = use gzip compression
# -m = do not compress files smaller than 1024 bytes
# -X = exclude ~ backup files
# -Z = exclude from compression
# -R = root directory of files to be backed up
# -c = base filename for the archive that is to be created. Files will be <base>.<number>.dar
#
######
for EACH_SRC_DIR in "${SRC_DIRS[@]}"; do
echo "do_backup: Starting $EACH_SRC_DIR dir backup"
echo -n "Starting $EACH_SRC_DIR dir backup at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
# We need to modify DAR's archive name if it starts with a "." as this causes issues
# with the copy of the files to the remote destination directory.
# This snippet adds a "_" to the beginning of the filename.
BU_BASE_NAME=${EACH_SRC_DIR##*/}
if [[ ${BU_BASE_NAME::1} == "." ]]; then
BU_BASE_NAME="_$BU_BASE_NAME"
fi
if ! $DAR -v \
-w \
-s 2147483640 \
-z \
-m 1024 \
-X "*~" \
-Z "*.png" \
-Z "*.PNG" \
-Z "*.pdf" \
-Z "*.gif" \
-Z "*.GIF" \
-Z "*.zip" \
-Z "*.ZIP" \
-Z "*.jpg" \
-Z "*.jpeg" \
-Z "*.JPG" \
-Z "*.tgz" \
-Z "*.gz" \
-R "$EACH_SRC_DIR" \
-c $LOC_DEST_DIR/$BACKUP_NAME/$CURDATE/"$BU_BASE_NAME-bu"
then
echo "do_backup: $EACH_SRC_DIR dir backup failed"
echo -n "!!!*** WARNING ***!!! $EACH_SRC_DIR dir backup failed at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
$SENDEMAIL -f $EMAIL_FROM \
-t $EMAIL_TO \
-u "*** FAILED!!! *** $BACKUP_NAME Backup of $LOC_SYSTEM_NAME" \
-m "$CURDATE backup of $BACKUP_NAME from $LOC_SYSTEM_NAME *** FAILED *** : $CURDATE_EMAIL.\n\nReason: DAR failed backing up files to $LOC_DEST_DIR/$BACKUP_NAME/$CURDATE/" \
-s $EMAIL_SERVER \
-a $LOGFILE_LOC
`log_rotate`
exit 1
fi
echo "do_backup: Finished $EACH_SRC_DIR directory backup"
echo -n "Finished $EACH_SRC_DIR directory backup at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
echo " " >> $LOGFILE_LOC
done
# Check again to make sure the remote point is still mounted
echo "do_backup: Checking $REM_MOUNT_POINT still mounted"
echo -n "Checking $REM_MOUNT_POINT is still mounted at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
if ! $GREP $REM_MOUNT_POINT /etc/mtab
then
echo "do_backup: $REM_MOUNT_POINT not mounted, trying to mount"
if ! $MOUNT $REM_MOUNT_POINT
then
echo "do_backup: Failed to mount $REM_MOUNT_POINT"
echo -n "!!!*** WARNING ***!!! Failed attempting to mount $REM_MOUNT_POINT at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
$SENDEMAIL -f $EMAIL_FROM \
-t $EMAIL_TO \
-u "*** FAILED!!! *** $BACKUP_NAME Backup of $LOC_SYSTEM_NAME" \
-m "$CURDATE backup of $BACKUP_NAME from $LOC_SYSTEM_NAME *** FAILED *** : $CURDATE_EMAIL.\n\nReason: Failed to mount $REM_MOUNT_POINT before copying files." \
-s $EMAIL_SERVER \
-a $LOGFILE_LOC
`log_rotate`
exit 1
fi
fi
echo "do_backup: $REM_MOUNT_POINT is still mounted AOK"
echo -n " $REM_MOUNT_POINT is still mounted AOK at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
echo " " >> $LOGFILE_LOC
# Checking to see if the remote destination directory exists, if not creates it
echo "do_backup: Checking if remote backup destination directory $CURDATE exists"
echo -n "Checking if remote backup destination directory $CURDATE exists at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
if [ ! -d $REM_DEST_DIR/$BACKUP_NAME/$CURDATE ]; then
echo "do_backup: Creating remote destination directory $REM_DEST_DIR/$BACKUP_NAME/$CURDATE"
echo -n " Creating remote destination directory $REM_DEST_DIR/$BACKUP_NAME/$CURDATE at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
if ! $MKDIR -p $REM_DEST_DIR/$BACKUP_NAME/$CURDATE
then
echo "do_backup: Failed to create destination directory $REM_DEST_DIR/$BACKUP_NAME/$CURDATE"
echo -n "!!!*** WARNING ***!!! Failed to create destination directory $REM_DEST_DIR/$BACKUP_NAME/$CURDATE"
$DATE >> $LOGFILE_LOC
$SENDMAIL -f $EMAIL_FROM \
-t $EMAIL_TO \
-u "*** FAILED!!! *** $BACKUP_NAME Backup of $LOC_SYSTEM_NAME" \
-m "$CURDATE backup of $BACKUP_NAME from $LOC_SYSTEM_NAME *** FAILED *** : $CURDATE_EMAIL.\n\nReason: Failed to create destination directory $REM_DEST_DIR/$BACKUP_NAME/$CURDATE" \
-s $EMAIL_SERVER \
-a $LOGFILE_LOC
`log_rotate`
exit 1
fi
echo "do_backup: Created remote destination directory $REM_DEST_DIR/$BACKUP_NAME/$CURDATE"
echo -n " Created remote destination directory $REM_DEST_DIR/$BACKUP_NAME/$CURDATE at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
fi
echo "do_backup: Done checking if remote backup destination directory exists"
echo -n "Done checking if remote backup destination directory exists at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
echo " " >> $LOGFILE_LOC
# Copy the backup files to remote mount point
echo "do_backup: Copying backup files to $REM_MOUNT_POINT"
echo -n "Begin copy of backup files to $REM_MOUNT_POINT at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
if ! $CP --reply=yes -r $LOC_DEST_DIR/$BACKUP_NAME/$CURDATE/* $REM_DEST_DIR/$BACKUP_NAME/$CURDATE/
then
echo "do_backup: Failed to copy backups to $REM_MOUNT_POINT"
echo -n "!!!*** WARNING ***!!! Failed to copy backups to $REM_MOUNT_POINT at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
$SENDEMAIL -f $EMAIL_FROM \
-t $EMAIL_TO \
-u "*** FAILED!!! *** $BACKUP_NAME Backup of $LOC_SYSTEM_NAME" \
-m "$CURDATE backup of $BACKUP_NAME from $LOC_SYSTEM_NAME *** FAILED *** : $CURDATE_EMAIL.\n\nReason: Failed to copy files to $REM_MOUNT_POINT" \
-s $EMAIL_SERVER \
-a $LOGFILE_LOC
`log_rotate`
exit 1
else
echo "do_backup: Copied backups to $REM_MOUNT_POINT successfully"
echo -n "Copied backups to $REM_MOUNT_POINT successfully at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
echo " "
echo "do_backup: Backup completed successfully"
echo -n "Backup completed successfully at: " >> $LOGFILE_LOC
$DATE >> $LOGFILE_LOC
fi
echo " " >> $LOGFILE_LOC
echo "=*=*=*= Finished $CURDATE backup of $BACKUP_NAME from $LOC_SYSTEM_NAME =*=*=*=" >> $LOGFILE_LOC
echo " " >> $LOGFILE_LOC
####################################
# Email log files
#
# The sendEmail is a perl script downloaded from:
# http://caspian.dotconf.net/menu/Software/SendEmail/
#
# It is located in the /usr/local/bin directory and uses the following switches
#
# -f From address
# -t To address
# -u Subject line
# -m Message body
# -s Server to send SMTP
# -a Logfile to send as an attachment, note we are only sending the log for
# the current backup. Below we rotate this into an archive file.
#
####################################
echo -n "do_backup: "
$SENDEMAIL -f $EMAIL_FROM \
-t $EMAIL_TO \
-u "$BACKUP_NAME Backup Log for $CURDATE performed $CURDATE_EMAIL" \
-m "$CURDATE backup of $BACKUP_NAME from $LOC_SYSTEM_NAME for $CURDATE_EMAIL Completed.\n\nUpdated Logfile attached :" \
-s $EMAIL_SERVER \
-a $LOGFILE_LOC
`log_rotate`
exit 0
The following is an example of the configuration file needed for the above script
# Configuration file for the do_backup script
#
# (c) 2005,2006,2007 Jim Pye - PyeNet Universal
#
#
# Email Details
#
# Email address to receive logfiles and notification of backup failures
# eg. EMAIL_TO="backup.reports@pyenet.co.nz"
EMAIL_TO="backup.reports@pyenet.co.nz"
# Email address that logfiles and notifications are sent from
# This must be a valid email address for the email server specified
# eg. EMAIL_FROM="backup.process@pyenet.co.nz"
EMAIL_FROM="backup.process@pyenet.co.nz"
# The email server used for the sending of email notifications
# eg. EMAIL_SERVER="mailer.pyenet.co.nz"
EMAIL_SERVER="mailer.pyenet.co.nz"
#
# Backup Location details
#
# The hostname of the local system
# This is the system that the backup script is running on
# eg. LOC_SYSTEM_NAME=linux-srv1
LOC_SYSTEM_NAME=linux-srv1
# The hostname of the remote system
# This is the system that the backup will be copied to
# eg. REM_SYSTEM_NAME=linux-backup-srv
REM_SYSTEM_NAME=linux-backup-srv
# Backup Rotation
# Backups can either be made to overwrite the previous backup or to be in a rotation system
# of daily, weekly and monthly backups.
# If we are using the rotation system then the ROTATE variable needs
# to be true, therefore:
# To _USE_ROTATION_ place a character (space, text) in the string eg. ROTATE=" "
# To _NOT_USE_ROTATION_ make the variable an empty string eg. ROTATE=""
ROTATE="yes"
# Log File Directory
# This variable defines the directory for the log files.
# The log file will placed in this directory with the name:
# $BACKUP_NAME-backup.log
# Note the trailing / is _NOT_ needed
# eg. LOGFILE_DIR=/var/log/backups
LOGFILE_DIR=/var/log/backups
# Source Directories
# This is an array of the directories to be backed up with this configuration.
# Place each directory in quotes. This allows for directories with spaces.
# eg. SRC_DIRS=("/data/test dir with space" "/data/test-dir-wo-space")
SRC_DIRS=("/data/test dir with space" "/data/test-dir-wo-space")
# Local mount point
# This specifies the mount point for the local file system where the local
# copy of the backup is to be created. The DAR utility makes its backup
# directly to a sub directory of this mount point.
# Specifying this local mount point allows for an additional hard disk to be
# used for the local backup.
# eg. LOC_MOUNT_POINT=/data
LOC_MOUNT_POINT=/data
# Local Destination Directory
# The DAR utility creates the archive directly here first
# A subdirectory, or subdirectories, will be created below this directory using
# the $BACKUP_NAME and $CURDATE variables.
# The directory specified here must already be created and must be writable by
# the user account used to mount the filesystem.
# eg. LOC_DEST_DIR=/data/backups/linux-srv1
LOC_DEST_DIR=/data/backups/linux-srv1
# Remote mount point
# This specifies the mount point for the remote file system this is where the
# backup archives are to be copied.
# eg. REM_MOUNT_POINT=/mnt/linux-backup-srv
REM_MOUNT_POINT=/mnt/linux-backup-srv
# Remote Destination Directory
# This is where the backup archive files are copied to once they are created
# by DAR.
# The directory specified here must already be created and must be writable by
# the user account used to mount the filesystem.
# eg. REM_DEST_DIR=/mnt/linux-backup-srv/backups/linux-srv1
REM_DEST_DIR=/mnt/linux-backup-srv/backups/linux-srv1