執(zhí)行步驟：
1.備份mysql數(shù)據(jù)庫
2.導(dǎo)入數(shù)據(jù)到pg數(shù)據(jù)庫中
1.備份mysql數(shù)據(jù)庫
備份工具目錄結(jié)構(gòu)：
[ansible@java2 wz-temp]$ tree mysql_pg/
mysql_pg/
├── conf
│ └── common.sh
├── dump_mysql.sh
└── logs
├── mysql_bak_tables20180514.log
├── mysql_bak_tables20180517.log
├── mysql_bak_tables20180601.log
...
2 directories, 8 files
備份工具dump_mysql.sh：
#!/bin/bash
# 注意：執(zhí)行該腳本一定要先進(jìn)入到腳本的當(dāng)前目錄下
source ./conf/common.sh
set -o errexit
set -o nounset
DUMP_CMD="/usr/local/mysql/bin/mysqldump"
DB_CONN="-u rds_read -pxxxx -h 192.168.x.x"
ARGS=" --skip-opt --compatible=postgresql --compact --no-create-info --default-character-set=utf8 --skip-comments --skip-dump-date --set-gtid-purged=OFF --skip-tz-utc "
DB_NAME="xxx_db"
DISK_USAGE=3
BackPath="/web/share/backup_tables_pg"
LOG_PREFIX="mysql_bak_tables"
dat="`date +%F`"
# 判斷執(zhí)行返回結(jié)果
Execution_result(){
local method_name="$1"
local right_message="$2"
local error_message="$3"
if [[ $? -eq 0 ]]; then
LOG_INFO "${method_name}" "${right_message}"
else
LOG_ERR "${method_name}" "${error_message}"
exit 1
fi
}
# 磁盤空間檢測(cè)
Check_disk(){
set +o errexit
local func_name="Check_disk"
DiskFree=`df -h | awk -F 'G' 'NR==2 {print $3}'`
c=$(echo " $DiskFree < $DISK_USAGE" | bc) # 小數(shù)點(diǎn)的運(yùn)算
if [[ $c -eq 1 ]]; then
LOG_ERR "${func_name}" "there have no enough disk space."
exit 1
else
LOG_INFO "${func_name}" "Check disk spacess passed."
fi
set -o errexit
}
# 備份表
Backup_tables(){
local func_name="Backup_tables"
Check_disk
if [[ ! -d "${BackPath}" ]]; then
LOG_WARN "${func_name}" "Backup path is not exists, and create it now."
sudo /bin/mkdir -p "${BackPath}"
else
LOG_INFO "${func_name}" "Backup path is available"
fi
# Backup tables
for i in vip_level vip_level_benefit vip_user_level; do
sudo "${DUMP_CMD}" ${DB_CONN} ${ARGS} ${DB_NAME} "${i}" > "${BackPath}"/"${i}"_"${dat}".sql
Execution_result "${func_name}" "Backup table $i succeed." "Backup table $i failed."
done
}
# 對(duì)vip_level_benefit表處理成pg能接收的格式
Data_deal(){
local func_name="Data_deal"
if [[ ! -f ${BackPath}/vip_level_benefit_${dat}.sql ]]; then
LOG_ERR "${func_name}" "vip_level_benefit_${dat}.sql is not exists."
exit 1
else
sudo sed -i 's/\\//g' "${BackPath}"/vip_level_benefit_"${dat}".sql
Execution_result "${func_name}" "deal with backup data of vip_level_benefit succeed." "deal with data of vip_level_benefit failed."
fi
}
# 清理備份
Clean_oldback(){
local func_name="Clean_oldback"
sudo find "${BackPath}" -type f -mtime +5 -name "vip_*.sql" -exec rm -rf {} \;
Execution_result "${func_name}" "Clean old tables succeed." "Clean old tables failed."
}
main(){
Backup_tables
Data_deal
Clean_oldback
}
main
日志文件：common.sh , 代碼見另一篇文章，Bash腳本的日志公用方法
2.將數(shù)據(jù)導(dǎo)入到pg數(shù)據(jù)庫中
目錄結(jié)構(gòu):
tree import_pg
import_pg
├── conf
│ └── common.sh
├── import_pg.sh
└── logs
├── import_pg_data20180517.log
├── import_pg_data20180601.log
├── import_pg_data20180612.log
....
2 directories, 7 files
備份恢復(fù)到pg中腳本，import_pg.sh
#!/bin/bash
# 注意：執(zhí)行該腳本一定要先進(jìn)入到腳本的當(dāng)前目錄下
source ./conf/common.sh
set -o errexit
set -o nounset
BackPath="/web/share/backup_tables_pg"
LOG_PREFIX="import_pg_data"
HOST="10.26.20.75"
USER="p2p_activity_rw"
DBNAME="p2p_activity"
PORT="8888"
NAME_suffix="$(date +%F.sql)"
Result_time="`date '+%Y-%m-%d %H:%M:%S'`"
TABLE_LIST="vip_level_${NAME_suffix} vip_level_benefit_${NAME_suffix} vip_user_level_${NAME_suffix}"
#TABLE_LIST="vip_level_${NAME_suffix} vip_level_benefit_${NAME_suffix} "
Execution_result(){
local method_name="$1"
local right_message="$2"
local error_message="$3"
if [[ $? -eq 0 ]]; then
LOG_INFO "${method_name}" "${right_message}"
else
LOG_ERR "${method_name}" "${error_message}"
exit 1
fi
}
Clean_old_tables(){
local func_name="Clean_old_tables"
sudo /usr/bin/psql -h "${HOST}" -p "${PORT}" -U "${USER}" -d "${DBNAME}" << EOF
truncate table vip_level;
truncate table vip_level_benefit;
truncate table vip_user_level;
EOF
# truncate table vip_user_level;
Execution_result "${func_name}" "truncate tables succeed." "truncate tables failed."
}
Import_tables(){
local func_name="Import_tables"
for i in ${TABLE_LIST} ; do
sudo /usr/bin/psql -h "${HOST}" -p "${PORT}" -U "${USER}" -d "${DBNAME}" < "${BackPath}"/$i > /dev/null
Execution_result "${func_name}" "import $i to p2p_activity db succeed." "import $i to p2p_activity db failed."
done
}
main(){
Clean_old_tables
Import_tables
}
main
備注：
- 導(dǎo)入到pg數(shù)據(jù)庫的前提條件是需配置服務(wù)器本機(jī)免密碼登陸pg數(shù)據(jù)庫，具體參考簡(jiǎn)書上寫的另一篇文章: 從阿里云上備份pg部分表到內(nèi)網(wǎng)還原
- 日志文件：common.sh , 代碼見另一篇文章：Bash腳本的日志公用方法
