一、引言
前几天写了MongoDB数据库的聚合。一说到“聚合”，用过关系型数据库的人都应该知道它是一个什么东西，主要是用于对数据分类汇总和统计。大家都知道，做为DBA还有另一个重要的任务，那就是对数据库进行备份，以备当数据库发生损坏的时候，我们可以还原到以前的某个时刻，防止数据的丢失。今天我就来抛砖引玉，简单的说一说MongoDB文档数据库中的“备份-还原”的概念。
二、简介
说起来数据库的“备份-还原”，在RDBMS系统中，都有很好的支持，也有很多选项可以设置，功能强大，也能自动完成大部分的备份功能，只要当初设置好了就可以了。对于MongoDB文档型的数据库来说，情况有一些不一样。在MongoDB中，要想对数据进行备份操作，需要使用脚本来执行命令完成，还原的的工作也是一样的，这是它本身支持的“备份-还原”的工作，相对RDBMS系统来说，要简单很多，不能自动完成。真的不能进行设置，来自动完成“备份和还原”的操作吗？当然可以，只是我们需要使用第三的软件才可以，而且功能越强大的，收费有的就越多，免费的也有，功能一般了，但是完成“备份-还原”的工作没问题。
接下来我们就开始说说MongoDB自己的、原生态的“备份-还原”是如何实现的，脚本很简单。mongodump命名主要完成数据的备份工作，mongorestore命令主要完成数据库的还原操作。就这两个命名，是不是很简单，那就开始我们今天的正文吧。
三、数据库的备份和还原
1、MongoDB数据库的备份
1.1、mongodump命令脚本语法如下：
>./mongodump -h dbhost -d dbname -o dbdirectory
-h：–host【–host <hostname><:port>, -h <hostname><:port>】
MongoDB所在服务器地址，默认地址：localhost（127.0.0.1），当然也可以指定端口号：localhost:27017
-d：–db【–db <database>, -d <database>】
需要备份的数据库实例，例如：school,这个数据库是我自己建立的，所以是该备份的
-o：–out <path>【 –out <path>, -o <path>】
备份的数据存放位置，例如：./databaseBack，当然该目录需要提前建立，在备份完成后，系统自动在dump目录下建立一个test目录，这个目录里面存放该数据库实例的备份数据。
-u：–username <username>【–username <username>, -u <username>】
指定用于向使用认证的MongoDB数据库认证的用户名，与–password和–authenticationDatabase结合使用
-p：–password <password>【–password <password>, -p <password>】
指定用于向使用认证的MongoDB数据库认证的密码。与–username和 –authenticationDatabase选项结合使用。
-c：–collection <collection>【–collection <collection>, -c <collection>】
指定要备份的集合。如果不指定，则会将指定数据库或实例中的所有集合备份。
–port <port>：
指定MongoDB实例监听客户连接的TCP端口号。端口的默认值：27017
–gzip：
MongoDB3.2或者以上的版本，可以进行压缩输出，如果mongodump指定导出到目录，则该选项会将每个文件都压缩，并添加.gz后缀；如果mongodump指定导出到文档或标准输出流，则该选项会压缩到文档或输出流中
–authenticationDatabase：【–authenticationDatabase <dbname>】
如果您未指定身份验证数据库，则mongodump会假定指定要导出的数据库保存用户的凭据。如果您未指定要导出的身份验证数据库或数据库，则mongodump假定admin数据库保存用户的凭据。
–authenticationMechanism：【 –authenticationMechanism <name>】
默认值： SCRAM-SHA-1
1.2、实例代码
1】、登陆MongoDB的客户端，查看school数据库当前的详情
//登陆MongoDB的客户端 [root@linux bin]# ./mongo --host=192.168.127.130 --port=27017 MongoDB shell version v3.6.3 connecting to: mongodb://192.168.127.130:27017/ MongoDB server version: 3.6.3 Server has startup warnings: 2018-06-13T11:27:09.721+0800 I CONTROL [initandlisten] 2018-06-13T11:27:09.721+0800 I CONTROL [initandlisten] ** WARNING: Access control is not enabled for the database. 2018-06-13T11:27:09.721+0800 I CONTROL [initandlisten] ** Read and write access to data and configuration is unrestricted. 2018-06-13T11:27:09.721+0800 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2018-06-13T11:27:09.721+0800 I CONTROL [initandlisten] 2018-06-13T11:27:09.723+0800 I CONTROL [initandlisten] 2018-06-13T11:27:09.723+0800 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2018-06-13T11:27:09.723+0800 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2018-06-13T11:27:09.723+0800 I CONTROL [initandlisten] //显示当前数据库列表 > show dbs admin 0.000GB config 0.000GB local 0.000GB school 0.000GB //---这个数据库就是我们要备份的 //切换到school数据库 > use school switched to db school //显示当前school数据库下有多个集合 > show tables geoInstance users //当前两个集合都有数据 > db.users.find() { "_id" : ObjectId("5b1e044733091e826f7c2c74"), "title" : "MongoDb Overview", "description" : "Mongodb is not sql database", "author" : "huangFeiHong", "url" : "http://www.huangfeihong.com", "tags" : [ "mongodb", "database", "NoSql" ], "likes" : 100, "quantity" : 4 } { "_id" : ObjectId("5b1e044733091e826f7c2c75"), "title" : "NoSql Overview", "description" : "No sql database is very fast", "author" : "huangFeiHong", "url" : "http://www.huangfeihong.com", "tags" : [ "mongodb", "database", "NoSql" ], "likes" : 10, "quantity" : 12 } { "_id" : ObjectId("5b1e044733091e826f7c2c76"), "title" : "Log4Net Overview", "description" : "log4net is not sql database", "author" : "linChong", "url" : "http://www.linchong.com", "tags" : [ "log", "net", "NoSQL" ], "likes" : 750, "quantity" : 6 } { "_id" : ObjectId("5b1e1bfb33091e826f7c2c77"), "title" : "MongoDb Higher", "description" : "Mongodb is not sql database", "author" : "huangFeiHong", "url" : "http://www.huangfeihong.com", "tags" : [ "mongodb", "database", "NoSql" ], "likes" : 120, "quantity" : 4 } { "_id" : ObjectId("5b1e1bfb33091e826f7c2c78"), "title" : "NoSql Redis Overview", "description" : "No sql database is very fast", "author" : "linChong", "url" : "http://www.linchong.com", "tags" : [ "redis", "database", "NoSql" ], "likes" : 30, "quantity" : 33 } { "_id" : ObjectId("5b1e1bfb33091e826f7c2c79"), "title" : "Memcached Overrivew", "description" : "Memcached is sql database", "author" : "wuSong", "url" : "http://www.wusong.com", "tags" : [ "memcached", "cache", "NoSQL" ], "likes" : 50, "quantity" : 10 } > > > db.geoInstance.find() { "_id" : ObjectId("5b1f4d21cf30d7cba03d5e03"), "loc" : [ 1, 3 ] } { "_id" : ObjectId("5b1f4d21cf30d7cba03d5e04"), "loc" : [ 3, 4 ] } { "_id" : ObjectId("5b1f4d21cf30d7cba03d5e05"), "loc" : [ 0, -3 ] } { "_id" : ObjectId("5b1f4d21cf30d7cba03d5e06"), "loc" : [ -6, 2 ] } { "_id" : ObjectId("5b1f4d21cf30d7cba03d5e07"), "loc" : { "x" : 9, "y" : 5 } } { "_id" : ObjectId("5b1f4d21cf30d7cba03d5e08"), "loc" : { "lng" : -9.2, "lat" : 21.3 } }
2】、退出MongoDB的客户端，我们要创建保存备份文件的目录
//退出MongoDB的客户端 > exit bye [root@linux bin]# //当前目录结构 [root@linux bin]# pwd /root/application/program/mongodb/mongodb-linux-x86_64-3.6.3/bin [root@linux bin]# databaseBack //创建保存备份文件的目录名称 //已经创建好的目录结构，databaseBack是备份目录 [root@linux bin]# ls bsondump datas logs mongod mongodump mongofiles mongoperf mongorestore mongostat databaseBack install_compass mongo mongodb.conf mongoexport mongoimport mongoreplay mongos mongotop
3】、开始备份数据库，因为我们使用的是客户端，要写完整的地址，在MongoDB服务器端就可以省略
//代码很简单 [root@linux bin]# ./mongodump -h 192.168.127.130:27017 -d school -o ./databaseBack 2018-06-13T11:50:00.816+0800 writing school.geoInstance to 2018-06-13T11:50:00.817+0800 writing school.users to 2018-06-13T11:50:00.821+0800 done dumping school.geoInstance (6 documents) 2018-06-13T11:50:00.821+0800 done dumping school.users (6 documents) //查看备份文件 [root@linux bin]# ls ./databaseBack school [root@linux bin]# ls ./databaseBack/school geoInstance.bson geoInstance.metadata.json users.bson users.metadata.json
4】、以下操作将创建一个只包含名为school的数据库中名为users的集合的转储文件。 在这种情况下，数据库在端口27017上的192.168.127.130运行：
[root@linux bin]# ./mongodump -h 192.168.127.130:27017 --db school --collection users -o ./backCollection 2018-06-13T13:40:46.702+0800 writing school.users to 2018-06-13T13:40:46.706+0800 done dumping school.users (6 documents) [root@linux bin]# ls ./backCollection school [root@linux bin]# ls ./backCollection/school users.bson users.metadata.json [root@linux bin]#
5】、要将转储输出到存档文件，请使用–archive选项和存档文件名运行mongodump。 例如，以下操作将创建一个包含school数据库转储的文件school.20180613.archive。
[root@linux bin]# ./mongodump -h 192.168.127.130:27017 --archive=./backArchiveFile/school.2018613.archive --db school 2018-06-13T13:57:51.953+0800 writing school.geoInstance to archive './backArchiveFile/school.2018613.archive' 2018-06-13T13:57:51.955+0800 writing school.users to archive './backArchiveFile/school.2018613.archive' 2018-06-13T13:57:51.994+0800 done dumping school.geoInstance (6 documents) 2018-06-13T13:57:51.997+0800 done dumping school.users (6 documents) [root@linux bin]# ls ./backArchiveFile/ school.2018613.archive
6】、要压缩输出转储目录中的文件，请使用新的–gzip选项运行mongodump。 例如，以下操作将压缩文件输出到默认转储目录。
[root@linux bin]# ./mongodump -h 192.168.127.130:27017 --db school --gzip -o ./backZip 2018-06-13T14:04:39.674+0800 writing school.geoInstance to 2018-06-13T14:04:39.675+0800 writing school.users to 2018-06-13T14:04:39.682+0800 done dumping school.geoInstance (6 documents) 2018-06-13T14:04:39.684+0800 done dumping school.users (6 documents) //显示压缩文件 [root@linux bin]# ls ./backZip/school geoInstance.bson.gz geoInstance.metadata.json.gz users.bson.gz users.metadata.json.gz
7】、想要通过mongodump命令将压缩的文件输出到指定目录，请将–gzip选项与–archive选项一起使用，并指定压缩文件的名称。
[root@linux bin]# ./mongodump -h 192.168.127.130:27017 --archive=./backZip/school.2018613.gz --db school --gzip 2018-06-13T14:08:57.311+0800 writing school.geoInstance to archive './backZip/school.2018613.gz' 2018-06-13T14:08:57.312+0800 writing school.users to archive './backZip/school.2018613.gz' 2018-06-13T14:08:57.346+0800 done dumping school.geoInstance (6 documents) 2018-06-13T14:08:57.349+0800 done dumping school.users (6 documents) [root@linux bin]# ls ./backZip/ school.2018613.gz
2、MongoDB数据库的还原
2.1、mongorestore命令脚本语法如下：
>mongorestore -h <hostname><:port> -d dbname <path>
–host <:port>, -h <:port>：
MongoDB所在服务器地址，默认为： localhost:27017
–db , -d ：
需要恢复的数据库实例，例如：school，当然这个名称也可以和备份时候的不一样，比如school3
–drop：
还原的时候，先删除当前的数据，然后还原备份的数据。也就是说，还原后，成功备份之后再添加或者修改的数据都会被删除，慎用哦！
<path>：
mongorestore 最后的一个参数，设置备份数据所在位置，如:./databaseBack
你不能同时指定 <path> 和 –dir 选项，–dir也可以设置备份目录。
–dir：
指定备份数据的目录地址
你不能同时指定 <path> 和 –dir 选项。
2.2、示例代码
1】、上文已经成功备份了数据库，现在我们要登陆MongoDB客户端把我们的school数据库删除。
//登陆MongoDB客户端，显示当前数据库列表 [root@linux bin]# ./mongo --host=192.168.127.130 --port=27017 MongoDB shell version v3.6.3 connecting to: mongodb://192.168.127.130:27017/ MongoDB server version: 3.6.3 Server has startup warnings: 2018-06-13T11:27:09.721+0800 I CONTROL [initandlisten] 2018-06-13T11:27:09.721+0800 I CONTROL [initandlisten] ** WARNING: Access control is not enabled for the database. 2018-06-13T11:27:09.721+0800 I CONTROL [initandlisten] ** Read and write access to data and configuration is unrestricted. 2018-06-13T11:27:09.721+0800 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2018-06-13T11:27:09.721+0800 I CONTROL [initandlisten] 2018-06-13T11:27:09.723+0800 I CONTROL [initandlisten] 2018-06-13T11:27:09.723+0800 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2018-06-13T11:27:09.723+0800 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2018-06-13T11:27:09.723+0800 I CONTROL [initandlisten] > show dbs admin 0.000GB config 0.000GB local 0.000GB school 0.000GB > //删除school数据库 > use school switched to db school > db.dropDatabase() { "dropped" : "school", "ok" : 1 } > > > show dbs admin 0.000GB config 0.000GB local 0.000GB > //退出MongoDB客户端 > exit bye [root@linux bin]#
2】、我们开始还原我们的school数据库吧，我们从集合来恢复数据库。
//还原users集合 [root@linux bin]# ./mongorestore -h 192.168.127.130:27017 --collection users --db school ./databaseBack/school/users.bson 2018-06-13T13:16:52.118+0800 checking for collection data in databaseBack/school/users.bson 2018-06-13T13:16:52.120+0800 reading metadata for school.users from databaseBack/school/users.metadata.json 2018-06-13T13:16:52.148+0800 restoring school.users from databaseBack/school/users.bson 2018-06-13T13:16:52.218+0800 no indexes to restore 2018-06-13T13:16:52.218+0800 finished restoring school.users (6 documents) 2018-06-13T13:16:52.219+0800 done //还原geoInstance集合 [root@linux bin]# ./mongorestore -h 192.168.127.130:27017 --collection geoInstance --db school ./databaseBack/school/geoInstance.bson 2018-06-13T13:18:26.353+0800 checking for collection data in databaseBack/school/geoInstance.bson 2018-06-13T13:18:26.358+0800 reading metadata for school.geoInstance from databaseBack/school/geoInstance.metadata.json 2018-06-13T13:18:26.386+0800 restoring school.geoInstance from databaseBack/school/geoInstance.bson 2018-06-13T13:18:26.456+0800 restoring indexes for collection school.geoInstance from metadata 2018-06-13T13:18:26.475+0800 finished restoring school.geoInstance (6 documents) 2018-06-13T13:18:26.475+0800 done
3】、查看一下我们还原的数据。
[root@linux bin]# ./mongo --host=192.168.127.130 --port=27017 MongoDB shell version v3.6.3 connecting to: mongodb://192.168.127.130:27017/ MongoDB server version: 3.6.3 Server has startup warnings: 2018-06-13T11:27:09.721+0800 I CONTROL [initandlisten] 2018-06-13T11:27:09.721+0800 I CONTROL [initandlisten] ** WARNING: Access control is not enabled for the database. 2018-06-13T11:27:09.721+0800 I CONTROL [initandlisten] ** Read and write access to data and configuration is unrestricted. 2018-06-13T11:27:09.721+0800 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2018-06-13T11:27:09.721+0800 I CONTROL [initandlisten] 2018-06-13T11:27:09.723+0800 I CONTROL [initandlisten] 2018-06-13T11:27:09.723+0800 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2018-06-13T11:27:09.723+0800 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2018-06-13T11:27:09.723+0800 I CONTROL [initandlisten] > > > show dbs admin 0.000GB config 0.000GB local 0.000GB school 0.000GB > > > use school switched to db school > > show tables geoInstance users > > > db.users.find() { "_id" : ObjectId("5b1e044733091e826f7c2c74"), "title" : "MongoDb Overview", "description" : "Mongodb is not sql database", "author" : "huangFeiHong", "url" : "http://www.huangfeihong.com", "tags" : [ "mongodb", "database", "NoSql" ], "likes" : 100, "quantity" : 4 } { "_id" : ObjectId("5b1e044733091e826f7c2c75"), "title" : "NoSql Overview", "description" : "No sql database is very fast", "author" : "huangFeiHong", "url" : "http://www.huangfeihong.com", "tags" : [ "mongodb", "database", "NoSql" ], "likes" : 10, "quantity" : 12 } { "_id" : ObjectId("5b1e044733091e826f7c2c76"), "title" : "Log4Net Overview", "description" : "log4net is not sql database", "author" : "linChong", "url" : "http://www.linchong.com", "tags" : [ "log", "net", "NoSQL" ], "likes" : 750, "quantity" : 6 } { "_id" : ObjectId("5b1e1bfb33091e826f7c2c77"), "title" : "MongoDb Higher", "description" : "Mongodb is not sql database", "author" : "huangFeiHong", "url" : "http://www.huangfeihong.com", "tags" : [ "mongodb", "database", "NoSql" ], "likes" : 120, "quantity" : 4 } { "_id" : ObjectId("5b1e1bfb33091e826f7c2c78"), "title" : "NoSql Redis Overview", "description" : "No sql database is very fast", "author" : "linChong", "url" : "http://www.linchong.com", "tags" : [ "redis", "database", "NoSql" ], "likes" : 30, "quantity" : 33 } { "_id" : ObjectId("5b1e1bfb33091e826f7c2c79"), "title" : "Memcached Overrivew", "description" : "Memcached is sql database", "author" : "wuSong", "url" : "http://www.wusong.com", "tags" : [ "memcached", "cache", "NoSQL" ], "likes" : 50, "quantity" : 10 } > > > db.geoInstance.find() { "_id" : ObjectId("5b1f4d21cf30d7cba03d5e03"), "loc" : [ 1, 3 ] } { "_id" : ObjectId("5b1f4d21cf30d7cba03d5e04"), "loc" : [ 3, 4 ] } { "_id" : ObjectId("5b1f4d21cf30d7cba03d5e05"), "loc" : [ 0, -3 ] } { "_id" : ObjectId("5b1f4d21cf30d7cba03d5e06"), "loc" : [ -6, 2 ] } { "_id" : ObjectId("5b1f4d21cf30d7cba03d5e07"), "loc" : { "x" : 9, "y" : 5 } } { "_id" : ObjectId("5b1f4d21cf30d7cba03d5e08"), "loc" : { "lng" : -9.2, "lat" : 21.3 } }
4】、我们可以使用nsInclude参数来恢复指定集合的数据。
[root@linux bin]# ./mongorestore -h 192.168.127.130:27017 --nsInclude school.users ./databaseBack/ 2018-06-13T14:19:59.942+0800 preparing collections to restore from 2018-06-13T14:19:59.946+0800 reading metadata for school.users from databaseBack/school/users.metadata.json 2018-06-13T14:19:59.970+0800 restoring school.users from databaseBack/school/users.bson 2018-06-13T14:19:59.977+0800 no indexes to restore 2018-06-13T14:19:59.977+0800 finished restoring school.users (6 documents) 2018-06-13T14:19:59.977+0800 done //这是在有数据的情况下执行恢复 [root@linux bin]# ./mongorestore -h 192.168.127.130:27017 --nsInclude school.users ./databaseBack/ 2018-06-13T14:21:10.743+0800 preparing collections to restore from 2018-06-13T14:21:10.747+0800 reading metadata for school.users from databaseBack/school/users.metadata.json 2018-06-13T14:21:10.748+0800 restoring school.users from databaseBack/school/users.bson 2018-06-13T14:21:10.755+0800 error: multiple errors in bulk operation: - E11000 duplicate key error collection: school.users index: _id_ dup key: { : ObjectId('5b1e044733091e826f7c2c74') } - E11000 duplicate key error collection: school.users index: _id_ dup key: { : ObjectId('5b1e044733091e826f7c2c75') } - E11000 duplicate key error collection: school.users index: _id_ dup key: { : ObjectId('5b1e044733091e826f7c2c76') } - E11000 duplicate key error collection: school.users index: _id_ dup key: { : ObjectId('5b1e1bfb33091e826f7c2c77') } - E11000 duplicate key error collection: school.users index: _id_ dup key: { : ObjectId('5b1e1bfb33091e826f7c2c78') } - E11000 duplicate key error collection: school.users index: _id_ dup key: { : ObjectId('5b1e1bfb33091e826f7c2c79') } 2018-06-13T14:21:10.755+0800 no indexes to restore 2018-06-13T14:21:10.755+0800 finished restoring school.users (6 documents) 2018-06-13T14:21:10.755+0800 done
5】、我们可以使用zip压缩文件，通过archive参数来恢复指定数据库的数据。
[root@linux bin]# ./mongorestore -h 192.168.127.130:27017 --gzip --db school --archive=./backZip/school.2018613.gz 2018-06-13T14:26:48.939+0800 the --db and --collection args should only be used when restoring from a BSON file. Other uses are deprecated and will not exist in the future; use --nsInclude instead 2018-06-13T14:26:49.591+0800 preparing collections to restore from 2018-06-13T14:26:50.041+0800 reading metadata for school.geoInstance from archive './backZip/school.2018613.gz' 2018-06-13T14:26:50.071+0800 restoring school.geoInstance from archive './backZip/school.2018613.gz' 2018-06-13T14:26:51.132+0800 restoring indexes for collection school.geoInstance from metadata 2018-06-13T14:26:51.150+0800 finished restoring school.geoInstance (6 documents) 2018-06-13T14:26:51.152+0800 reading metadata for school.users from archive './backZip/school.2018613.gz' 2018-06-13T14:26:51.181+0800 restoring school.users from archive './backZip/school.2018613.gz' 2018-06-13T14:26:51.837+0800 no indexes to restore 2018-06-13T14:26:51.838+0800 finished restoring school.users (6 documents) 2018-06-13T14:26:51.838+0800 done //以前已经删除了school数据库 [root@linux bin]# ./mongo --host 192.168.127.130 --port=27017 MongoDB shell version v3.6.3 connecting to: mongodb://192.168.127.130:27017/ MongoDB server version: 3.6.3 Server has startup warnings: 2018-06-13T11:27:09.721+0800 I CONTROL [initandlisten] 2018-06-13T11:27:09.721+0800 I CONTROL [initandlisten] ** WARNING: Access control is not enabled for the database. 2018-06-13T11:27:09.721+0800 I CONTROL [initandlisten] ** Read and write access to data and configuration is unrestricted. 2018-06-13T11:27:09.721+0800 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2018-06-13T11:27:09.721+0800 I CONTROL [initandlisten] 2018-06-13T11:27:09.723+0800 I CONTROL [initandlisten] 2018-06-13T11:27:09.723+0800 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2018-06-13T11:27:09.723+0800 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2018-06-13T11:27:09.723+0800 I CONTROL [initandlisten] > show dbs admin 0.000GB config 0.000GB local 0.000GB school 0.000GB //数据库已经存在了，说明恢复成功
五、结束
好了，就是这些了。MongoDB的备份和还原还是有很多内容的，mongodump和mongorestore命令有很多参数可以去配置，今天只是一个初步认知，如果大家想查看更详细的内容，可以查看英文的网站。地址如下：https://docs.mongodb.com/manual/reference/program/mongodump/。不忘初心，继续努力吧。
