MongoDB副本集搭建和測試

前段時間花了時間看了看mongodb,室友買了mongodb權威指南也借過來瞅瞅,書對于剛剛接觸的人還是不錯的。廢話不多說上代碼。

1 .搭建環境

 MacBook pro 15款840 <p>
 VMWare Fusion8 <p>
 Centos 6.7 <p>
 mongodb-linux-x86_64-3.0.6.tgz
  1. 安裝mongodb
    這一步其實就是一個解壓的過程。很簡單。
    在安裝前把dbpath和logpath路徑新建好,然后會報錯。
     [root@rabbitmq-node2 ~]# mkdir -p /mongodb/data/arbiter
     [root@rabbitmq-node2 ~]# mkdir -p /mongodb/logs
     [root@rabbitmq-node2 data]# cd /usr/programmer/
     [root@rabbitmq-node2 programmer]# tar zxf mongodb-linux-x86_64-3.0.6.tgz 
     [root@rabbitmq-node2 programmer]# mv mongodb-linux-x86_64-3.0.6 mongodb
     [root@rabbitmq-node2 programmer]# mv mongodb /usr/local/
     [root@rabbitmq-node2 programmer]# ls
        apache-tomcat-8.0.26.tar.gz     nginx-1.9.4.tar.gz
        erlang-17.4-1.el6.x86_64.rpm    openssl-1.0.2c.tar.gz
        go1.4.2.linux-amd64.tar.gz      rabbitmq-server-3.5.6-1.noarch.rpm
        jdk-7u80-linux-x64.tar.gz       redis-3.0.3.tar
        mongodb-linux-x86_64-3.0.6.tgz  solr-5.2.1.tgz
        mongodb-osx-x86_64-3.0.6.tgz    zookeeper-3.4.6.tar.gz
        nginx-1.8.0.tar.gz
     [root@rabbitmq-node2 programmer]# cd /usr/local/
     [root@rabbitmq-node2 local]# cd mongodb/
     [root@rabbitmq-node2 mongodb]# ls
          bin  GNU-AGPL-3.0  README  THIRD-PARTY-NOTICES
     [root@rabbitmq-node2 mongodb]# mkdir conf
     [root@rabbitmq-node2 mongodb]# cd conf/
  這里有三臺虛擬機都是一樣這樣安裝。我就省略其他的了。
  1. 副本集群搭建
    進入集群搭建,需要加一些配置:如下
#master.conf
#數據存放目錄
dbpath=/mongodb/data/master
#日志存放目錄
logpath=/mongodb/logs/master.log
#進程文件
pidfilepath=/mongodb/master.pid
#按照數據庫名字建立目錄存放數據
directoryperdb=true
#指定日志文件,該文件將保存所有的日志記錄、診斷信息。除非另有指定,
#mongod將所有的日志信息輸出到標準輸出。如果沒有指定logappend,重啟則日
#志會進行覆蓋操作
logappend=true
#副本集名字
replSet=szss
#綁定IP地址
bind_ip=192.168.31.101
#端口號
port=27017
#操作日志大小
oplogSize=10000
#是否后臺運行 進程在后臺運行的守護進程模式
fork=true
#預分配文件縮短啟動時間
noprealloc=true

注意如果之后關閉mongodb后重啟報錯,可能是你強行關閉造成鎖表,或者因為你的磁盤不夠大了。需要加上 nojournal = true 關閉操作日志。 但是 非常不建議這樣做。因為它可以幫助你備份和故障修復,提高寫入的速率。

其他的兩個配置也是大差不差。就不一一貼代碼了。

啟動mongodb服務:

[root@rabbitmq-node1 bin]# ./mongod --fork --rest ../conf/master.config 

2015-11-04T15:58:02.803-0500 I CONTROL  ** WARNING: --rest is specified without --httpinterface,

2015-11-04T15:58:02.803-0500 I CONTROL  **          enabling http interface

BadValue --fork has to be used with --logpath or --syslog

try './mongod --help' for more information

[root@rabbitmq-node1 bin]# ./mongod --rest -f  ../conf/master.config 

2015-11-04T15:58:41.235-0500 I CONTROL  ** WARNING: --rest is specified without --httpinterface,

2015-11-04T15:58:41.235-0500 I CONTROL  **          enabling http interface

note: noprealloc may hurt performance in many applications

about to fork child process, waiting until server is ready for connections.

forked process: 2494

child process started successfully, parent exiting
[root@rabbitmq-node1 bin]# ps -ef | grep mongod
root       2494      1  0 15:58 ?        00:00:00 ./mongod --rest -f ../conf/master.config
root       2537   2382  0 16:01 pts/0    00:00:00 grep mongod
[root@rabbitmq-node1 bin]# ./mongo 192.168.31.101:27017

MongoDB shell version: 3.0.6

connecting to: 192.168.31.101:27017/test

Server has startup warnings: 

2015-11-04T15:49:55.987-0500 I CONTROL  [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended.

2015-11-04T15:49:55.987-0500 I CONTROL  [initandlisten] 

2015-11-04T15:49:55.987-0500 I CONTROL  [initandlisten] 

2015-11-04T15:49:55.987-0500 I CONTROL  [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'.

2015-11-04T15:49:55.987-0500 I CONTROL  [initandlisten] **        We suggest setting it to 'never'

2015-11-04T15:49:55.987-0500 I CONTROL  [initandlisten] 

2015-11-04T15:49:55.987-0500 I CONTROL  [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'.

2015-11-04T15:49:55.987-0500 I CONTROL  [initandlisten] **        We suggest setting it to 'never'

2015-11-04T15:49:55.987-0500 I CONTROL  [initandlisten] 

> use admin

switched to db admin

> db.shutdownServer();

assert failed : unexpected error: Error: shutdownServer failed: shutdown must run from localhost when running db without auth

Error: assert failed : unexpected error: Error: shutdownServer failed: shutdown must run from localhost when running db without auth

    at Error (<anonymous>)

    at doassert (src/mongo/shell/assert.js:11:14)

    at assert (src/mongo/shell/assert.js:20:5)

    at DB.shutdownServer (src/mongo/shell/db.js:212:9)

    at (shell):1:4

2015-11-04T15:54:48.911-0500 E QUERY    Error: assert failed : unexpected error: Error: shutdownServer failed: shutdown must run from localhost when running db without auth

    at Error (<anonymous>)

    at doassert (src/mongo/shell/assert.js:11:14)

    at assert (src/mongo/shell/assert.js:20:5)

    at DB.shutdownServer (src/mongo/shell/db.js:212:9)

    at (shell):1:4 at src/mongo/shell/assert.js:13

> ^C

bye

--rest是開啟webUI監考頁面

這里寫圖片描述

這里說 使用使用這種方式關閉服務 必須在有登錄驗證情況下遠程ssh才擁有這個權限的,所以

[root@rabbitmq-node1 bin]# ./mongod --shutdown --dbpath /mongodb/data/master/

killing process with pid: 2434

使用客戶端命令來關閉。

啟動mongodb服務:

[root@rabbitmq-node1 bin]# ./mongo 127.0.0.1

MongoDB shell version: 3.0.6

connecting to: 127.0.0.1/test

2015-11-04T16:01:53.200-0500 W NETWORK  Failed to connect to 127.0.0.1:27017, reason: errno:111 Connection refused

2015-11-04T16:01:53.201-0500 E QUERY    Error: couldn't connect to server 127.0.0.1:27017 (127.0.0.1), connection attempt failed

    at connect (src/mongo/shell/mongo.js:181:14)

    at (connect):1:6 at src/mongo/shell/mongo.js:181

exception: connect failed

可以看出是不識別localhost 127.0.0.1的

[root@rabbitmq-node1 bin]# ./mongo 192.168.31.101
MongoDB shell version: 3.0.6
connecting to: 192.168.31.101/test
Server has startup warnings: 
2015-11-04T15:58:41.235-0500 I CONTROL  ** WARNING: --rest is specified without --httpinterface,
2015-11-04T15:58:41.235-0500 I CONTROL  **          enabling http interface
2015-11-04T15:58:41.304-0500 I CONTROL  [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended.
2015-11-04T15:58:41.304-0500 I CONTROL  [initandlisten] 
2015-11-04T15:58:41.304-0500 I CONTROL  [initandlisten] 
2015-11-04T15:58:41.304-0500 I CONTROL  [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'.
2015-11-04T15:58:41.304-0500 I CONTROL  [initandlisten] **        We suggest setting it to 'never'
2015-11-04T15:58:41.304-0500 I CONTROL  [initandlisten] 
2015-11-04T15:58:41.304-0500 I CONTROL  [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'.
2015-11-04T15:58:41.304-0500 I CONTROL  [initandlisten] **        We suggest setting it to 'never'
2015-11-04T15:58:41.304-0500 I CONTROL  [initandlisten] 
> use admin
switched to db admin
> cfg={ "_id" : "szss", "members" : [ {  "_id" : 0,  "host" : "192.168.31.101:27017"  }  ]  }
{
    "_id": "szss",
    "members": [
        {
            "_id": 0,
            "host": "192.168.31.101:27017"
        }
    ]
}
> rs.initiate(cfg)
{ "ok" : 1 }
szss:OTHER> rs.add("192.168.31.154:27017")
{ "ok" : 1 }
szss:PRIMARY> rs.add("192.168.31.159:27017")
{ "ok" : 1 }

加入集群配置 并初始化 并且加上其他虛機的服務 這里也可以一步到位。 我也比較推薦這種方式。

{
    _id: "szss",
    members: [
        {
            _id: 0,
            host: '192.168.31.101: 27017',
            priority: 2
        },
        {
            _id: 1,
            host: '192.168.31.154: 27017',
            priority: 1
        },
        {
            _id: 2,
            host: '192.168.31.159: 27017',
            arbiterOnly: true
        }
    ]
};

這種方式是 主節點,備節點,仲裁節點的副本集集群,但是在實際中,仲裁節點比較雞肋,他要占用一個服務,但是只是為了投票而已,只要將備節點的個數控制在奇數就足夠了。
回到現在的這種副本集集群搭建的方式,現在要賦予節點權重。權重是選舉中優先級最高的。

szss:PRIMARY> rs.conf()
{
    "_id": "szss",
    "version": 3,
    "members": [
        {
            "_id": 0,
            "host": "192.168.31.101:27017",
            "arbiterOnly": false,
            "buildIndexes": true,
            "hidden": false,
            "priority": 1,
            "tags": {
                
            },
            "slaveDelay": 0,
            "votes": 1
        },
        {
            "_id": 1,
            "host": "192.168.31.154:27017",
            "arbiterOnly": false,
            "buildIndexes": true,
            "hidden": false,
            "priority": 1,
            "tags": {
                
            },
            "slaveDelay": 0,
            "votes": 1
        },
        {
            "_id": 2,
            "host": "192.168.31.159:27017",
            "arbiterOnly": false,
            "buildIndexes": true,
            "hidden": false,
            "priority": 1,
            "tags": {
                
            },
            "slaveDelay": 0,
            "votes": 1
        }
    ],
    "settings": {
        "chainingAllowed": true,
        "heartbeatTimeoutSecs": 10,
        "getLastErrorModes": {
            
        },
        "getLastErrorDefaults": {
            "w": 1,
            "wtimeout": 0
        }
    }
}
szss:PRIMARY> cfgs=rs.conf()
{
    "_id": "szss",
    "version": 3,
    "members": [
        {
            "_id": 0,
            "host": "192.168.31.101:27017",
            "arbiterOnly": false,
            "buildIndexes": true,
            "hidden": false,
            "priority": 1,
            "tags": {},
            "slaveDelay": 0,
            "votes": 1
        },
        {
            "_id": 1,
            "host": "192.168.31.154:27017",
            "arbiterOnly": false,
            "buildIndexes": true,
            "hidden": false,
            "priority": 1,
            "tags": {},
            "slaveDelay": 0,
            "votes": 1
        },
        {
            "_id": 2,
            "host": "192.168.31.159:27017",
            "arbiterOnly": false,
            "buildIndexes": true,
            "hidden": false,
            "priority": 1,
            "tags": {},
            "slaveDelay": 0,
            "votes": 1
        }
    ],
    "settings": {
        "chainingAllowed": true,
        "heartbeatTimeoutSecs": 10,
        "getLastErrorModes": {},
        "getLastErrorDefaults": {
            "w": 1,
            "wtimeout": 0
        }
    }
}
#賦予權重
szss:PRIMARY> cfgs.members[0].priority=2
2
szss:PRIMARY> rs.conf()
{
    "_id": "szss",
    "version": 3,
    "members": [
        {
            "_id": 0,
            "host": "192.168.31.101:27017",
            "arbiterOnly": false,
            "buildIndexes": true,
            "hidden": false,
            "priority": 1,
            "tags": {},
            "slaveDelay": 0,
            "votes": 1
        },
        {
            "_id": 1,
            "host": "192.168.31.154:27017",
            "arbiterOnly": false,
            "buildIndexes": true,
            "hidden": false,
            "priority": 1,
            "tags": {},
            "slaveDelay": 0,
            "votes": 1
        },
        {
            "_id": 2,
            "host": "192.168.31.159:27017",
            "arbiterOnly": false,
            "buildIndexes": true,
            "hidden": false,
            "priority": 1,
            "tags": {},
            "slaveDelay": 0,
            "votes": 1
        }
    ],
    "settings": {
        "chainingAllowed": true,
        "heartbeatTimeoutSecs": 10,
        "getLastErrorModes": {},
        "getLastErrorDefaults": {
            "w": 1,
            "wtimeout": 0
        }
    }
}
#重新讀取 初始化
szss:PRIMARY> rs.reconfig(cfgs)
{ "ok" : 1 }

進入到瀏覽器 輸入 192.168.31.101:28017 如果是27017將訪問不了,需要將啟動端口號加上1000


這里寫圖片描述
  1. 測試
    測試一下集群是否可用:
    關掉主節點,模擬主節點宕機的情景
[root@rabbitmq-node1 bin]# ps -ef | grep mongod
root       2494      1  0 15:58 ?        00:00:17 ./mongod --rest -f ../conf/master.config
root       3344   2382  0 16:30 pts/0    00:00:00 grep mongod
[root@rabbitmq-node1 bin]# kill -9 2494

看一下備節點的狀態:

這里寫圖片描述

這里可以看到備節點已經變為主節點。

szss:PRIMARY> 
for(var i=0;i<10000;i++)db.test.insert(
 {
    "name": "lxc"+i,
    "age": 22,
    "sex": "man"
 }
)
WriteResult({ "nInserted" : 1 })

在主節點插入1w條數據。再看看備節點。

szss:SECONDARY> use admin
switched to db admin
szss:SECONDARY> use test
switched to db test
szss:SECONDARY> db.getMongo().setSlaveOk()
szss:SECONDARY> db.test.count()
10000
szss:SECONDARY> 
szss:SECONDARY> use test
switched to db test
szss:SECONDARY> db.getMongo().setSlaveOk()
szss:SECONDARY> db.test.count()
10000

均已經同步過來了。

到這里就基本完成搭建了。mongodb的中文社區也很不錯。而且它的官方文檔寫的也很不錯。一起學習吧~

借鑒大神的文章:

http://www.cnblogs.com/zhanjindong/category/507349.html

http://www.mongoing.com

http://blog.csdn.net/luonanqin/article/details/8497860

歡迎光臨我的個人博客

最后編輯于
?著作權歸作者所有,轉載或內容合作請聯系作者
平臺聲明:文章內容(如有圖片或視頻亦包括在內)由作者上傳并發布,文章內容僅代表作者本人觀點,簡書系信息發布平臺,僅提供信息存儲服務。

推薦閱讀更多精彩內容