tomcat 隨機(jī)宕機(jī) 問題 未解決。。。。記錄

問題：

最近在測(cè)試環(huán)境上出現(xiàn)一個(gè)隨機(jī)宕機(jī)的問題，而且還沒有出現(xiàn)異常日志，唯一的就是tomcat的關(guān)閉的日志：

20170919:10:53:46.327 [DubboServerHandler-120.26.209.77:20882-thread-195] [com.souche.knox.rule.async.biz.SynchronousResolver:85] INFO? ===規(guī)則腳本執(zhí)行成功===，taskid:831501，結(jié)果：null

20170919:10:53:46.356 [DubboServerHandler-120.26.209.77:20882-thread-195] [com.souche.knox.invoke.service.impl.RuleServiceImpl:97] INFO? ********RuleService end result:{"code":"tangeche_down_payment_ratio","data":{"dscDownPaymentRatio":18},"ruleId":121,"ruleName":"彈個(gè)車首付比例配置規(guī)則","ruleVersion":"1.0.0","status":"FINISHED","success":true,"taskId":831501}

20170919:10:53:52.608 [DubboServerHandler-120.26.209.77:20882-thread-197] [com.souche.knox.invoke.service.impl.RuleServiceImpl:65] INFO? ********RuleService start ruleCode:tangeche_formula,param:{canzhi=100, carType=1, fee=200, guidePrice=100, repurchasePrice=null, loanPeriod=12, bargainPrice=null}

20170919:10:53:52.630 [DubboServerHandler-120.26.209.77:20882-thread-197] [com.souche.knox.rule.async.biz.SynchronousResolver:85] INFO? ===規(guī)則腳本執(zhí)行成功===，taskid:831502，結(jié)果：null

20170919:10:53:52.653 [DubboServerHandler-120.26.209.77:20882-thread-197] [com.souche.knox.invoke.service.impl.RuleServiceImpl:97] INFO? ********RuleService end result:{"code":"tangeche_formula","data":{"SXXZ":100},"ruleId":152,"ruleName":"彈個(gè)車授信公式配置規(guī)則","ruleVersion":"2.0.0","status":"FINISHED","success":true,"taskId":831502}

20170919:10:53:52.659 [DubboServerHandler-120.26.209.77:20882-thread-198] [com.souche.knox.invoke.service.impl.RuleServiceImpl:65] INFO? ********RuleService start ruleCode:tangeche_down_payment_ratio,param:{alipayDownPaymentRatio=17, idCardNo=430482199105209271}

20170919:10:53:52.678 [DubboServerHandler-120.26.209.77:20882-thread-198] [com.souche.knox.rule.async.biz.SynchronousResolver:85] INFO? ===規(guī)則腳本執(zhí)行成功===，taskid:831503，結(jié)果：null

20170919:10:53:52.700 [DubboServerHandler-120.26.209.77:20882-thread-198] [com.souche.knox.invoke.service.impl.RuleServiceImpl:97] INFO? ********RuleService end result:{"code":"tangeche_down_payment_ratio","data":{"dscDownPaymentRatio":18},"ruleId":121,"ruleName":"彈個(gè)車首付比例配置規(guī)則","ruleVersion":"1.0.0","status":"FINISHED","success":true,"taskId":831503}

19-Sep-2017 10:53:53.374 INFO [Thread-10] org.apache.coyote.AbstractProtocol.pause Pausing ProtocolHandler ["http-nio-4025"]

19-Sep-2017 10:53:53.382 INFO [Thread-10] org.apache.coyote.AbstractProtocol.pause Pausing ProtocolHandler ["ajp-nio-4030"]

20170919:10:53:53.415 [DubboShutdownHook] [org.apache.zookeeper.ZooKeeper:684] INFO? Session: 0x15afe4318e5c818 closed

20170919:10:53:53.415 [DEFAULT.handleRunTaskJob_Scheduler_QuartzSchedulerThread-EventThread] [org.apache.zookeeper.ClientCnxn$EventThread:519] INFO? EventThread shut down for session: 0x15afe4318e5c818

19-Sep-2017 10:53:53.434 INFO [Thread-10] org.apache.catalina.core.StandardService.stopInternal Stopping service Catalina

20170919:10:53:53.476 [DubboShutdownHook] [org.apache.zookeeper.ZooKeeper:684] INFO? Session: 0x15afe4318e5c813 closed

20170919:10:53:53.476 [localhost-startStop-1-EventThread] [org.apache.zookeeper.ClientCnxn$EventThread:519] INFO? EventThread shut down for session: 0x15afe4318e5c813

19-Sep-2017 10:53:53.509 WARNING [localhost-startStop-2] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [ROOT] appears to have started a thread named [Curator-ConnectionStateManager-0] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:

sun.misc.Unsafe.park(Native Method)

java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)

java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)

java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403)

org.apache.curator.framework.state.ConnectionStateManager.processEvents(ConnectionStateManager.java:245)

org.apache.curator.framework.state.ConnectionStateManager.access$000(ConnectionStateManager.java:43)

org.apache.curator.framework.state.ConnectionStateManager$1.call(ConnectionStateManager.java:111)

java.util.concurrent.FutureTask.run(FutureTask.java:266)

java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)


其中加粗部分是異常的開始點(diǎn)，下面是正常的進(jìn)行tomcat關(guān)閉，

自己的環(huán)境配置：

環(huán)境：

Java version: 1.8.0_77

Server version: Apache Tomcat/8.0.39


jvm配置：

/opt/souche/java/bin/java

-Djava.util.logging.config.file=/home/souche/server/knox-rule-service/conf/logging.properties

-Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager

-Djdk.tls.ephemeralDHKeySize=2048

-Djava.protocol.handler.pkgs=org.apache.catalina.webresources

-server

-Xms512m

-Xmx512m

-XX:PermSize=256m

-XX:MaxPermSize=256m

-Xmn256m

-Djava.endorsed.dirs=/home/souche/server/knox-rule-service/endorsed

-classpath /home/souche/server/knox-rule-service/bin/bootstrap.jar:/home/souche/server/knox-rule-service/bin/tomcat-juli.jar

-Dcatalina.base=/home/souche/server/knox-rule-service

-Dcatalina.home=/home/souche/server/knox-rule-service

-Djava.io.tmpdir=/home/souche/server/knox-rule-service/temp?

org.apache.catalina.startup.Bootstrap start



********************************************************************************************************************************************

個(gè)人思路：

首先排查jvm的方面的東西，于是對(duì)jvm做了一些優(yōu)化，但是還是沒有作用，還是會(huì)出現(xiàn)這種異常

/opt/souche/java/bin/java

-Djava.util.logging.config.file=/home/souche/server/knox-rule-service/conf/logging.properties

-Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager

-Djdk.tls.ephemeralDHKeySize=2048

-Djava.protocol.handler.pkgs=org.apache.catalina.webresources

-server

-Xms1024m

-Xmx1024m

-XX:+PrintGCDetails

-XX:+PrintGCDateStamps

-XX:PermSize=64m

-XX:MaxPermSize=128m

-Xmn512m

-XX:+HeapDumpOnOutOfMemoryError

-XX:HeapDumpPath=/home/souche/server/knox-rule-service/logs/heapdump/heap.bin

-Xloggc:/home/souche/server/knox-rule-service/logs/gc.log -Djava.endorsed.dirs=/home/souche/server/knox-rule-service/endorsed

-classpath /home/souche/server/knox-rule-service/bin/bootstrap.jar:/home/souche/server/knox-rule-service/bin/tomcat-juli.jar

-Dcatalina.base=/home/souche/server/knox-rule-service -Dcatalina.home=/home/souche/server/knox-rule-service

-Djava.io.tmpdir=/home/souche/server/knox-rule-service/temp

org.apache.catalina.startup.Bootstrap start

這里修改主要是參考鏈接

http://vekergu.blog.51cto.com/9966832/1619640

這里主要是對(duì)堆的分配和GC日志定位添加日志和進(jìn)行定位，但是發(fā)現(xiàn)，我這里的問題并不是上面的這個(gè)，我這里的打印都是很正常的

2017-09-19T22:01:06.826+0800: 3833.058: [GC (Allocation Failure) [PSYoungGen: 523661K->333K(523776K)] 768894K->245566K(1048064K), 0.0046172 secs] [Times: user=0.01 sys=0.00, real=0.00 secs]

2017-09-19T22:01:17.471+0800: 3843.702: [GC (Allocation Failure) [PSYoungGen: 523597K->410K(523776K)] 768830K->245659K(1048064K), 0.0055236 secs] [Times: user=0.01 sys=0.00, real=0.01 secs]

2017-09-19T22:01:18.107+0800: 3844.339: [GC (Allocation Failure) [PSYoungGen: 523674K->506K(523776K)] 768923K->245771K(1048064K), 0.0070453 secs] [Times: user=0.02 sys=0.00, real=0.01 secs]

2017-09-19T22:01:18.766+0800: 3844.998: [GC (Allocation Failure) [PSYoungGen: 523770K->346K(522752K)] 769035K->245611K(1047040K), 0.0053823 secs] [Times: user=0.01 sys=0.00, real=0.00 secs]

2017-09-19T22:01:29.408+0800: 3855.640: [GC (Allocation Failure) [PSYoungGen: 522586K->365K(523264K)] 767851K->245630K(1047552K), 0.0049888 secs] [Times: user=0.01 sys=0.00, real=0.01 secs]

2017-09-19T22:01:30.078+0800: 3856.310: [GC (Allocation Failure) [PSYoungGen: 522605K->384K(523776K)] 767870K->245657K(1048064K), 0.0054023 secs] [Times: user=0.01 sys=0.00, real=0.01 secs]

太多就不截取了

根據(jù)異常關(guān)鍵字Pausing ProtocolHandler 搜索到相關(guān)的文章

后來參考了幾個(gè)文章

https://stackoverflow.com/questions/30759220/tomcat8-shutdown-randomly-with-abstractprotocol-pause

上面這個(gè)跟自己的問題很像，但是我們這邊沒有辦法更改權(quán)限。他這里將web用戶更改為root之后就Ok ,但是我這邊是測(cè)試環(huán)境有問題，但是線上的沒有，線上的和本地測(cè)試的權(quán)限都是一樣的。

問題遺留。。。。。。。


參考鏈接

https://link.zhihu.com/?target=http%3A//hongjiang.info/why-kill-2-cannot-stop-tomcat/

http://vekergu.blog.51cto.com/9966832/1619640

https://stackoverflow.com/questions/30759220/tomcat8-shutdown-randomly-with-abstractprotocol-pause

http://www.365mini.com/page/tomcat-connector-mode.htm?(tomcat優(yōu)化)

最后編輯于 ：
?著作權(quán)歸作者所有,轉(zhuǎn)載或內(nèi)容合作請(qǐng)聯(lián)系作者
平臺(tái)聲明：文章內(nèi)容（如有圖片或視頻亦包括在內(nèi)）由作者上傳并發(fā)布，文章內(nèi)容僅代表作者本人觀點(diǎn)，簡(jiǎn)書系信息發(fā)布平臺(tái)，僅提供信息存儲(chǔ)服務(wù)。

推薦閱讀更多精彩內(nèi)容

  • Spring Cloud為開發(fā)人員提供了快速構(gòu)建分布式系統(tǒng)中一些常見模式的工具（例如配置管理，服務(wù)發(fā)現(xiàn)，斷路器，智...
    卡卡羅2017閱讀 134,923評(píng)論 18贊 139
  • ** 今天看了一下kafka官網(wǎng)，嘗試著在自己電腦上安裝和配置，然后學(xué)一下官方document。** Introd...
    RainChang閱讀 5,044評(píng)論 1贊 30
  • ] ERROR org.apache.spark.executor.Executor[91] - Exceptio...
    博瑜閱讀 2,362評(píng)論 0贊 0
  • 1、運(yùn)行環(huán)境 主機(jī)IP 主機(jī)名 2、配置主機(jī)名(分別在五臺(tái)機(jī)器上執(zhí)行) hostname +主機(jī)名例如： h...
    獻(xiàn)給記性不好的自己閱讀 3,590評(píng)論 0贊 6
  • 我一項(xiàng)是個(gè)對(duì)節(jié)日不敏感的人，通常節(jié)日的到來，我都是由身邊的人提醒才得知，自己并不上心。包括母親節(jié)，或者父親節(jié)，我連...
    小饅頭0601閱讀 251評(píng)論 0贊 2