Cassandra消化不匹配异常在DCOS中运行码头容器
问题描述:
Cassandra发出摘要不匹配错误。在所有节点上重新启动服务都无济于事。Cassandra消化不匹配异常在DCOS中运行码头容器
ERROR 10:55:11 Exception in thread Thread[HintsDispatcher:2,1,main]
org.apache.cassandra.io.FSReadError: java.io.IOException: Digest mismatch exception
at org.apache.cassandra.hints.HintsReader$HintsIterator.computeNext(HintsReader.java:199) ~[apache-cassandra-3.0.14.jar:3.0.14]
at org.apache.cassandra.hints.HintsReader$HintsIterator.computeNext(HintsReader.java:164) ~[apache-cassandra-3.0.14.jar:3.0.14]
at org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) ~[apache-cassandra-3.0.14.jar:3.0.14]
at org.apache.cassandra.hints.HintsDispatcher.sendHints(HintsDispatcher.java:157) ~[apache-cassandra-3.0.14.jar:3.0.14]
at org.apache.cassandra.hints.HintsDispatcher.sendHintsAndAwait(HintsDispatcher.java:139) ~[apache-cassandra-3.0.14.jar:3.0.14]
at org.apache.cassandra.hints.HintsDispatcher.dispatch(HintsDispatcher.java:123) ~[apache-cassandra-3.0.14.jar:3.0.14]
at org.apache.cassandra.hints.HintsDispatcher.dispatch(HintsDispatcher.java:95) ~[apache-cassandra-3.0.14.jar:3.0.14]
at org.apache.cassandra.hints.HintsDispatchExecutor$DispatchHintsTask.deliver(HintsDispatchExecutor.java:268) ~[apache-cassandra-3.0.14.jar:3.0.14]
at org.apache.cassandra.hints.HintsDispatchExecutor$DispatchHintsTask.dispatch(HintsDispatchExecutor.java:251) ~[apache-cassandra-3.0.14.jar:3.0.14]
at org.apache.cassandra.hints.HintsDispatchExecutor$DispatchHintsTask.dispatch(HintsDispatchExecutor.java:229) ~[apache-cassandra-3.0.14.jar:3.0.14]
at org.apache.cassandra.hints.HintsDispatchExecutor$DispatchHintsTask.run(HintsDispatchExecutor.java:208) ~[apache-cassandra-3.0.14.jar:3.0.14]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_131]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_131]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[na:1.8.0_131]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_131]
at org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:79) [apache-cassandra-3.0.14.jar:3.0.14]
at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_131]
Caused by: java.io.IOException: Digest mismatch exception
at org.apache.cassandra.hints.HintsReader$HintsIterator.computeNextInternal(HintsReader.java:216) ~[apache-cassandra-3.0.14.jar:3.0.14]
at org.apache.cassandra.hints.HintsReader$HintsIterator.computeNext(HintsReader.java:190) ~[apache-cassandra-3.0.14.jar:3.0.14]
... 16 common frames omitted
一些挖后,我发现这个https://issues.apache.org/jira/browse/CASSANDRA-13696,我想我需要删除hintfiles这样的节点可以得出一个一致的状态,但Cassandra是在DCOS /中间层运行,我不能够连接nodetool截断hintfiles
任何方式我可以删除hintfiles?或者使群集一致的其他方式?提前致谢。
由于管理安装点。现在我们已经重新创建了群集并重新填充了数据,但是我们无法找到我认为是由于损坏的hintfiles导致的问题的解决方案。我们能够立即连接到节点上的cqlsh,然后他们失败了。 –