ES性能测试

ES性能测试

主节点Es-1: 配置8核,6g

调整配置为8核,12g

 

 

ES性能测试

Node-3:配置为4核,12g

ES性能测试

ES性能测试

Node-4,5:配置为8核,4g

ES性能测试

 

Es-1,2、node-1,2:配置为8核,12g

ES性能测试

 

 

集群中尽量避免水桶效应;master节点内存应尽量大,否则gc时间过长,

 

 

[2017-03-06T08:38:35,604][INFO ][o.e.i.e.InternalEngine$EngineMergeScheduler] [node-5] [mtest][3] now throttling indexing: numMergesInFlight=10, maxNumMerges=9

[2017-03-06T08:39:00,352][INFO ][o.e.i.e.InternalEngine$EngineMergeScheduler] [node-5] [mtest][3] stop throttling indexing: numMergesInFlight=8, maxNumMerges=9

 

"index.merge.policy.max_merged_segment": "1g"

 

段合并影响较大,默认最大为5g,此时合并时系统开销较大,改为1g

 

    

ES性能测试

"index.translog.sync_interval": "60s",

    "index.translog.durability": "async",

    "index.translog.flush_threshold_size": "1g",

    "index.merge.scheduler.max_thread_count": 2,

"index.merge.scheduler.max_merge_count": 2,    

    "index.merge.policy.max_merged_segment": "1g",

    "refresh_interval": "180s",

"number_of_shards": 6,

"number_of_replicas": 0,

    "index.routing.allocation.total_shards_per_node": 1

6*8核*10g,3w/s

持续写入15h,大小1.25T

 

ES性能测试