2. Elasticsearch 集群部署配置

1. 服务器资源

 

Elasticsearch DATA 3台  配置  32G内存  CPU 16 空间 1T

 

Elasticsearch master 2 台 配置  8G内存  CPU 4 空间 200G

2. Elasticsearch 集群部署配置

 

2. Elasticsearch DATA配置

 

# ======================== Elasticsearch Configuration =========================

#

# NOTE: Elasticsearch comes with reasonable defaults for most settings.

# Before you set out to tweak and tune the configuration, make sure you

# understand what are you trying to accomplish and the consequences.

#

# The primary way of configuring a node is via this file. This template lists

# the most important settings you may want to configure for a production cluster.

#

# Please consult the documentation for further information on configuration options:

# https://www.elastic.co/guide/en/elasticsearch/reference/index.html

#

# ---------------------------------- Cluster -----------------------------------

#

# Use a descriptive name for your cluster:

#

#cluster.name: my-application

cluster.name: elastic #集群名称

#

# ------------------------------------ Node ------------------------------------

#

# Use a descriptive name for the node:

#

#node.name: node-1

node.name: Elastic_37_64 # 本机名称

#

# Add custom attributes to the node:

#

#node.attr.rack: r1

node.master: false #关闭 master 角色

#node.master: true

node.data: true # 启用data角色

# ----------------------------------- Paths ------------------------------------

#

# Path to directory where to store the data (separate multiple locations by comma):

#

#path.data: /path/to/data

path.data: /opt/elasticsearch-6.6.1/data

#

# Path to log files:

#

#path.logs: /path/to/logs

#

# ----------------------------------- Memory -----------------------------------

#

# Lock the memory on startup:

#

#bootstrap.memory_lock: true

#

# Make sure that the heap size is set to about half the memory available

# on the system and that the owner of the process is allowed to use this

# limit.

#

# Elasticsearch performs poorly when the system is swapping the memory.

#

# ---------------------------------- Network -----------------------------------

#

# Set the bind address to a specific IP (IPv4 or IPv6):

#

#network.host: 192.168.0.1

network.host: 100.76.37.64 # 本机服务IP

# Set a custom port for HTTP:

#

#http.port: 9200

http.port: 9200 #本机服务器端口

#

# For more information, consult the network module documentation.

#

# --------------------------------- Discovery ----------------------------------

#

# Pass an initial list of hosts to perform discovery when new node is started:

# The default list of hosts is ["127.0.0.1", "[::1]"]

#

#discovery.zen.ping.unicast.hosts: ["host1", "host2"]

discovery.zen.ping.unicast.hosts: ["100.76.37.64", "100.76.37.65","100.76.37.66","100.76.37.71","100.76.37.72"] # 集群ip配置

# Prevent the "split brain" by configuring the majority of nodes (total number of master-eligible nodes / 2 + 1):

#

#discovery.zen.minimum_master_nodes:

discovery.zen.minimum_master_nodes: 1

# For more information, consult the zen discovery module documentation.

#

# ---------------------------------- Gateway -----------------------------------

#

# Block initial recovery after a full cluster restart until N nodes are started:

#

#gateway.recover_after_nodes: 3

#

# For more information, consult the gateway module documentation.

#

# ---------------------------------- Various -----------------------------------

#

# Require explicit names when deleting indices:

#

#action.destructive_requires_name: true

[[email protected]_37_64 config]#

 

3. Elasticsearch Master配置

[[email protected]_37_71 config]# more elasticsearch.yml

# ======================== Elasticsearch Configuration =========================

#

# NOTE: Elasticsearch comes with reasonable defaults for most settings.

# Before you set out to tweak and tune the configuration, make sure you

# understand what are you trying to accomplish and the consequences.

#

# The primary way of configuring a node is via this file. This template lists

# the most important settings you may want to configure for a production cluster.

#

# Please consult the documentation for further information on configuration options:

# https://www.elastic.co/guide/en/elasticsearch/reference/index.html

#

# ---------------------------------- Cluster -----------------------------------

#

# Use a descriptive name for your cluster:

#

#cluster.name: my-application

cluster.name: elastic #集群名称

#

# ------------------------------------ Node ------------------------------------

#

# Use a descriptive name for the node:

#

#node.name: node-1

node.name: Elastic_37_71

 

node.master: true #启用master角色

node.data: false # 关闭data 角色

node.ingest: false

 

#

# Add custom attributes to the node:

#

#node.attr.rack: r1

#

# ----------------------------------- Paths ------------------------------------

#

# Path to directory where to store the data (separate multiple locations by comma):

#

#path.data: /path/to/data

path.data: /opt/elasticsearch-6.6.1/data

#

# Path to log files:

#

#path.logs: /path/to/logs

#

# ----------------------------------- Memory -----------------------------------

#

# Lock the memory on startup:

#

#bootstrap.memory_lock: true

#

# Make sure that the heap size is set to about half the memory available

# on the system and that the owner of the process is allowed to use this

# limit.

#

# Elasticsearch performs poorly when the system is swapping the memory.

#

# ---------------------------------- Network -----------------------------------

#

# Set the bind address to a specific IP (IPv4 or IPv6):

#

#network.host: 192.168.0.1

network.host: 100.76.37.71 # 本机服务IP

#

# Set a custom port for HTTP:

#

#http.port: 9200

http.port: 9200 #本机服务器端口

#

# For more information, consult the network module documentation.

#

# --------------------------------- Discovery ----------------------------------

#

# Pass an initial list of hosts to perform discovery when new node is started:

# The default list of hosts is ["127.0.0.1", "[::1]"]

#

#discovery.zen.ping.unicast.hosts: ["host1", "host2"]

discovery.zen.ping.unicast.hosts: ["100.76.37.64", "100.76.37.65","100.76.37.66","100.76.37.71","100.76.37.72"] #集群IP地址管理

#

# Prevent the "split brain" by configuring the majority of nodes (total number of master-eligible nodes / 2 + 1):

#

#discovery.zen.minimum_master_nodes:

discovery.zen.minimum_master_nodes: 1

#

# For more information, consult the zen discovery module documentation.

#

# ---------------------------------- Gateway -----------------------------------

#

# Block initial recovery after a full cluster restart until N nodes are started:

#

#gateway.recover_after_nodes: 3

#

# For more information, consult the gateway module documentation.

#

# ---------------------------------- Various -----------------------------------

#

# Require explicit names when deleting indices:

#

#action.destructive_requires_name: true

[[email protected]_37_71 config]#

 

4. Elasticsearch 调优

 

[[email protected]_37_65 config]$ more jvm.options

## JVM configuration

 

################################################################

## IMPORTANT: JVM heap size

################################################################

##

## You should always set the min and max JVM heap

## size to the same value. For example, to set

## the heap to 4 GB, set:

##

## -Xms4g

## -Xmx4g

##

## See https://www.elastic.co/guide/en/elasticsearch/reference/current/heap-size.html

## for more information

##

################################################################

 

# Xms represents the initial size of total heap space

# Xmx represents the maximum size of total heap space

 

-Xms16g # Elasticsearch 占用本机内存50% 资源

-Xmx16g

 

################################################################

## Expert settings

################################################################

##

## All settings below this section are considered

## expert settings. Don't tamper with them unless

## you understand what you are doing

##

################################################################

 

 

 

5. 查看ES集群状态

[[email protected]_37_69 config]# curl http://100.115.3.3:9201/_cat/nodes?v

ip heap.percent ram.percent cpu load_1m load_5m load_15m node.role master name

100.106.18.3 68 93 9 0.12 0.30 0.24 di - node-6

100.115.3.3 40 81 2 0.08 0.12 0.22 di - node-3

100.115.3.2 67 93 0 0.38 0.40 0.29 di - node-2

100.115.3.1 10 81 0 0.01 0.04 0.05 mi * node-1

100.115.3.4 65 99 1 0.09 0.06 0.05 di - node-4

100.106.18.12 26 80 9 1.10 0.45 0.34 di - node-8

6. 查看单节点连接状态

[[email protected]_37_69 config]# curl http://100.115.3.3:9201/_cat/health?v

epoch timestamp cluster status node.total node.data shards pri relo init unassign pending_tasks max_task_wait_time active_shards_percent

1565747703 01:55:03 ora_es green 6 5 542 271 0 0 0 0 - 100.0%

[[email protected]_37_69 config]#