kubernetes安装kubespray
ens33
PEERDNS=no
Kubespray 是 Kubernetes incubator 中的项目,目标是提供 Production Ready Kubernetes 部署方案,该项目基础是通过 Ansible Playbook 来定义系统与 Kubernetes 集群部署的任务,具有以下几个特点:
可以部署在 AWS, GCE,Azure, OpenStack以及裸机上.
部署 HighAvailable Kubernetes 集群.
可组合性(Composable),可自行选择 Network Plugin (flannel, calico, canal,weave) 来部署.
支持多种 Linuxdistributions(CoreOS, Debian Jessie, Ubuntu 16.04, CentOS/RHEL7)
利用Kubespray可快速扩展K8S集群;初次安装遇到不少问题,过程见下文
暂时关闭swap,重启后恢复
[[email protected] ~]#swapoff -a
[[email protected] ~]# cat /etc/fstab
UUID=517ebfdd-d929-44a3-8bc0-968ca0d186f7 / xfs defaults 0 0
UUID=8104a15b-585f-4649-9bc6-20dbb71b3816 /boot xfs defaults 0 0
#UUID=bbeff511-493a-480a-b4d9-5af1519b5299 swap swap defaults 0 0
配置DNS修改/etc/resolv.conf
[[email protected] ~]# echo
"nameserver 8.8.8.8"
>
/etc/resolv
.conf
[[email protected] ~]# systemctl disable firewalld
[[email protected] ~]# ssh-******
[[email protected] ~]# ssh-copy-id [email protected]
[[email protected] ~]# yum install -y epel-release
[[email protected] ~]# yum install -y python-pip python-netaddr ansible git
[[email protected] ~]# pip install --upgrade Jinja2
[[email protected] ~]# pip install --upgrade pip
安装docker
请参考个人另外一篇文章
阿里云中查找响应镜像和版本
阿里云镜像搜索地址:https://dev.aliyun.com/search.html。
dockerhub:https://hub.docker.com/
下载kubespary(官方)[[email protected] ~]# cd /root/
[[email protected] ~]# git clone https://github.com/kubernetes-incubator/kubespray.git
[[email protected] ~]# cd kubespray
切换分支(待定)
--------------------------------------------待定
cd kubespray
git checkout v2.4.0 -b myv2.4.0
cp inventory/inventory.example inventory/inventory.cfg
--------------------------------------------待定
修改操作系统支持(dashboard需要确定,true或者false访问区别)
------------------------------------------------------
vi inventory/group_vars/all.yml
bootstrap_os: centos
vi inventory/group_vars/k8s-cluster.yml
dashboard_enabled: false
kube_api_pwd: “hello-world8888”
------------------------------------------------------[[email protected] kubespray]# grep -r 'Versions' .
./roles/dnsmasq/defaults/main.yml:# Versions
./roles/download/defaults/main.yml:# Versions
./roles/kubernetes-apps/ansible/defaults/main.yml:# Versions
./roles/kubernetes-apps/istio/templates/istio-initializer.yml.j2: apiVersions:
[[email protected] kubespray]#
[[email protected] kubespray]# grep -r 'v1.9.' .
./roles/bootstrap-os/files/get-pip.py:E3?dmsGKgdl$sm$JB!fuat?v1|9*1OtNCuG%A{j(7h-47SAd*2OgGdIE3?i8oOKiV2yPUwEADJ~L#*d
./roles/kubernetes-apps/cluster_roles/tasks/main.yml: - kube_version | version_compare('v1.9.0', '>=')
./roles/kubernetes-apps/cluster_roles/tasks/main.yml: - kube_version | version_compare('v1.9.3', '<=')
./roles/kubernetes-apps/cluster_roles/tasks/main.yml: - kube_version | version_compare('v1.9.0', '>=')
./roles/kubernetes-apps/cluster_roles/tasks/main.yml: - kube_version | version_compare('v1.9.3', '<=')
./roles/kubernetes-apps/cluster_roles/tasks/main.yml: - kube_version | version_compare('v1.9.0', '>=')
./roles/kubernetes-apps/cluster_roles/tasks/main.yml: - kube_version | version_compare('v1.9.3', '<=')
./roles/kubernetes/master/defaults/main.yml: {%- if kube_version | version_compare('v1.9', '<') -%}
./roles/kubernetes/master/templates/kubeadm-config.yaml.j2:{% if kube_version | version_compare('v1.9', '>=') %}
./roles/kubernetes/master/templates/manifests/kube-apiserver.manifest.j2:{% if kube_version | version_compare('v1.9', '<') %}
./roles/kubernetes/master/templates/manifests/kube-apiserver.manifest.j2:{% if kube_version | version_compare('v1.9', '>=') %}
./roles/kubernetes/master/templates/manifests/kube-apiserver.manifest.j2:{% if kube_version | version_compare('v1.9', '>=') %}
./roles/kubernetes/node/templates/vsphere-cloud-config.j2:{% if kube_version | version_compare('v1.9.2', '>=') %}
./roles/kubernetes/node/templates/vsphere-cloud-config.j2:{% if kube_version | version_compare('v1.9.2', '>=') %}
[[email protected] kubespray]#
非常重要的:本文源码对应版本,在使用的时候各个镜像及版本已经有变动,请下载kubespray源码,或者在githu中查找历史纪录,修改为指定版本
相关yml文件及路径为
[[email protected] kubespray]#kubespray/roles/kubernetes-apps/ansible/defaults/main.yml
[[email protected] kubespray]#kubespray/roles/download/defaults/main.yml
[[email protected] kubespray]#kubespray/extra_playbooks/roles/download/defaults/main.yml
[[email protected] kubespray]#kubespray/inventory/group_vars/k8s-cluster.yml
[[email protected] kubespray]#kubespray/roles/dnsmasq/templates/dnsmasq-autoscaler.yml
版本相关行(只查看)
[[email protected] ~]# vi kubespray/roles/kubernetes-apps/ansible/defaults/main.yml
2 # Versions
3 kubedns_version: 1.14.10
4 kubednsautoscaler_version: 1.1.2
44 # Dashboard
45 dashboard_enabled: true
46 dashboard_image_repo: gcr.io/google_containers/kubernetes-dashboard-amd64
47 dashboard_image_tag: v1.8.3
[[email protected] ~]# vi kubespray/roles/download/defaults/main.yml
26 # Versions
27 kube_version: v1.10.4
28 kubeadm_version: "{{ kube_version }}"
41 weave_version: 2.3.0
117 kubedns_version: 1.14.10
130 kubednsautoscaler_version: 1.1.2
[[email protected] ~]# vi kubespray/extra_playbooks/roles/download/defaults/main.yml
[[email protected] ~]# vi kubespray/inventory/sample/group_vars/k8s-cluster.yml
22 kube_version: v1.10.4
根据需要修改如下内容
68 kube_network_plugin: calico
94 kube_service_addresses: 10.233.0.0/18
99 kube_pods_subnet: 10.233.64.0/18
需要下载的镜像大约25个(通过v*n)
③需FQ下载的镜像 tag列表(25个):
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
|
gcr.io /google_containers/cluster-proportional-autoscaler-amd64 :1.1.2
gcr.io /google_containers/pause-amd64 :3.0
gcr.io /google_containers/k8s-dns-kube-dns-amd64 :1.14.7
gcr.io /google_containers/k8s-dns-dnsmasq-nanny-amd64 :1.14.7 gcr.io /google_containers/k8s-dns-sidecar-amd64 :1.14.7
gcr.io /google_containers/elasticsearch :v2.4.1
gcr.io /google_containers/fluentd-elasticsearch :1.22
gcr.io /google_containers/kibana :v4.6.1
gcr.io /kubernetes-helm/tiller :v2.7.2
gcr.io /google_containers/kubernetes-dashboard-init-amd64 :v1.0.1
gcr.io /google_containers/kubernetes-dashboard-amd64 :v1.8.1
quay.io /l23network/k8s-netchecker-agent :v1.0
quay.io /l23network/k8s-netchecker-server :v1.0
quay.io /coreos/etcd :v3.2.4
quay.io /coreos/flannel :v0.9.1
quay.io /coreos/flannel-cni :v0.3.0
quay.io /calico/ctl :v1.6.1
quay.io /calico/node :v2.6.2
quay.io /calico/cni :v1.11.0
quay.io /calico/kube-controllers :v1.0.0
quay.io /calico/routereflector :v0.4.0
quay.io /coreos/hyperkube :v1.9.0_coreos.0
quay.io /ant31/kargo :master
quay.io /external_storage/local-volume-provisioner-bootstrap :v1.0.0
quay.io /external_storage/local-volume-provisioner :v1.0.0
|
相关镜像,可去dockerhub中查找。
docker pull googlecontainer/镜像名:tag
下述为整理的各镜像。
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
|
docker pull jiang7865134 /gcr .io_google_containers_cluster-proportional-autoscaler-amd64:1.1.2
docker pull jiang7865134 /gcr .io_google_containers_pause-amd64:3.0
docker pull jiang7865134 /gcr .io_google_containers_k8s-dns-kube-dns-amd64:1.14.7
docker pull jiang7865134 /gcr .io_google_containers_k8s-dns-dnsmasq-nanny-amd64:1.14.7
docker pull jiang7865134 /gcr .io_google_containers_k8s-dns-sidecar-amd64:1.14.7
docker pull jiang7865134 /gcr .io_google_containers_elasticsearch:v2.4.1
docker pull jiang7865134 /gcr .io_google_containers_fluentd-elasticsearch:1.22
docker pull jiang7865134 /gcr .io_google_containers_kibana:v4.6.1
docker pull jiang7865134 /gcr .io_kubernetes-helm_tiller:v2.7.2
docker pull jiang7865134 /gcr .io_google_containers_kubernetes-dashboard-init-amd64:v1.0.1
docker pull jiang7865134 /gcr .io_google_containers_kubernetes-dashboard-amd64:v1.8.1
docker pull jiang7865134 /quay .io_l23network_k8s-netchecker-agent:v1.0
docker pull jiang7865134 /quay .io_l23network_k8s-netchecker-server:v1.0
docker pull jiang7865134 /quay .io_coreos_etcd:v3.2.4
docker pull jiang7865134 /quay .io_coreos_flannel:v0.9.1
docker pull jiang7865134 /quay .io_coreos_flannel-cni:v0.3.0
docker pull jiang7865134 /quay .io_calico_ctl:v1.6.1
docker pull jiang7865134 /quay .io_calico_node:v2.6.2
docker pull jiang7865134 /quay .io_calico_cni:v1.11.0
docker pull jiang7865134 /quay .io_calico_kube-controllers:v1.0.0
docker pull jiang7865134 /quay .io_calico_routereflector:v0.4.0
docker pull jiang7865134 /quay .io_coreos_hyperkube:v1.9.0_coreos.0
docker pull jiang7865134 /quay .io_ant31_kargo:master
docker pull jiang7865134 /quay .io_external_storage_local-volume-provisioner-bootstrap:v1.0.0
docker pull jiang7865134 /quay .io_external_storage_local-volume-provisioner:v1.0.0
|
将各yml中的镜像名改为dockerhub对应镜像名(推荐,因master,node部署中均需自动下载各镜像)
1
2
3
4
5
6
7
8
9
10
11
12
13
|
cd /root/kubespray
grep -r 'gcr.io' .
grep -r 'quay.io' .
sed -i 's#gcr\.io\/google_containers\/#jiang7865134/gcr\.io_google_containers_#g' roles /download/defaults/main .yml
#sed -i 's#gcr\.io\/google_containers\/#jiang7865134/gcr\.io_google_containers_#g' roles/dnsmasq/templates/dnsmasq-autoscaler.yml.j2 sed -i 's#gcr\.io\/google_containers\/#jiang7865134/gcr\.io_google_containers_#g' roles /kubernetes-apps/ansible/defaults/main .yml
sed -i 's#gcr\.io\/kubernetes-helm\/#jiang7865134/gcr\.io_kubernetes-helm_#g' roles /download/defaults/main .yml
sed -i 's#quay\.io\/l23network\/#jiang7865134/quay\.io_l23network_#g' docs /netcheck .md
sed -i 's#quay\.io\/l23network\/#jiang7865134/quay\.io_l23network_#g' roles /download/defaults/main .yml
sed -i 's#quay\.io\/coreos\/#jiang7865134/quay\.io_coreos_#g' roles /download/defaults/main .yml
sed -i 's#quay\.io\/calico\/#jiang7865134/quay\.io_calico_#g' roles /download/defaults/main .yml
sed -i 's#quay\.io\/external_storage\/#jiang7865134/quay\.io_external_storage_#g' roles /kubernetes-apps/local_volume_provisioner/defaults/main .yml
sed -i 's#quay\.io\/ant31\/kargo#jiang7865134/quay\.io_ant31_kargo_#g' .gitlab-ci.yml
|
修改ansible相关配置,
[[email protected] inventory]# ls
local sample
local为本地单机节点部署脚本配置, sample为集群部署脚本配置,其中包括master节点HA和etcdHA
[[email protected] inventory]# pwd
/home/hadoop/kubespray/inventory
[[email protected] inventory]# cp /root/kubespray/inventory/sample/hosts.ini ./inventory.cfg
[[email protected] inventory]# cat inventory.cfg
# ## Configure 'ip' variable to bind kubernetes services on a
# ## different ip than the default iface
# node1 ansible_host=95.54.0.12 # ip=10.3.0.1
# node2 ansible_host=95.54.0.13 # ip=10.3.0.2
# node3 ansible_host=95.54.0.14 # ip=10.3.0.3
# node4 ansible_host=95.54.0.15 # ip=10.3.0.4
# node5 ansible_host=95.54.0.16 # ip=10.3.0.5
# node6 ansible_host=95.54.0.17 # ip=10.3.0.6
# ## configure a bastion host if your nodes are not directly reachable
# bastion ansible_host=x.x.x.x ansible_user=some_user
# [kube-master]
# node1
# node2
# [etcd]
# node1
# node2
# node3
# [kube-node]
# node2
# node3
# node4
# node5
# node6
# [kube-ingress]
# node2
# node3
# [k8s-cluster:children]
# kube-master
# kube-node
# kube-ingress
部署两种方法
[[email protected] ~]# ansible-playbook -b -i inventory/inventory.cfg cluster.yml --flush-cache
[[email protected] ~]# ansible-playbook -i inventory/inventory.cfg cluster.yml
[[email protected] ~]# vi /root/kubespray/roles/kubernetes/preinstall/tasks/verify-settings.yml
部署中遇到问题解决(需要关注ansible批量自动化)
1python版本引起
fatal: [node1]: FAILED! => {"changed": false, "module_stderr": "Shared connection to 172.28.2.211 closed.\r\n", "module_stdout": "/bin/sh: 1: /usr/bin/python: not found\r\n", "msg": "MODULE FAILURE", "rc": 0}
解决办法:(centos等待完善)
apt-add-repository ppa:ansible/ansible
apt-get install python
python -V
Python 2.7.12
2 缺python-netaddr软件包localhost: The ipaddr filter requires python-netaddr be installed on the ansible controller
解决办法: yum install python-netaddr
3默认配置文件
TASK [kubernetes/preinstall : Stop if even number of etcd hosts]
fatal: [node1]: FAILED! => {
"assertion": "groups.etcd|length is not divisibleby 2",
"changed": false,
"evaluated_to": false
解决方法1(临时):kubespray/inventory/inventory.cfg中etcd组,仅保留master(默认为2,即localhost 和 master)
[etcd]
master
对应yml
前期检查kubernetes/preinstall
cd /root/kubespray/roles/kubernetes/preinstall/tasks
grep etcd *
etchosts.yml: {% for item in (groups['k8s-cluster'] + groups['etcd'] + groups['calico-rr']|default([]))|unique -%}{{ hostvars[item]['access_ip'] | default(hostvars[item]['ip'] | default(hostvars[item]['ansible_default_ipv4']['address'])) }}{% if (item != hostvars[item]['ansible_hostname']) %} {{ hostvars[item]['ansible_hostname'] }} {{ hostvars[item]['ansible_hostname'] }}.{{ dns_domain }}{% endif %} {{ item }} {{ item }}.{{ dns_domain }}
verify-settings.yml:- name: Stop if even number of etcd hosts
verify-settings.yml: that: groups.etcd|length is not divisibleby 2
解决方法2:
保留inventory.cfg中etcd组中节点不变,修改verify-settings.yml
49 that: groups.etcd|length is not divisibleby 5
数量改为节点数+1=5 ,目前总共4个节点
报错4: swap未关闭
TASK [kubernetes/preinstall : Stop if swap enabled] **************************************************************
Thursday 01 February 2018 16:10:27 +0800 (0:00:00.095) 0:00:15.064 *****
fatal: [node1]: FAILED! => {
"assertion": "ansible_swaptotal_mb == 0",
解决方法:
根据TASK [kubernetes/preinstall : Stop if swap enabled]可确定任务对应yml文件的目录
cd /root/kubespray/roles/kubernetes/preinstall/tasks
grep swap *
verify-settings.yml:- name: Stop if swap enabled
.....
vim verify-settings.yml
修改swap, 75 - name: Stop if swap enabled
76 assert:
77 that: ansible_swaptotal_mb == 0
78 when: kubelet_fail_swap_on|default(false)
79 ignore_errors: "{{ ignore_assert_errors }}"
或所有机器执行: 关闭swap
swapoff -a
free -m
报错5:dns配置导致
TASK [docker : check number of nameservers] **********************************************************************
Thursday 01 February 2018 16:46:08 +0800 (0:00:00.091) 0:07:27.328 *****
fatal: [node1]: FAILED! => {"changed": false, "msg": "Too many nameservers. You can relax this check by set docker_dns_servers_strict=no and we will only use the first 3."}
解决方法:
cd /root/kubespray/roles/docker/tasks
grep nameserver *
vim set_facts_dns.yml
......
/etc/resolv.conf中dns记录过多
按提示,两种解决方法:
set docker_dns_servers_strict=no
或修改/etc/resolv.conf,将记录保留2个以内
echo "nameserver 172.16.0.1" >/etc/resolv.conf
报错6:playbook默认配置问题
RUNNING HANDLER [docker : Docker | reload docker] ****************************************************************
Thursday 01 February 2018 17:27:02 +0800 (0:00:00.090) 0:01:42.994 *****
fatal: [master]: FAILED! => {"changed": false, "msg": "Unable to restart service docker: Job for docker.service failed because the control process exited with error code. See \"systemctl status docker.service\" and \"journalctl -xe\" for details.\n"}
fatal: [node2]: 。。。。。
解决方法:
cd /etc/systemd/system/docker.service.d
新增两个配置文件
docker-dns.conf docker-options.conf
systemctl status docker查看错误信息如下
Error starting daemon: error initializing graphdriver: /var/lib/docker contains several valid graphdrivers: aufs, overlay2; Please cleanup or explicitly choose storage driver (-s <DRIVER
修改配置文件vim docker-options.conf ,增加--storage-driver=**相关配置
[Service]
Environment="DOCKER_OPTS=--insecure-registry=172.28.2.2:4000 --graph=/var/lib/docker --log-opt max-size=50m --log-opt max-file=5 \
--iptables=false --storage-driver=aufs"
解决办法:
①修改模板文件
/root/kubespray/roles/docker/templates
vim docker-options.conf.j2
[Service]
Environment="DOCKER_OPTS={{ docker_options | default('') }} \
--iptables=false --storage-driver=aufs"
②修改playbook yml
vim /root/kubespray/inventory/group_vars/k8s-cluster.yml
136 docker_options: "--insecure-registry={{ kube_service_addresses }} --graph={{ docker_daemon_graph }} {{ docker_log_opts }}"
修改为
136 docker_options: "--insecure-registry=172.28.2.2:4000 --graph={{ docker_daemon_graph }} {{ docker_log_opts }}"
前提,手动修改docker配置并重启服务,保证docker服务在部署前正常
vim /etc/systemd/system/docker.service.d/docker-options.conf
systemctl daemon-reload
systemctl restart docker
3、部署完成
查看节点
kubectl get node
kubectl get pod -n kube-system
NAME READY STATUS RESTARTS AGE
calico-node-4gm72 1/1 Running 11 13h
calico-node-8fkfk 1/1 Running 0 13h
calico-node-fqdwj 1/1 Running 16 13h
calico-node-lpdtx 1/1 Running 15 13h
kube-apiserver-master 1/1 Running 0 13h
.....
kube-dns-79d99cdcd5-5cw5b 0/3 ImagePullBackOff 0 13h
若如上所示,有报错,则查看报错相关pod
kubectl describe pod kube-dns-79d99cdcd5-5cw5b -n kube-system
查看引起报错相关镜像,手动下载。
Name: kube-dns-79d99cdcd5-5cw5b
Namespace: kube-system
Node: node3/172.28.2.213
Image: **********
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
|
NAME STATUS ROLES AGE VERSION master Ready master 33d v1.9.0+coreos.0 node1 Ready node 33d v1.9.0+coreos.0 node2 Ready node 33d v1.9.0+coreos.0 node3 Ready node 33d v1.9.0+coreos.0 NAME READY STATUS RESTARTS AGE calico-node-4gm72 1 /1 Running 52 33d
calico-node-8fkfk 1 /1 Running 0 33d
calico-node-fqdwj 1 /1 Running 53 33d
calico-node-lpdtx 1 /1 Running 47 33d
kube-apiserver-master 1 /1 Running 0 33d
kube-apiserver-node4 1 /1 Running 224 18d
kube-controller-manager-master 1 /1 Running 0 33d
kube-controller-manager-node4 1 /1 Running 5 18d
kube-dns-79d99cdcd5-6vvrw 3 /3 Running 0 18d
kube-dns-79d99cdcd5-rkpf2 3 /3 Running 0 18d
kube-proxy-master 1 /1 Running 0 33d
kube-proxy-node1 1 /1 Running 0 32d
kube-proxy-node2 1 /1 Running 0 18d
kube-proxy-node3 1 /1 Running 0 32d
kube-scheduler-master 1 /1 Running 0 33d
kubedns-autoscaler-5564b5585f-7z62x 1 /1 Running 0 18d
kubernetes-dashboard-6bbb86ffc4-zmmc2 1 /1 Running 0 18d
nginx-proxy-node1 1 /1 Running 0 32d
nginx-proxy-node2 1 /1 Running 0 18d
nginx-proxy-node3 1 /1 Running 0 32d
|
三、集群扩展
1、修改inventory文件,把新主机node4加入Master或者Node组
[all]
master ansible_host=172.28.2.210 ip=172.28.2.210 ansible_user=root
node1 ansible_host=172.28.2.211 ip=172.28.2.211 ansible_user=root
node2 ansible_host=172.28.2.212 ip=172.28.2.212 ansible_user=root
node3 ansible_host=172.28.2.213 ip=172.28.2.213 ansible_user=root
node4 ansible_host=172.28.2.214 ip=172.28.2.214 ansible_user=root
[kube-master]
master
node4
[kube-node]
node1
node2
node3
node4
[etcd]
master
[k8s-cluster:children]
kube-node
kube-master
2、安装
ssh-copy-id 172.28.2.214
#安装python 2.7.12
apt-add-repository ppa:ansible/ansible
apt-get install python python-netaddr
#所有机器执行: 关闭swapswapoff -a
echo "nameserver 172.16.0.1" >/etc/resolv.conf
执行:
cd /root/kubespray/
ansible-playbook -i inventory/inventory.cfg cluster.yml --limit node4
3、完成
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
|
NAME STATUS ROLES AGE VERSION master Ready master 33d v1.9.0+coreos.0 node1 Ready node 33d v1.9.0+coreos.0 node2 Ready node 33d v1.9.0+coreos.0 node3 Ready node 33d v1.9.0+coreos.0 node4 Ready master,node 33d v1.9.0+coreos.0 NAME READY STATUS RESTARTS AGE calico-node-4gm72 1 /1 Running 52 33d
calico-node-8fkfk 1 /1 Running 0 33d
calico-node-fqdwj 1 /1 Running 53 33d
calico-node-lpdtx 1 /1 Running 47 33d
calico-node-nq8l2 1 /1 Running 42 33d
kube-apiserver-master 1 /1 Running 0 33d
kube-apiserver-node4 1 /1 Running 224 18d
kube-controller-manager-master 1 /1 Running 0 33d
kube-controller-manager-node4 1 /1 Running 5 18d
kube-dns-79d99cdcd5-6vvrw 3 /3 Running 0 18d
kube-dns-79d99cdcd5-rkpf2 3 /3 Running 0 18d
kube-proxy-master 1 /1 Running 0 33d
kube-proxy-node1 1 /1 Running 0 32d
kube-proxy-node2 1 /1 Running 0 18d
kube-proxy-node3 1 /1 Running 0 32d
kube-proxy-node4 1 /1 Running 0 18d
kube-scheduler-master 1 /1 Running 0 33d
kube-scheduler-node4 1 /1 Running 3 18d
kubedns-autoscaler-5564b5585f-7z62x 1 /1 Running 0 18d
kubernetes-dashboard-6bbb86ffc4-zmmc2 1 /1 Running 0 18d
nginx-proxy-node1 1 /1 Running 0 32d
nginx-proxy-node2 1 /1 Running 0 18d
nginx-proxy-node3 1 /1 Running 0 32d
|
使用kuberspay无坑安装生产级Kubernetes集群: http://www.wisely.top/2017/07/01/no-problem-kubernetes-kuberspay/
kubespray(ansible)自动化安装k8s集群 https://www.cnblogs.com/iiiiher/p/8128184.html