摘要：最近被業(yè)務(wù)折騰的死去活來(lái)，實(shí)在沒(méi)時(shí)間發(fā)帖，花了好多個(gè)晚上才寫(xiě)好這篇帖子，后續(xù)會(huì)加油的利用技術(shù)棧打造個(gè)人私有云系列文章目錄利用技術(shù)棧打造個(gè)人私有云連載之初章利用技術(shù)棧打造個(gè)人私有云連載之集群搭建利用技術(shù)棧打造個(gè)人私有云連載之環(huán)境理解和練手利用

最近被業(yè)務(wù)折騰的死去活來(lái)，實(shí)在沒(méi)時(shí)間發(fā)帖，花了好多個(gè)晚上才寫(xiě)好這篇帖子，后續(xù)會(huì)加油的！

【利用K8S技術(shù)棧打造個(gè)人私有云系列文章目錄】

利用K8S技術(shù)棧打造個(gè)人私有云（連載之：初章）

利用K8S技術(shù)棧打造個(gè)人私有云（連載之：K8S集群搭建）

利用K8S技術(shù)棧打造個(gè)人私有云（連載之：K8S環(huán)境理解和練手）

利用K8S技術(shù)棧打造個(gè)人私有云（連載之：基礎(chǔ)鏡像制作與實(shí)驗(yàn)）

利用K8S技術(shù)棧打造個(gè)人私有云（連載之：資源控制研究）

利用K8S技術(shù)棧打造個(gè)人私有云（連載之：私有云客戶端打造）

注： 本文首發(fā)于 My 公眾號(hào) CodeSheep ，可 長(zhǎng)按 或 掃描 下面的 小心心 來(lái)訂閱 ↓ ↓ ↓

玩集群嘛，當(dāng)然要搞幾臺(tái)機(jī)器做節(jié)點(diǎn)！無(wú)賴自己并沒(méi)有性能很強(qiáng)勁的多余機(jī)器，在家里翻箱倒柜，找出了幾臺(tái)破舊的本子，試試看吧，與其墊桌腳不如拿出來(lái)遛遛彎...

總體環(huán)境安排如下圖所示：

各部分簡(jiǎn)介如下：

Master節(jié)點(diǎn) ( 一臺(tái)08年買的Hedy筆記本 Centos7.3 64bit )

docker

etcd

flannel

kube-apiserver

kube-scheduler

kube-controller-manager

Slave節(jié)點(diǎn) ( 一臺(tái)二手Thinkpad T420s Centos7.3 64bit )

docker

flannel

kubelet

kube-proxy

Client節(jié)點(diǎn)（ 一臺(tái)12年的Sony Vaio SVS13 Win7 Ultimate）

客戶端嘛，畢竟甲方，不需要安裝啥東西，有個(gè)ssh客戶端能連到master和slave節(jié)點(diǎn)就OK

Docker鏡像倉(cāng)庫(kù)

一般企業(yè)內(nèi)部應(yīng)用的話，其會(huì)搭建自己的docker registry，用作鏡像倉(cāng)庫(kù)，我這里就直接用Docker Gub作為鏡像倉(cāng)庫(kù)，自己不搭建了（其實(shí)主要是沒(méi)機(jī)子啊！）

Wireless Router （雷猴子家的小米路由器3）

最好能穿墻，因?yàn)槲壹衣酚善鞣旁诳蛷d，但我實(shí)驗(yàn)是在臥室里做的啊！

各部分全部都是由wifi進(jìn)行互聯(lián)，我個(gè)人不太喜歡一大堆線繞來(lái)繞去

先設(shè)置master節(jié)點(diǎn)和所有slave節(jié)點(diǎn)的主機(jī)名

master上執(zhí)行：

hostnamectl --static set-hostname  k8s-master

slave上執(zhí)行：

hostnamectl --static set-hostname  k8s-node-1

修改master和slave上的hosts

在master和slave的/etc/hosts文件中均加入以下內(nèi)容：

192.168.31.166   k8s-master
192.168.31.166   etcd
192.168.31.166   registry
192.168.31.199   k8s-node-1

關(guān)閉master和slave上的防火墻

systemctl disable firewalld.service
systemctl stop firewalld.service

master節(jié)點(diǎn)需要安裝以下組件：

etcd

flannel

docker

kubernets

下面按順序闡述

1. etcd安裝

安裝命令：yum install etcd -y

編輯etcd的默認(rèn)配置文件/etc/etcd/etcd.conf

# [member]
ETCD_NAME=master
ETCD_DATA_DIR="/var/lib/etcd/default.etcd"
#ETCD_WAL_DIR=""
#ETCD_SNAPSHOT_COUNT="10000"
#ETCD_HEARTBEAT_INTERVAL="100"
#ETCD_ELECTION_TIMEOUT="1000"
#ETCD_LISTEN_PEER_URLS="http://localhost:2380"
ETCD_LISTEN_CLIENT_URLS="http://0.0.0.0:2379,http://0.0.0.0:4001"
#ETCD_MAX_SNAPSHOTS="5"
#ETCD_MAX_WALS="5"
#ETCD_CORS=""
#
#[cluster]
#ETCD_INITIAL_ADVERTISE_PEER_URLS="http://localhost:2380"
# if you use different ETCD_NAME (e.g. test), set ETCD_INITIAL_CLUSTER value for this name, i.e. "test=http://..."
#ETCD_INITIAL_CLUSTER="default=http://localhost:2380"
#ETCD_INITIAL_CLUSTER_STATE="new"
#ETCD_INITIAL_CLUSTER_TOKEN="etcd-cluster"
ETCD_ADVERTISE_CLIENT_URLS="http://etcd:2379,http://etcd:4001"
#ETCD_DISCOVERY=""
#ETCD_DISCOVERY_SRV=""
#ETCD_DISCOVERY_FALLBACK="proxy"
#ETCD_DISCOVERY_PROXY=""
#ETCD_STRICT_RECONFIG_CHECK="false"
#ETCD_AUTO_COMPACTION_RETENTION="0"
#ETCD_ENABLE_V2="true"
#
#[proxy]
#ETCD_PROXY="off"
#ETCD_PROXY_FAILURE_WAIT="5000"
#ETCD_PROXY_REFRESH_INTERVAL="30000"
#ETCD_PROXY_DIAL_TIMEOUT="1000"
#ETCD_PROXY_WRITE_TIMEOUT="5000"
#ETCD_PROXY_READ_TIMEOUT="0"
#
#[security]
#ETCD_CERT_FILE=""
#ETCD_KEY_FILE=""
#ETCD_CLIENT_CERT_AUTH="false"
#ETCD_TRUSTED_CA_FILE=""
#ETCD_AUTO_TLS="false"
#ETCD_PEER_CERT_FILE=""
#ETCD_PEER_KEY_FILE=""
#ETCD_PEER_CLIENT_CERT_AUTH="false"
#ETCD_PEER_TRUSTED_CA_FILE=""
#ETCD_PEER_AUTO_TLS="false"
#
#[logging]
#ETCD_DEBUG="false"
# examples for -log-package-levels etcdserver=WARNING,security=DEBUG
#ETCD_LOG_PACKAGE_LEVELS=""
#
#[profiling]
#ETCD_ENABLE_PPROF="false"
#ETCD_METRICS="basic"
#
#[auth]
#ETCD_AUTH_TOKEN="simple"

啟動(dòng)etcd并驗(yàn)證

首先啟動(dòng)etcd服務(wù)

systemctl start etcd // 啟動(dòng)etcd服務(wù)

再獲取etcd的健康指標(biāo)看看：

etcdctl -C http://etcd:2379 cluster-health
etcdctl -C http://etcd:4001 cluster-health

2. flannel安裝

安裝命令：yum install flannel

配置flannel：/etc/sysconfig/flanneld

# Flanneld configuration options  

# etcd url location.  Point this to the server where etcd runs
FLANNEL_ETCD_ENDPOINTS="http://etcd:2379"

# etcd config key.  This is the configuration key that flannel queries
# For address range assignment
FLANNEL_ETCD_PREFIX="/atomic.io/network"

# Any additional options that you want to pass
#FLANNEL_OPTIONS=""

配置etcd中關(guān)于flannel的key

etcdctl mk /atomic.io/network/config "{ "Network": "10.0.0.0/16" }"

啟動(dòng)flannel并設(shè)置開(kāi)機(jī)自啟

systemctl start flanneld.service
systemctl enable flanneld.service

3. docker安裝

該部分網(wǎng)上教程太多了，主要步驟如下

安裝命令：yum install docker -y

開(kāi)啟docker服務(wù)：service docker start

設(shè)置docker開(kāi)啟自啟動(dòng)：chkconfig docker on

4. kubernets安裝

k8s的安裝命令很簡(jiǎn)單，執(zhí)行：

yum install kubernetes

但k8s需要配置的東西比較多，正如第一節(jié)“環(huán)境介紹”中提及的，畢竟master上需要運(yùn)行以下組件：

kube-apiserver

kube-scheduler

kube-controller-manager

下面詳細(xì)闡述：

配置/etc/kubernetes/apiserver文件

###
# kubernetes system config
#
# The following values are used to configure the kube-apiserver
#

# The address on the local server to listen to.
KUBE_API_ADDRESS="--address=0.0.0.0"

# The port on the local server to listen on.
KUBE_API_PORT="--port=8080"

# Port minions listen on
KUBELET_PORT="--kubelet-port=10250"

# Comma separated list of nodes in the etcd cluster
KUBE_ETCD_SERVERS="--etcd-servers=http://etcd:2379"

# Address range to use for services
KUBE_SERVICE_ADDRESSES="--service-cluster-ip-range=10.254.0.0/16"

# default admission control policies
# KUBE_ADMISSION_CONTROL="--admission-control=NamespaceLifecycle,NamespaceExists,LimitRanger,SecurityContextDeny,ServiceAccount,ResourceQuota"
KUBE_ADMISSION_CONTROL="--admission-control=NamespaceLifecycle,NamespaceExists,LimitRanger,SecurityContextDeny,ResourceQuota"

# Add your own!
KUBE_API_ARGS=""

配置/etc/kubernetes/config文件

###
# kubernetes system config
#
# The following values are used to configure various aspects of all
# kubernetes services, including
#
#   kube-apiserver.service
#   kube-controller-manager.service
#   kube-scheduler.service
#   kubelet.service
#   kube-proxy.service
# logging to stderr means we get it in the systemd journal
KUBE_LOGTOSTDERR="--logtostderr=true"

# journal message level, 0 is debug
KUBE_LOG_LEVEL="--v=0"

# Should this cluster be allowed to run privileged docker containers
KUBE_ALLOW_PRIV="--allow-privileged=false"

# How the controller-manager, scheduler, and proxy find the apiserver
KUBE_MASTER="--master=http://k8s-master:8080"

啟動(dòng)k8s各個(gè)組件

systemctl start kube-apiserver.service
systemctl start kube-controller-manager.service
systemctl start kube-scheduler.service

設(shè)置k8s各組件開(kāi)機(jī)啟動(dòng)

systemctl enable kube-apiserver.service
systemctl enable kube-controller-manager.service
systemctl enable kube-scheduler.service

slave節(jié)點(diǎn)需要安裝以下組件：

flannel

docker

kubernetes

下面按順序闡述：

1. flannel安裝

安裝命令：yum install flannel

配置flannel：/etc/sysconfig/flanneld

# Flanneld configuration options  

# etcd url location.  Point this to the server where etcd runs
FLANNEL_ETCD_ENDPOINTS="http://etcd:2379"

# etcd config key.  This is the configuration key that flannel queries
# For address range assignment
FLANNEL_ETCD_PREFIX="/atomic.io/network"

# Any additional options that you want to pass
#FLANNEL_OPTIONS=""

啟動(dòng)flannel并設(shè)置開(kāi)機(jī)自啟

systemctl start flanneld.service
systemctl enable flanneld.service

2. docker安裝

參考前文master節(jié)點(diǎn)上部署docker過(guò)程，此處不再贅述

3. kubernetes安裝

安裝命令：yum install kubernetes

不同于master節(jié)點(diǎn)，slave節(jié)點(diǎn)上需要運(yùn)行kubernetes的如下組件：

kubelet

kubernets-proxy

下面詳細(xì)闡述要配置的東西：

配置/etc/kubernetes/config

###
# kubernetes system config
#
# The following values are used to configure various aspects of all
# kubernetes services, including
#
#   kube-apiserver.service
#   kube-controller-manager.service
#   kube-scheduler.service
#   kubelet.service
#   kube-proxy.service
# logging to stderr means we get it in the systemd journal
KUBE_LOGTOSTDERR="--logtostderr=true"

# journal message level, 0 is debug
KUBE_LOG_LEVEL="--v=0"

# Should this cluster be allowed to run privileged docker containers
KUBE_ALLOW_PRIV="--allow-privileged=false"

# How the controller-manager, scheduler, and proxy find the apiserver
KUBE_MASTER="--master=http://k8s-master:8080"

配置/etc/kubernetes/kubelet

###
# kubernetes kubelet (minion) config

# The address for the info server to serve on (set to 0.0.0.0 or "" for all interfaces)
KUBELET_ADDRESS="--address=0.0.0.0"

# The port for the info server to serve on
# KUBELET_PORT="--port=10250"

# You may leave this blank to use the actual hostname
KUBELET_HOSTNAME="--hostname-override=k8s-node-1"

# location of the api-server
KUBELET_API_SERVER="--api-servers=http://k8s-master:8080"

# pod infrastructure container
KUBELET_POD_INFRA_CONTAINER="--pod-infra-container-image=registry.access.redhat.com/rhel7/pod-infrastructure:latest"

# Add your own!
KUBELET_ARGS=""

啟動(dòng)kube服務(wù)

systemctl start kubelet.service
systemctl start kube-proxy.service

設(shè)置k8s組件開(kāi)機(jī)自啟

systemctl enable kubelet.service
systemctl enable kube-proxy.service

至此為止，k8s集群的搭建過(guò)程就完成了，下面來(lái)驗(yàn)證一下集群是否搭建成功了

查看端點(diǎn)信息：kubectl get endpoints

查看集群信息：kubectl cluster-info

獲取集群中的節(jié)點(diǎn)狀態(tài)： kubectl get nodes

OK，節(jié)點(diǎn)已經(jīng)就緒，可以在上面做實(shí)驗(yàn)了！

https://www.kubernetes.org.cn/

作者更多的原創(chuàng)文章在此，歡迎觀賞

My Personal Blog

作者更多的SpringBt實(shí)踐文章在此：

Spring Boot應(yīng)用監(jiān)控實(shí)戰(zhàn)

SpringBoot應(yīng)用部署于外置Tomcat容器

ElasticSearch搜索引擎在SpringBt中的實(shí)踐

初探Kotlin+SpringBoot聯(lián)合編程

Spring Boot日志框架實(shí)踐

SpringBoot優(yōu)雅編碼之：Lombok加持

如果有興趣，也可以抽點(diǎn)時(shí)間看看作者一些關(guān)于容器化、微服務(wù)化方面的文章：

利用K8S技術(shù)棧打造個(gè)人私有云 連載文章

從一份配置清單詳解Nginx服務(wù)器配置

Docker容器可視化監(jiān)控中心搭建

利用ELK搭建Docker容器化應(yīng)用日志中心

RPC框架實(shí)踐之：Apache Thrift

RPC框架實(shí)踐之：Google gRPC

微服務(wù)調(diào)用鏈追蹤中心搭建

Docker容器跨主機(jī)通信

Docker Swarm集群初探

高效編寫(xiě)Dockerfile的幾條準(zhǔn)則