环境: 3台kvm, 局域网互通, 均不能上外网
备注: 这3个kvm是重新弄的, 较为干净, 防火墙也关了

安装日志:

2019-12-06 14:57:00,881 p=5136 u=root | PLAY [kube-master[0]] ******************************************************************************************************************************************************************************************************************************************
2019-12-06 14:57:00,939 p=5136 u=root | TASK [loadbalancer_apiserver is not set] ***********************************************************************************************************************************************************************************************************************
2019-12-06 14:57:00,940 p=5136 u=root | Friday 06 December 2019 14:57:00 +0800 (0:00:00.164) 0:00:00.164 *******
2019-12-06 14:57:00,978 p=5136 u=root | skipping: [master]
2019-12-06 14:57:00,988 p=5136 u=root | PLAY [k8s-cluster] *********************************************************************************************************************************************************************************************************************************************
2019-12-06 14:57:00,998 p=5136 u=root | TASK [Disable swap] ********************************************************************************************************************************************************************************************************************************************
2019-12-06 14:57:00,999 p=5136 u=root | Friday 06 December 2019 14:57:00 +0800 (0:00:00.059) 0:00:00.223 *******
2019-12-06 14:57:01,098 p=5136 u=root | changed: [master]
2019-12-06 15:02:03,159 p=5136 u=root | fatal: [node1]: FAILED! => {}

MSG:

Timeout (302s) waiting for privilege escalation prompt:

2019-12-06 15:02:03,191 p=5136 u=root | fatal: [node2]: FAILED! => {}

MSG:

Timeout (302s) waiting for privilege escalation prompt:

2019-12-06 15:02:03,234 p=5136 u=root | TASK [Swap off] ************************************************************************************************************************************************************************************************************************************************
2019-12-06 15:02:03,235 p=5136 u=root | Friday 06 December 2019 15:02:03 +0800 (0:05:02.235) 0:05:02.458 *******
2019-12-06 15:02:03,300 p=5136 u=root | changed: [master]
2019-12-06 15:02:03,316 p=5136 u=root | PLAY [local-registry] ******************************************************************************************************************************************************************************************************************************************
2019-12-06 15:02:03,361 p=5136 u=root | TASK [config docker-ce] ****************************************************************************************************************************************************************************************************************************************
2019-12-06 15:02:03,362 p=5136 u=root | Friday 06 December 2019 15:02:03 +0800 (0:00:00.127) 0:05:02.586 *******
2019-12-06 15:02:05,369 p=5136 u=root | ok: [master] => (item={u’type’: u’conf’, u’name’: u’docker.service’, u’file’: u’docker.service’})
2019-12-06 15:02:05,409 p=5136 u=root | TASK [check docker-options] ************************************************************************************************************************************************************************************************************************************
2019-12-06 15:02:05,409 p=5136 u=root | Friday 06 December 2019 15:02:05 +0800 (0:00:02.046) 0:05:04.633 *******
2019-12-06 15:02:05,601 p=5136 u=root | ok: [master]
2019-12-06 15:02:05,641 p=5136 u=root | TASK [Restart docker] ******************************************************************************************************************************************************************************************************************************************
2019-12-06 15:02:05,642 p=5136 u=root | Friday 06 December 2019 15:02:05 +0800 (0:00:00.232) 0:05:04.865 *******
2019-12-06 15:02:08,142 p=5136 u=root | changed: [master]
2019-12-06 15:02:08,158 p=5136 u=root | PLAY [all] *****************************************************************************************************************************************************************************************************************************************************
2019-12-06 15:02:08,197 p=5136 u=root | TASK [Fetch /etc/os-release] ***********************************************************************************************************************************************************************************************************************************
2019-12-06 15:02:08,197 p=5136 u=root | Friday 06 December 2019 15:02:08 +0800 (0:00:02.555) 0:05:07.421 *******
2019-12-06 15:02:08,246 p=5136 u=root | ok: [master]
2019-12-06 15:02:08,286 p=5136 u=root | TASK [Check os release] ****************************************************************************************************************************************************************************************************************************************
2019-12-06 15:02:08,286 p=5136 u=root | Friday 06 December 2019 15:02:08 +0800 (0:00:00.088) 0:05:07.510 *******
2019-12-06 15:02:08,330 p=5136 u=root | ok: [master]
2019-12-06 15:02:08,369 p=5136 u=root | TASK [Check source.list] ***************************************************************************************************************************************************************************************************************************************
2019-12-06 15:02:08,369 p=5136 u=root | Friday 06 December 2019 15:02:08 +0800 (0:00:00.083) 0:05:07.593 *******
2019-12-06 15:02:08,394 p=5136 u=root | skipping: [master]
2019-12-06 15:02:08,428 p=5136 u=root | TASK [Backup source.list] **************************************************************************************************************************************************************************************************************************************
2019-12-06 15:02:08,428 p=5136 u=root | Friday 06 December 2019 15:02:08 +0800 (0:00:00.058) 0:05:07.652 *******
2019-12-06 15:02:08,456 p=5136 u=root | skipping: [master]
2019-12-06 15:02:08,499 p=5136 u=root | TASK [creat source.list] ***************************************************************************************************************************************************************************************************************************************
2019-12-06 15:02:08,499 p=5136 u=root | Friday 06 December 2019 15:02:08 +0800 (0:00:00.071) 0:05:07.723 *******
2019-12-06 15:02:08,530 p=5136 u=root | skipping: [master]
2019-12-06 15:02:08,568 p=5136 u=root | TASK [Apt update] **********************************************************************************************************************************************************************************************************************************************
2019-12-06 15:02:08,569 p=5136 u=root | Friday 06 December 2019 15:02:08 +0800 (0:00:00.069) 0:05:07.793 *******
2019-12-06 15:02:08,592 p=5136 u=root | skipping: [master]
2019-12-06 15:02:08,629 p=5136 u=root | TASK [Backup repo.d] *******************************************************************************************************************************************************************************************************************************************
2019-12-06 15:02:08,629 p=5136 u=root | Friday 06 December 2019 15:02:08 +0800 (0:00:00.060) 0:05:07.853 *******
2019-12-06 15:02:08,697 p=5136 u=root | changed: [master]
2019-12-06 15:02:08,733 p=5136 u=root | TASK [Backup repo.d] *******************************************************************************************************************************************************************************************************************************************
2019-12-06 15:02:08,733 p=5136 u=root | Friday 06 December 2019 15:02:08 +0800 (0:00:00.103) 0:05:07.957 *******
2019-12-06 15:02:08,766 p=5136 u=root | skipping: [master]
2019-12-06 15:02:08,802 p=5136 u=root | TASK [Create repo.d] *******************************************************************************************************************************************************************************************************************************************
2019-12-06 15:02:08,802 p=5136 u=root | Friday 06 December 2019 15:02:08 +0800 (0:00:00.068) 0:05:08.026 *******
2019-12-06 15:02:08,865 p=5136 u=root | fatal: [master]: FAILED! => {
“changed”: true,
“rc”: 1
}

STDERR:

mkdir: 无法创建目录"/etc/yum.repos.d": 文件已存在

MSG:

non-zero return code

2019-12-06 15:02:08,865 p=5136 u=root | …ignoring
2019-12-06 15:02:08,905 p=5136 u=root | TASK [Creat client.repo] ***************************************************************************************************************************************************************************************************************************************
2019-12-06 15:02:08,906 p=5136 u=root | Friday 06 December 2019 15:02:08 +0800 (0:00:00.103) 0:05:08.130 *******
2019-12-06 15:02:08,939 p=5136 u=root | skipping: [master]
2019-12-06 15:02:08,950 p=5136 u=root | PLAY [localhost] ***********************************************************************************************************************************************************************************************************************************************
2019-12-06 15:02:08,958 p=5136 u=root | TASK [Get local_ip] ********************************************************************************************************************************************************************************************************************************************
2019-12-06 15:02:08,959 p=5136 u=root | Friday 06 December 2019 15:02:08 +0800 (0:00:00.052) 0:05:08.182 *******
2019-12-06 15:02:09,082 p=5136 u=root | changed: [localhost]
2019-12-06 15:02:09,085 p=5136 u=root | PLAY RECAP *****************************************************************************************************************************************************************************************************************************************************
2019-12-06 15:02:09,085 p=5136 u=root | localhost : ok=1 changed=1 unreachable=0 failed=0

2019-12-06 15:02:09,085 p=5136 u=root | master : ok=9 changed=5 unreachable=0 failed=0

2019-12-06 15:02:09,086 p=5136 u=root | node1 : ok=0 changed=0 unreachable=0 failed=1

2019-12-06 15:02:09,086 p=5136 u=root | node2 : ok=0 changed=0 unreachable=0 failed=1

2019-12-06 15:02:09,086 p=5136 u=root | Friday 06 December 2019 15:02:09 +0800 (0:00:00.127) 0:05:08.310 *******
2019-12-06 15:02:09,086 p=5136 u=root | ===============================================================================
2019-12-06 15:02:09,087 p=5136 u=root | Disable swap —————————————————————————————————————————————————————————————————————————————— 302.24s
2019-12-06 15:02:09,087 p=5136 u=root | Restart docker —————————————————————————————————————————————————————————————————————————————— 2.56s
2019-12-06 15:02:09,087 p=5136 u=root | config docker-ce —————————————————————————————————————————————————————————————————————————————- 2.05s
2019-12-06 15:02:09,087 p=5136 u=root | check docker-options ———————————————————————————————————————————————————————————————————————————— 0.23s
2019-12-06 15:02:09,087 p=5136 u=root | Get local_ip ——————————————————————————————————————————————————————————————————————————————– 0.13s
2019-12-06 15:02:09,088 p=5136 u=root | Swap off ———————————————————————————————————————————————————————————————————————————————— 0.13s
2019-12-06 15:02:09,088 p=5136 u=root | Backup repo.d ——————————————————————————————————————————————————————————————————————————————- 0.10s
2019-12-06 15:02:09,088 p=5136 u=root | Create repo.d ——————————————————————————————————————————————————————————————————————————————- 0.10s
2019-12-06 15:02:09,088 p=5136 u=root | Fetch /etc/os-release ———————————————————————————————————————————————————————————————————————————– 0.09s
2019-12-06 15:02:09,088 p=5136 u=root | Check os release —————————————————————————————————————————————————————————————————————————————- 0.08s
2019-12-06 15:02:09,088 p=5136 u=root | Backup source.list ————————————————————————————————————————————————————————————————————————————– 0.07s
2019-12-06 15:02:09,089 p=5136 u=root | creat source.list ————————————————————————————————————————————————————————————————————————————— 0.07s
2019-12-06 15:02:09,089 p=5136 u=root | Backup repo.d ——————————————————————————————————————————————————————————————————————————————- 0.07s
2019-12-06 15:02:09,089 p=5136 u=root | Apt update ———————————————————————————————————————————————————————————————————————————————- 0.06s
2019-12-06 15:02:09,089 p=5136 u=root | loadbalancer_apiserver is not set ———————————————————————————————————————————————————————————————————————– 0.06s
2019-12-06 15:02:09,089 p=5136 u=root | Check source.list ————————————————————————————————————————————————————————————————————————————— 0.06s
2019-12-06 15:02:09,089 p=5136 u=root | Creat client.repo ————————————————————————————————————————————————————————————————————————————— 0.05s

/var/log/message | grep error:

cat /var/log/messages | grep error

Dec 6 10:51:41 api dockerd: time=“2019-12-06T10:51:41.589699280+08:00” level=warning msg=“failed to load plugin io.containerd.snapshotter.v1.btrfs” error=“path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.btrfs must be a btrfs filesystem to be used with the btrfs snapshotter”
Dec 6 10:51:41 api dockerd: time=“2019-12-06T10:51:41.591825631+08:00” level=warning msg=“failed to load plugin io.containerd.snapshotter.v1.aufs” error="modprobe aufs failed: “modprobe: FATAL: Module aufs not found.\n”: exit status 1″
Dec 6 10:51:41 api dockerd: time=“2019-12-06T10:51:41.592484815+08:00″ level=warning msg=“could not use snapshotter aufs in metadata plugin” error="modprobe aufs failed: “modprobe: FATAL: Module aufs not found.\n”: exit status 1″
Dec 6 10:51:41 api dockerd: time=“2019-12-06T10:51:41.592497535+08:00″ level=warning msg=“could not use snapshotter zfs in metadata plugin” error=“path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.zfs must be a zfs filesystem to be used with the zfs snapshotter: skip plugin”
Dec 6 10:51:41 api dockerd: time=“2019-12-06T10:51:41.592507128+08:00” level=warning msg=“could not use snapshotter btrfs in metadata plugin” error=“path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.btrfs must be a btrfs filesystem to be used with the btrfs snapshotter”
Dec 6 11:05:40 api dockerd: time=“2019-12-06T11:05:40.876356651+08:00” level=info msg=“stopping event stream following graceful shutdown” error=“<nil>” module=libcontainerd namespace=moby
Dec 6 11:05:40 api dockerd: time=“2019-12-06T11:05:40.876885836+08:00″ level=info msg=“stopping event stream following graceful shutdown” error=“context canceled” module=libcontainerd namespace=plugins.moby
Dec 6 11:05:42 api dockerd: time=“2019-12-06T11:05:42.077148314+08:00″ level=warning msg=“failed to load plugin io.containerd.snapshotter.v1.btrfs” error=“path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.btrfs must be a btrfs filesystem to be used with the btrfs snapshotter”
Dec 6 11:05:42 api dockerd: time=“2019-12-06T11:05:42.079200613+08:00” level=warning msg=“failed to load plugin io.containerd.snapshotter.v1.aufs” error="modprobe aufs failed: “modprobe: FATAL: Module aufs not found.\n”: exit status 1″
Dec 6 11:05:42 api dockerd: time=“2019-12-06T11:05:42.079889140+08:00″ level=warning msg=“could not use snapshotter aufs in metadata plugin” error="modprobe aufs failed: “modprobe: FATAL: Module aufs not found.\n”: exit status 1″
Dec 6 11:05:42 api dockerd: time=“2019-12-06T11:05:42.079900868+08:00” level=warning msg=“could not use snapshotter zfs in metadata plugin” error=“path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.zfs must be a zfs filesystem to be used with the zfs snapshotter: skip plugin”
Dec 6 11:05:42 api dockerd: time=“2019-12-06T11:05:42.079921256+08:00″ level=warning msg=“could not use snapshotter btrfs in metadata plugin” error=“path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.btrfs must be a btrfs filesystem to be used with the btrfs snapshotter”
Dec 6 14:13:44 api dockerd: time=“2019-12-06T14:13:44.988481406+08:00″ level=info msg=“stopping event stream following graceful shutdown” error=“<nil>” module=libcontainerd namespace=moby
Dec 6 14:13:44 api dockerd: time=“2019-12-06T14:13:44.989603808+08:00″ level=info msg=“stopping event stream following graceful shutdown” error=“context canceled” module=libcontainerd namespace=plugins.moby
Dec 6 14:13:46 api dockerd: time=“2019-12-06T14:13:46.158966413+08:00″ level=warning msg=“failed to load plugin io.containerd.snapshotter.v1.btrfs” error=“path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.btrfs must be a btrfs filesystem to be used with the btrfs snapshotter”
Dec 6 14:13:46 api dockerd: time=“2019-12-06T14:13:46.160953470+08:00” level=warning msg=“failed to load plugin io.containerd.snapshotter.v1.aufs” error="modprobe aufs failed: “modprobe: FATAL: Module aufs not found.\n”: exit status 1″
Dec 6 14:13:46 api dockerd: time=“2019-12-06T14:13:46.161434760+08:00″ level=warning msg=“could not use snapshotter btrfs in metadata plugin” error=“path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.btrfs must be a btrfs filesystem to be used with the btrfs snapshotter”
Dec 6 14:13:46 api dockerd: time=“2019-12-06T14:13:46.161444125+08:00” level=warning msg=“could not use snapshotter aufs in metadata plugin” error="modprobe aufs failed: “modprobe: FATAL: Module aufs not found.\n”: exit status 1″
Dec 6 14:13:46 api dockerd: time=“2019-12-06T14:13:46.161454677+08:00″ level=warning msg=“could not use snapshotter zfs in metadata plugin” error=“path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.zfs must be a zfs filesystem to be used with the zfs snapshotter: skip plugin”
Dec 6 15:02:06 api dockerd: time=“2019-12-06T15:02:06.652521155+08:00″ level=info msg=“stopping event stream following graceful shutdown” error=“<nil>” module=libcontainerd namespace=moby
Dec 6 15:02:06 api dockerd: time=“2019-12-06T15:02:06.653163768+08:00″ level=info msg=“stopping event stream following graceful shutdown” error=“context canceled” module=libcontainerd namespace=plugins.moby
Dec 6 15:02:07 api dockerd: time=“2019-12-06T15:02:07.846870556+08:00″ level=warning msg=“failed to load plugin io.containerd.snapshotter.v1.btrfs” error=“path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.btrfs must be a btrfs filesystem to be used with the btrfs snapshotter”
Dec 6 15:02:07 api dockerd: time=“2019-12-06T15:02:07.849184283+08:00″ level=warning msg=“failed to load plugin io.containerd.snapshotter.v1.aufs” error="modprobe aufs failed: “modprobe: FATAL: Module aufs not found.\n”: exit status 1″
Dec 6 15:02:07 api dockerd: time=“2019-12-06T15:02:07.849734060+08:00″ level=warning msg=“could not use snapshotter btrfs in metadata plugin” error=“path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.btrfs must be a btrfs filesystem to be used with the btrfs snapshotter”
Dec 6 15:02:07 api dockerd: time=“2019-12-06T15:02:07.849744399+08:00″ level=warning msg=“could not use snapshotter aufs in metadata plugin” error="modprobe aufs failed: “modprobe: FATAL: Module aufs not found.\n”: exit status 1″
Dec 6 15:02:07 api dockerd: time=“2019-12-06T15:02:07.849754853+08:00” level=warning msg=“could not use snapshotter zfs in metadata plugin” error=“path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.zfs must be a zfs filesystem to be used with the zfs snapshotter: skip plugin”