=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-darwin-amd64 start -p old-k8s-version-182000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0
E0128 11:32:50.651877 25982 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/auto-732000/client.crt: no such file or directory
E0128 11:33:04.430766 25982 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/custom-flannel-732000/client.crt: no such file or directory
E0128 11:33:18.502214 25982 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/false-732000/client.crt: no such file or directory
E0128 11:33:18.507449 25982 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/false-732000/client.crt: no such file or directory
E0128 11:33:18.517559 25982 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/false-732000/client.crt: no such file or directory
E0128 11:33:18.537718 25982 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/false-732000/client.crt: no such file or directory
E0128 11:33:18.579514 25982 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/false-732000/client.crt: no such file or directory
E0128 11:33:18.660785 25982 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/false-732000/client.crt: no such file or directory
E0128 11:33:18.820976 25982 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/false-732000/client.crt: no such file or directory
E0128 11:33:19.141102 25982 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/false-732000/client.crt: no such file or directory
E0128 11:33:19.781836 25982 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/false-732000/client.crt: no such file or directory
E0128 11:33:21.062052 25982 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/false-732000/client.crt: no such file or directory
E0128 11:33:23.622532 25982 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/false-732000/client.crt: no such file or directory
E0128 11:33:28.742905 25982 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/false-732000/client.crt: no such file or directory
E0128 11:33:33.537091 25982 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/skaffold-054000/client.crt: no such file or directory
=== CONT TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-182000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0: exit status 109 (4m11.430668049s)
-- stdout --
* [old-k8s-version-182000] minikube v1.29.0-1674856271-15565 on Darwin 13.2
- MINIKUBE_LOCATION=15565
- KUBECONFIG=/Users/jenkins/minikube-integration/15565-24808/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/15565-24808/.minikube
- MINIKUBE_FORCE_SYSTEMD=
* Using the docker driver based on user configuration
* Using Docker Desktop driver with root privileges
* Starting control plane node old-k8s-version-182000 in cluster old-k8s-version-182000
* Pulling base image ...
* Creating docker container (CPUs=2, Memory=2200MB) ...
* Preparing Kubernetes v1.16.0 on Docker 20.10.23 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0128 11:32:46.832068 43291 out.go:296] Setting OutFile to fd 1 ...
I0128 11:32:46.832417 43291 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0128 11:32:46.832422 43291 out.go:309] Setting ErrFile to fd 2...
I0128 11:32:46.832425 43291 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0128 11:32:46.832609 43291 root.go:334] Updating PATH: /Users/jenkins/minikube-integration/15565-24808/.minikube/bin
I0128 11:32:46.833181 43291 out.go:303] Setting JSON to false
I0128 11:32:46.854151 43291 start.go:125] hostinfo: {"hostname":"MacOS-Agent-3.local","uptime":9141,"bootTime":1674925225,"procs":399,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.2","kernelVersion":"22.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}
W0128 11:32:46.854241 43291 start.go:133] gopshost.Virtualization returned error: not implemented yet
I0128 11:32:46.877611 43291 out.go:177] * [old-k8s-version-182000] minikube v1.29.0-1674856271-15565 on Darwin 13.2
I0128 11:32:46.920403 43291 notify.go:220] Checking for updates...
I0128 11:32:46.941150 43291 out.go:177] - MINIKUBE_LOCATION=15565
I0128 11:32:46.962152 43291 out.go:177] - KUBECONFIG=/Users/jenkins/minikube-integration/15565-24808/kubeconfig
I0128 11:32:46.983336 43291 out.go:177] - MINIKUBE_BIN=out/minikube-darwin-amd64
I0128 11:32:47.004333 43291 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0128 11:32:47.025248 43291 out.go:177] - MINIKUBE_HOME=/Users/jenkins/minikube-integration/15565-24808/.minikube
I0128 11:32:47.046228 43291 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0128 11:32:47.067721 43291 config.go:180] Loaded profile config "calico-732000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.26.1
I0128 11:32:47.067774 43291 driver.go:365] Setting default libvirt URI to qemu:///system
I0128 11:32:47.132873 43291 docker.go:141] docker version: linux-20.10.22:Docker Desktop 4.16.2 (95914)
I0128 11:32:47.133028 43291 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0128 11:32:47.285168 43291 info.go:266] docker info: {ID:O4T2:OPZV:SRVN:GAA5:IEOW:TFNR:UPTT:2CKV:GY3E:3NIN:VS7C:3BCB Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:60 OomKillDisable:false NGoroutines:57 SystemTime:2023-01-28 19:32:47.18826115 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:5 KernelVersion:5.15.49-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServe
rAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6231715840 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.22 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:9ba4b250366a5ddde94bb7c9d1def331423aa323 Expected:9ba4b250366a5ddde94bb7c9d1def331423aa323} RuncCommit:{ID:v1.1.4-0-g5fd4c4d Expected:v1.1.4-0-g5fd4c4d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default
name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.10.0] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.15.1] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.0.5] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.17] map[Name:sbom Path:
/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scan] ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I0128 11:32:47.327781 43291 out.go:177] * Using the docker driver based on user configuration
I0128 11:32:47.348807 43291 start.go:296] selected driver: docker
I0128 11:32:47.348822 43291 start.go:857] validating driver "docker" against <nil>
I0128 11:32:47.348835 43291 start.go:868] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0128 11:32:47.351427 43291 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0128 11:32:47.517687 43291 info.go:266] docker info: {ID:O4T2:OPZV:SRVN:GAA5:IEOW:TFNR:UPTT:2CKV:GY3E:3NIN:VS7C:3BCB Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:60 OomKillDisable:false NGoroutines:57 SystemTime:2023-01-28 19:32:47.407204294 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:5 KernelVersion:5.15.49-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6231715840 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.22 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:9ba4b250366a5ddde94bb7c9d1def331423aa323 Expected:9ba4b250366a5ddde94bb7c9d1def331423aa323} RuncCommit:{ID:v1.1.4-0-g5fd4c4d Expected:v1.1.4-0-g5fd4c4d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defaul
t name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.10.0] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.15.1] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.0.5] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.17] map[Name:sbom Path
:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scan] ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I0128 11:32:47.517878 43291 start_flags.go:305] no existing cluster config was found, will generate one from the flags
I0128 11:32:47.518079 43291 start_flags.go:917] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0128 11:32:47.556860 43291 out.go:177] * Using Docker Desktop driver with root privileges
I0128 11:32:47.578204 43291 cni.go:84] Creating CNI manager for ""
I0128 11:32:47.578236 43291 cni.go:161] CNI unnecessary in this configuration, recommending no CNI
I0128 11:32:47.578252 43291 start_flags.go:319] config:
{Name:old-k8s-version-182000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.37@sha256:8bf7a0e8a062bc5e2b71d28b35bfa9cc862d9220e234e86176b3785f685d8b15 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-182000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocke
t: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP:}
I0128 11:32:47.637908 43291 out.go:177] * Starting control plane node old-k8s-version-182000 in cluster old-k8s-version-182000
I0128 11:32:47.659011 43291 cache.go:120] Beginning downloading kic base image for docker with docker
I0128 11:32:47.680055 43291 out.go:177] * Pulling base image ...
I0128 11:32:47.738388 43291 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0128 11:32:47.738466 43291 image.go:77] Checking for gcr.io/k8s-minikube/kicbase:v0.0.37@sha256:8bf7a0e8a062bc5e2b71d28b35bfa9cc862d9220e234e86176b3785f685d8b15 in local docker daemon
I0128 11:32:47.738484 43291 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/15565-24808/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4
I0128 11:32:47.738502 43291 cache.go:57] Caching tarball of preloaded images
I0128 11:32:47.738736 43291 preload.go:174] Found /Users/jenkins/minikube-integration/15565-24808/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0128 11:32:47.738761 43291 cache.go:60] Finished verifying existence of preloaded tar for v1.16.0 on docker
I0128 11:32:47.739893 43291 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/config.json ...
I0128 11:32:47.740061 43291 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/config.json: {Name:mk82641dee1bfbc07d915c26c36d8701394f90b6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0128 11:32:47.799738 43291 image.go:81] Found gcr.io/k8s-minikube/kicbase:v0.0.37@sha256:8bf7a0e8a062bc5e2b71d28b35bfa9cc862d9220e234e86176b3785f685d8b15 in local docker daemon, skipping pull
I0128 11:32:47.799756 43291 cache.go:143] gcr.io/k8s-minikube/kicbase:v0.0.37@sha256:8bf7a0e8a062bc5e2b71d28b35bfa9cc862d9220e234e86176b3785f685d8b15 exists in daemon, skipping load
I0128 11:32:47.799775 43291 cache.go:193] Successfully downloaded all kic artifacts
I0128 11:32:47.799828 43291 start.go:364] acquiring machines lock for old-k8s-version-182000: {Name:mk4015ba4a18ecf0d87a4f26a0f8283e87452f7f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0128 11:32:47.800005 43291 start.go:368] acquired machines lock for "old-k8s-version-182000" in 163.428µs
I0128 11:32:47.800033 43291 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-182000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.37@sha256:8bf7a0e8a062bc5e2b71d28b35bfa9cc862d9220e234e86176b3785f685d8b15 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-182000 Namespace:default APIServerName:minikubeCA APIServe
rNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fals
e CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0128 11:32:47.800128 43291 start.go:125] createHost starting for "" (driver="docker")
I0128 11:32:47.839878 43291 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0128 11:32:47.840324 43291 start.go:159] libmachine.API.Create for "old-k8s-version-182000" (driver="docker")
I0128 11:32:47.840386 43291 client.go:168] LocalClient.Create starting
I0128 11:32:47.840591 43291 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/15565-24808/.minikube/certs/ca.pem
I0128 11:32:47.840686 43291 main.go:141] libmachine: Decoding PEM data...
I0128 11:32:47.840731 43291 main.go:141] libmachine: Parsing certificate...
I0128 11:32:47.840856 43291 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/15565-24808/.minikube/certs/cert.pem
I0128 11:32:47.840942 43291 main.go:141] libmachine: Decoding PEM data...
I0128 11:32:47.840966 43291 main.go:141] libmachine: Parsing certificate...
I0128 11:32:47.841795 43291 cli_runner.go:164] Run: docker network inspect old-k8s-version-182000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0128 11:32:47.896874 43291 cli_runner.go:211] docker network inspect old-k8s-version-182000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0128 11:32:47.897002 43291 network_create.go:281] running [docker network inspect old-k8s-version-182000] to gather additional debugging logs...
I0128 11:32:47.897021 43291 cli_runner.go:164] Run: docker network inspect old-k8s-version-182000
W0128 11:32:47.951619 43291 cli_runner.go:211] docker network inspect old-k8s-version-182000 returned with exit code 1
I0128 11:32:47.951648 43291 network_create.go:284] error running [docker network inspect old-k8s-version-182000]: docker network inspect old-k8s-version-182000: exit status 1
stdout:
[]
stderr:
Error: No such network: old-k8s-version-182000
I0128 11:32:47.951660 43291 network_create.go:286] output of [docker network inspect old-k8s-version-182000]: -- stdout --
[]
-- /stdout --
** stderr **
Error: No such network: old-k8s-version-182000
** /stderr **
I0128 11:32:47.951748 43291 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0128 11:32:48.007355 43291 network.go:209] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0128 11:32:48.008924 43291 network.go:209] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0128 11:32:48.010368 43291 network.go:209] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0128 11:32:48.010672 43291 network.go:206] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc001292540}
I0128 11:32:48.010682 43291 network_create.go:123] attempt to create docker network old-k8s-version-182000 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I0128 11:32:48.010768 43291 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-182000 old-k8s-version-182000
I0128 11:32:48.097334 43291 network_create.go:107] docker network old-k8s-version-182000 192.168.76.0/24 created
I0128 11:32:48.097366 43291 kic.go:117] calculated static IP "192.168.76.2" for the "old-k8s-version-182000" container
I0128 11:32:48.097470 43291 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0128 11:32:48.152343 43291 cli_runner.go:164] Run: docker volume create old-k8s-version-182000 --label name.minikube.sigs.k8s.io=old-k8s-version-182000 --label created_by.minikube.sigs.k8s.io=true
I0128 11:32:48.206146 43291 oci.go:103] Successfully created a docker volume old-k8s-version-182000
I0128 11:32:48.206268 43291 cli_runner.go:164] Run: docker run --rm --name old-k8s-version-182000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-182000 --entrypoint /usr/bin/test -v old-k8s-version-182000:/var gcr.io/k8s-minikube/kicbase:v0.0.37@sha256:8bf7a0e8a062bc5e2b71d28b35bfa9cc862d9220e234e86176b3785f685d8b15 -d /var/lib
I0128 11:32:48.697252 43291 oci.go:107] Successfully prepared a docker volume old-k8s-version-182000
I0128 11:32:48.697309 43291 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0128 11:32:48.697325 43291 kic.go:190] Starting extracting preloaded images to volume ...
I0128 11:32:48.697442 43291 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/15565-24808/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-182000:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.37@sha256:8bf7a0e8a062bc5e2b71d28b35bfa9cc862d9220e234e86176b3785f685d8b15 -I lz4 -xf /preloaded.tar -C /extractDir
I0128 11:32:55.118671 43291 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/15565-24808/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-182000:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.37@sha256:8bf7a0e8a062bc5e2b71d28b35bfa9cc862d9220e234e86176b3785f685d8b15 -I lz4 -xf /preloaded.tar -C /extractDir: (6.421155772s)
I0128 11:32:55.118691 43291 kic.go:199] duration metric: took 6.421351 seconds to extract preloaded images to volume
I0128 11:32:55.118796 43291 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0128 11:32:55.259761 43291 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname old-k8s-version-182000 --name old-k8s-version-182000 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-182000 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=old-k8s-version-182000 --network old-k8s-version-182000 --ip 192.168.76.2 --volume old-k8s-version-182000:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.37@sha256:8bf7a0e8a062bc5e2b71d28b35bfa9cc862d9220e234e86176b3785f685d8b15
I0128 11:32:55.607022 43291 cli_runner.go:164] Run: docker container inspect old-k8s-version-182000 --format={{.State.Running}}
I0128 11:32:55.671096 43291 cli_runner.go:164] Run: docker container inspect old-k8s-version-182000 --format={{.State.Status}}
I0128 11:32:55.733399 43291 cli_runner.go:164] Run: docker exec old-k8s-version-182000 stat /var/lib/dpkg/alternatives/iptables
I0128 11:32:55.863842 43291 oci.go:144] the created container "old-k8s-version-182000" has a running status.
I0128 11:32:55.863871 43291 kic.go:221] Creating ssh key for kic: /Users/jenkins/minikube-integration/15565-24808/.minikube/machines/old-k8s-version-182000/id_rsa...
I0128 11:32:55.935387 43291 kic_runner.go:191] docker (temp): /Users/jenkins/minikube-integration/15565-24808/.minikube/machines/old-k8s-version-182000/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0128 11:32:56.078803 43291 cli_runner.go:164] Run: docker container inspect old-k8s-version-182000 --format={{.State.Status}}
I0128 11:32:56.140489 43291 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0128 11:32:56.140508 43291 kic_runner.go:114] Args: [docker exec --privileged old-k8s-version-182000 chown docker:docker /home/docker/.ssh/authorized_keys]
I0128 11:32:56.244631 43291 cli_runner.go:164] Run: docker container inspect old-k8s-version-182000 --format={{.State.Status}}
I0128 11:32:56.303074 43291 machine.go:88] provisioning docker machine ...
I0128 11:32:56.303116 43291 ubuntu.go:169] provisioning hostname "old-k8s-version-182000"
I0128 11:32:56.303210 43291 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-182000
I0128 11:32:56.359811 43291 main.go:141] libmachine: Using SSH client type: native
I0128 11:32:56.360024 43291 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil> [] 0s} 127.0.0.1 62637 <nil> <nil>}
I0128 11:32:56.360040 43291 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-182000 && echo "old-k8s-version-182000" | sudo tee /etc/hostname
I0128 11:32:56.502228 43291 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-182000
I0128 11:32:56.502317 43291 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-182000
I0128 11:32:56.559072 43291 main.go:141] libmachine: Using SSH client type: native
I0128 11:32:56.559243 43291 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil> [] 0s} 127.0.0.1 62637 <nil> <nil>}
I0128 11:32:56.559262 43291 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-182000' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-182000/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-182000' | sudo tee -a /etc/hosts;
fi
fi
I0128 11:32:56.693276 43291 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0128 11:32:56.693296 43291 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/15565-24808/.minikube CaCertPath:/Users/jenkins/minikube-integration/15565-24808/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/15565-24808/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/15565-24808/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/15565-24808/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/15565-24808/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/15565-24808/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/15565-24808/.minikube}
I0128 11:32:56.693315 43291 ubuntu.go:177] setting up certificates
I0128 11:32:56.693322 43291 provision.go:83] configureAuth start
I0128 11:32:56.693394 43291 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-182000
I0128 11:32:56.749139 43291 provision.go:138] copyHostCerts
I0128 11:32:56.749229 43291 exec_runner.go:144] found /Users/jenkins/minikube-integration/15565-24808/.minikube/cert.pem, removing ...
I0128 11:32:56.749237 43291 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15565-24808/.minikube/cert.pem
I0128 11:32:56.749359 43291 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15565-24808/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/15565-24808/.minikube/cert.pem (1123 bytes)
I0128 11:32:56.749575 43291 exec_runner.go:144] found /Users/jenkins/minikube-integration/15565-24808/.minikube/key.pem, removing ...
I0128 11:32:56.749581 43291 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15565-24808/.minikube/key.pem
I0128 11:32:56.749646 43291 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15565-24808/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/15565-24808/.minikube/key.pem (1675 bytes)
I0128 11:32:56.749797 43291 exec_runner.go:144] found /Users/jenkins/minikube-integration/15565-24808/.minikube/ca.pem, removing ...
I0128 11:32:56.749804 43291 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15565-24808/.minikube/ca.pem
I0128 11:32:56.749878 43291 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15565-24808/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/15565-24808/.minikube/ca.pem (1082 bytes)
I0128 11:32:56.750002 43291 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/15565-24808/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/15565-24808/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/15565-24808/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-182000 san=[192.168.76.2 127.0.0.1 localhost 127.0.0.1 minikube old-k8s-version-182000]
I0128 11:32:56.933730 43291 provision.go:172] copyRemoteCerts
I0128 11:32:56.933797 43291 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0128 11:32:56.933853 43291 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-182000
I0128 11:32:56.990930 43291 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62637 SSHKeyPath:/Users/jenkins/minikube-integration/15565-24808/.minikube/machines/old-k8s-version-182000/id_rsa Username:docker}
I0128 11:32:57.085401 43291 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-24808/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0128 11:32:57.103181 43291 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-24808/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
I0128 11:32:57.121037 43291 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-24808/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0128 11:32:57.138574 43291 provision.go:86] duration metric: configureAuth took 445.235355ms
I0128 11:32:57.138590 43291 ubuntu.go:193] setting minikube options for container-runtime
I0128 11:32:57.138746 43291 config.go:180] Loaded profile config "old-k8s-version-182000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
I0128 11:32:57.138812 43291 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-182000
I0128 11:32:57.195810 43291 main.go:141] libmachine: Using SSH client type: native
I0128 11:32:57.195970 43291 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil> [] 0s} 127.0.0.1 62637 <nil> <nil>}
I0128 11:32:57.195987 43291 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0128 11:32:57.326259 43291 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0128 11:32:57.326271 43291 ubuntu.go:71] root file system type: overlay
I0128 11:32:57.326447 43291 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0128 11:32:57.326529 43291 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-182000
I0128 11:32:57.383509 43291 main.go:141] libmachine: Using SSH client type: native
I0128 11:32:57.383674 43291 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil> [] 0s} 127.0.0.1 62637 <nil> <nil>}
I0128 11:32:57.383726 43291 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0128 11:32:57.526437 43291 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0128 11:32:57.526541 43291 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-182000
I0128 11:32:57.584704 43291 main.go:141] libmachine: Using SSH client type: native
I0128 11:32:57.584863 43291 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil> [] 0s} 127.0.0.1 62637 <nil> <nil>}
I0128 11:32:57.584877 43291 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0128 11:32:58.200397 43291 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2023-01-19 17:34:14.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2023-01-28 19:32:57.523301231 +0000
@@ -1,30 +1,32 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
Wants=network-online.target
-Requires=docker.socket containerd.service
+Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutSec=0
-RestartSec=2
-Restart=always
-
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
+Restart=on-failure
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
@@ -32,16 +34,16 @@
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0128 11:32:58.200419 43291 machine.go:91] provisioned docker machine in 1.897320579s
I0128 11:32:58.200425 43291 client.go:171] LocalClient.Create took 10.360006757s
I0128 11:32:58.200442 43291 start.go:167] duration metric: libmachine.API.Create for "old-k8s-version-182000" took 10.360093658s
I0128 11:32:58.200447 43291 start.go:300] post-start starting for "old-k8s-version-182000" (driver="docker")
I0128 11:32:58.200451 43291 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0128 11:32:58.200521 43291 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0128 11:32:58.200572 43291 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-182000
I0128 11:32:58.259969 43291 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62637 SSHKeyPath:/Users/jenkins/minikube-integration/15565-24808/.minikube/machines/old-k8s-version-182000/id_rsa Username:docker}
I0128 11:32:58.354161 43291 ssh_runner.go:195] Run: cat /etc/os-release
I0128 11:32:58.357686 43291 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0128 11:32:58.357705 43291 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0128 11:32:58.357712 43291 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0128 11:32:58.357717 43291 info.go:137] Remote host: Ubuntu 20.04.5 LTS
I0128 11:32:58.357728 43291 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15565-24808/.minikube/addons for local assets ...
I0128 11:32:58.357833 43291 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15565-24808/.minikube/files for local assets ...
I0128 11:32:58.358003 43291 filesync.go:149] local asset: /Users/jenkins/minikube-integration/15565-24808/.minikube/files/etc/ssl/certs/259822.pem -> 259822.pem in /etc/ssl/certs
I0128 11:32:58.358200 43291 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0128 11:32:58.365617 43291 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-24808/.minikube/files/etc/ssl/certs/259822.pem --> /etc/ssl/certs/259822.pem (1708 bytes)
I0128 11:32:58.383885 43291 start.go:303] post-start completed in 183.415148ms
I0128 11:32:58.384492 43291 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-182000
I0128 11:32:58.442928 43291 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/config.json ...
I0128 11:32:58.443369 43291 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0128 11:32:58.443434 43291 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-182000
I0128 11:32:58.500202 43291 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62637 SSHKeyPath:/Users/jenkins/minikube-integration/15565-24808/.minikube/machines/old-k8s-version-182000/id_rsa Username:docker}
I0128 11:32:58.590140 43291 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0128 11:32:58.594848 43291 start.go:128] duration metric: createHost completed in 10.794686188s
I0128 11:32:58.594863 43291 start.go:83] releasing machines lock for "old-k8s-version-182000", held for 10.794822338s
I0128 11:32:58.594939 43291 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-182000
I0128 11:32:58.653699 43291 ssh_runner.go:195] Run: cat /version.json
I0128 11:32:58.653712 43291 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
I0128 11:32:58.653811 43291 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-182000
I0128 11:32:58.653813 43291 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-182000
I0128 11:32:58.715039 43291 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62637 SSHKeyPath:/Users/jenkins/minikube-integration/15565-24808/.minikube/machines/old-k8s-version-182000/id_rsa Username:docker}
I0128 11:32:58.715102 43291 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:62637 SSHKeyPath:/Users/jenkins/minikube-integration/15565-24808/.minikube/machines/old-k8s-version-182000/id_rsa Username:docker}
W0128 11:32:58.998023 43291 out.go:239] ! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.29.0 -> Actual minikube version: v1.29.0-1674856271-15565
! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.29.0 -> Actual minikube version: v1.29.0-1674856271-15565
I0128 11:32:58.998107 43291 ssh_runner.go:195] Run: systemctl --version
I0128 11:32:59.003181 43291 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0128 11:32:59.008135 43291 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0128 11:32:59.029291 43291 cni.go:229] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0128 11:32:59.029370 43291 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
I0128 11:32:59.043500 43291 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
I0128 11:32:59.051229 43291 cni.go:307] configured [/etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0128 11:32:59.051246 43291 start.go:483] detecting cgroup driver to use...
I0128 11:32:59.051259 43291 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0128 11:32:59.051345 43291 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
image-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0128 11:32:59.065596 43291 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "k8s.gcr.io/pause:3.1"|' /etc/containerd/config.toml"
I0128 11:32:59.074399 43291 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0128 11:32:59.083062 43291 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
I0128 11:32:59.083118 43291 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0128 11:32:59.091821 43291 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0128 11:32:59.100458 43291 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0128 11:32:59.109087 43291 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0128 11:32:59.117788 43291 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0128 11:32:59.125849 43291 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0128 11:32:59.134471 43291 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0128 11:32:59.141740 43291 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0128 11:32:59.148825 43291 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0128 11:32:59.219564 43291 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0128 11:32:59.299399 43291 start.go:483] detecting cgroup driver to use...
I0128 11:32:59.299417 43291 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0128 11:32:59.299479 43291 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0128 11:32:59.310369 43291 cruntime.go:273] skipping containerd shutdown because we are bound to it
I0128 11:32:59.310444 43291 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0128 11:32:59.320739 43291 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
image-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0128 11:32:59.335209 43291 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0128 11:32:59.429460 43291 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0128 11:32:59.511497 43291 docker.go:529] configuring docker to use "cgroupfs" as cgroup driver...
I0128 11:32:59.511515 43291 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)
I0128 11:32:59.525439 43291 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0128 11:32:59.614586 43291 ssh_runner.go:195] Run: sudo systemctl restart docker
I0128 11:32:59.822178 43291 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0128 11:32:59.853113 43291 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0128 11:32:59.934526 43291 out.go:204] * Preparing Kubernetes v1.16.0 on Docker 20.10.23 ...
I0128 11:32:59.934642 43291 cli_runner.go:164] Run: docker exec -t old-k8s-version-182000 dig +short host.docker.internal
I0128 11:33:00.045011 43291 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2
I0128 11:33:00.045118 43291 ssh_runner.go:195] Run: grep 192.168.65.2 host.minikube.internal$ /etc/hosts
I0128 11:33:00.049464 43291 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0128 11:33:00.059625 43291 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-182000
I0128 11:33:00.116731 43291 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0128 11:33:00.116806 43291 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0128 11:33:00.141860 43291 docker.go:630] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0128 11:33:00.141879 43291 docker.go:560] Images already preloaded, skipping extraction
I0128 11:33:00.141970 43291 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0128 11:33:00.166304 43291 docker.go:630] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0128 11:33:00.166322 43291 cache_images.go:84] Images are preloaded, skipping loading
I0128 11:33:00.166422 43291 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0128 11:33:00.233940 43291 cni.go:84] Creating CNI manager for ""
I0128 11:33:00.233956 43291 cni.go:161] CNI unnecessary in this configuration, recommending no CNI
I0128 11:33:00.233969 43291 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0128 11:33:00.233988 43291 kubeadm.go:172] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-182000 NodeName:old-k8s-version-182000 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticP
odPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m]}
I0128 11:33:00.234110 43291 kubeadm.go:177] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-182000"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-182000
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.76.2:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0128 11:33:00.234197 43291 kubeadm.go:968] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-182000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-182000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0128 11:33:00.234264 43291 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0128 11:33:00.242247 43291 binaries.go:44] Found k8s binaries, skipping transfer
I0128 11:33:00.242311 43291 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0128 11:33:00.250018 43291 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (348 bytes)
I0128 11:33:00.263226 43291 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0128 11:33:00.276352 43291 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2174 bytes)
I0128 11:33:00.289339 43291 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0128 11:33:00.293263 43291 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0128 11:33:00.303384 43291 certs.go:56] Setting up /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000 for IP: 192.168.76.2
I0128 11:33:00.303406 43291 certs.go:186] acquiring lock for shared ca certs: {Name:mk223e4eab41546e140aa3e3e480564c04fddab4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0128 11:33:00.303590 43291 certs.go:195] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/15565-24808/.minikube/ca.key
I0128 11:33:00.303665 43291 certs.go:195] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/15565-24808/.minikube/proxy-client-ca.key
I0128 11:33:00.303703 43291 certs.go:315] generating minikube-user signed cert: /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/client.key
I0128 11:33:00.303721 43291 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/client.crt with IP's: []
I0128 11:33:00.439823 43291 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/client.crt ...
I0128 11:33:00.439841 43291 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/client.crt: {Name:mk22df9d001a1acb80475565f9b9c54e4882863b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0128 11:33:00.440218 43291 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/client.key ...
I0128 11:33:00.440229 43291 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/client.key: {Name:mk682d6e9148089516677da58edd3b0d3d114683 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0128 11:33:00.440422 43291 certs.go:315] generating minikube signed cert: /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/apiserver.key.31bdca25
I0128 11:33:00.440437 43291 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/apiserver.crt.31bdca25 with IP's: [192.168.76.2 10.96.0.1 127.0.0.1 10.0.0.1]
I0128 11:33:00.559952 43291 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/apiserver.crt.31bdca25 ...
I0128 11:33:00.559987 43291 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/apiserver.crt.31bdca25: {Name:mka2529a6e235bc40f364eca6def7e7ddefdbc23 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0128 11:33:00.560293 43291 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/apiserver.key.31bdca25 ...
I0128 11:33:00.560301 43291 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/apiserver.key.31bdca25: {Name:mk8ad98ff6c57e105e17bc95626c1af2dc13c403 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0128 11:33:00.560506 43291 certs.go:333] copying /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/apiserver.crt.31bdca25 -> /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/apiserver.crt
I0128 11:33:00.560674 43291 certs.go:337] copying /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/apiserver.key.31bdca25 -> /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/apiserver.key
I0128 11:33:00.560827 43291 certs.go:315] generating aggregator signed cert: /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/proxy-client.key
I0128 11:33:00.560841 43291 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/proxy-client.crt with IP's: []
I0128 11:33:00.854114 43291 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/proxy-client.crt ...
I0128 11:33:00.854130 43291 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/proxy-client.crt: {Name:mk3940704c34895967bfeffaebabc0d303fc50bc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0128 11:33:00.854437 43291 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/proxy-client.key ...
I0128 11:33:00.854448 43291 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/proxy-client.key: {Name:mkfe4b87d8b6212353370fc9631900db1f6b6a9a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0128 11:33:00.854869 43291 certs.go:401] found cert: /Users/jenkins/minikube-integration/15565-24808/.minikube/certs/Users/jenkins/minikube-integration/15565-24808/.minikube/certs/25982.pem (1338 bytes)
W0128 11:33:00.854920 43291 certs.go:397] ignoring /Users/jenkins/minikube-integration/15565-24808/.minikube/certs/Users/jenkins/minikube-integration/15565-24808/.minikube/certs/25982_empty.pem, impossibly tiny 0 bytes
I0128 11:33:00.854931 43291 certs.go:401] found cert: /Users/jenkins/minikube-integration/15565-24808/.minikube/certs/Users/jenkins/minikube-integration/15565-24808/.minikube/certs/ca-key.pem (1675 bytes)
I0128 11:33:00.854968 43291 certs.go:401] found cert: /Users/jenkins/minikube-integration/15565-24808/.minikube/certs/Users/jenkins/minikube-integration/15565-24808/.minikube/certs/ca.pem (1082 bytes)
I0128 11:33:00.855005 43291 certs.go:401] found cert: /Users/jenkins/minikube-integration/15565-24808/.minikube/certs/Users/jenkins/minikube-integration/15565-24808/.minikube/certs/cert.pem (1123 bytes)
I0128 11:33:00.855042 43291 certs.go:401] found cert: /Users/jenkins/minikube-integration/15565-24808/.minikube/certs/Users/jenkins/minikube-integration/15565-24808/.minikube/certs/key.pem (1675 bytes)
I0128 11:33:00.855115 43291 certs.go:401] found cert: /Users/jenkins/minikube-integration/15565-24808/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/15565-24808/.minikube/files/etc/ssl/certs/259822.pem (1708 bytes)
I0128 11:33:00.855653 43291 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0128 11:33:00.875585 43291 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0128 11:33:00.894656 43291 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0128 11:33:00.914535 43291 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-24808/.minikube/profiles/old-k8s-version-182000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0128 11:33:00.936949 43291 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-24808/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0128 11:33:00.954921 43291 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-24808/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0128 11:33:00.973069 43291 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-24808/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0128 11:33:00.990970 43291 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-24808/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0128 11:33:01.008848 43291 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-24808/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0128 11:33:01.026545 43291 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-24808/.minikube/certs/25982.pem --> /usr/share/ca-certificates/25982.pem (1338 bytes)
I0128 11:33:01.044290 43291 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-24808/.minikube/files/etc/ssl/certs/259822.pem --> /usr/share/ca-certificates/259822.pem (1708 bytes)
I0128 11:33:01.062084 43291 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (772 bytes)
I0128 11:33:01.075699 43291 ssh_runner.go:195] Run: openssl version
I0128 11:33:01.081127 43291 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0128 11:33:01.089563 43291 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0128 11:33:01.093863 43291 certs.go:444] hashing: -rw-r--r-- 1 root root 1111 Jan 28 18:40 /usr/share/ca-certificates/minikubeCA.pem
I0128 11:33:01.093919 43291 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0128 11:33:01.099626 43291 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0128 11:33:01.108038 43291 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/25982.pem && ln -fs /usr/share/ca-certificates/25982.pem /etc/ssl/certs/25982.pem"
I0128 11:33:01.116239 43291 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/25982.pem
I0128 11:33:01.120414 43291 certs.go:444] hashing: -rw-r--r-- 1 root root 1338 Jan 28 18:44 /usr/share/ca-certificates/25982.pem
I0128 11:33:01.120465 43291 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/25982.pem
I0128 11:33:01.125943 43291 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/25982.pem /etc/ssl/certs/51391683.0"
I0128 11:33:01.134234 43291 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/259822.pem && ln -fs /usr/share/ca-certificates/259822.pem /etc/ssl/certs/259822.pem"
I0128 11:33:01.142606 43291 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/259822.pem
I0128 11:33:01.146705 43291 certs.go:444] hashing: -rw-r--r-- 1 root root 1708 Jan 28 18:44 /usr/share/ca-certificates/259822.pem
I0128 11:33:01.146753 43291 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/259822.pem
I0128 11:33:01.152290 43291 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/259822.pem /etc/ssl/certs/3ec20f2e.0"
I0128 11:33:01.160791 43291 kubeadm.go:401] StartCluster: {Name:old-k8s-version-182000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.37@sha256:8bf7a0e8a062bc5e2b71d28b35bfa9cc862d9220e234e86176b3785f685d8b15 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-182000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs
:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQe
muFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP:}
I0128 11:33:01.160894 43291 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0128 11:33:01.184773 43291 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0128 11:33:01.193053 43291 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0128 11:33:01.200595 43291 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
I0128 11:33:01.200650 43291 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0128 11:33:01.208131 43291 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0128 11:33:01.208160 43291 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0128 11:33:01.255566 43291 kubeadm.go:322] [init] Using Kubernetes version: v1.16.0
I0128 11:33:01.255634 43291 kubeadm.go:322] [preflight] Running pre-flight checks
I0128 11:33:01.565943 43291 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0128 11:33:01.566022 43291 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0128 11:33:01.566116 43291 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0128 11:33:01.796409 43291 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0128 11:33:01.797248 43291 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0128 11:33:01.803880 43291 kubeadm.go:322] [kubelet-start] Activating the kubelet service
I0128 11:33:01.865680 43291 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0128 11:33:01.886752 43291 out.go:204] - Generating certificates and keys ...
I0128 11:33:01.886831 43291 kubeadm.go:322] [certs] Using existing ca certificate authority
I0128 11:33:01.886901 43291 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0128 11:33:01.963790 43291 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
I0128 11:33:02.120509 43291 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
I0128 11:33:02.224603 43291 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
I0128 11:33:02.319860 43291 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
I0128 11:33:02.513294 43291 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
I0128 11:33:02.513444 43291 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [old-k8s-version-182000 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I0128 11:33:02.643261 43291 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
I0128 11:33:02.643381 43291 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-182000 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I0128 11:33:02.833867 43291 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
I0128 11:33:02.881480 43291 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
I0128 11:33:03.066740 43291 kubeadm.go:322] [certs] Generating "sa" key and public key
I0128 11:33:03.066811 43291 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0128 11:33:03.350006 43291 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0128 11:33:03.554020 43291 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0128 11:33:03.879140 43291 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0128 11:33:03.941799 43291 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0128 11:33:03.947197 43291 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0128 11:33:03.971541 43291 out.go:204] - Booting up control plane ...
I0128 11:33:03.971770 43291 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0128 11:33:03.971921 43291 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0128 11:33:03.972070 43291 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0128 11:33:03.972196 43291 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0128 11:33:03.972492 43291 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0128 11:33:43.954088 43291 kubeadm.go:322] [kubelet-check] Initial timeout of 40s passed.
I0128 11:33:43.954767 43291 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0128 11:33:43.954943 43291 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0128 11:33:48.955651 43291 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0128 11:33:48.955889 43291 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0128 11:33:58.957601 43291 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0128 11:33:58.957811 43291 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0128 11:34:18.958126 43291 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0128 11:34:18.958318 43291 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0128 11:34:58.959048 43291 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0128 11:34:58.959233 43291 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0128 11:34:58.959245 43291 kubeadm.go:322]
I0128 11:34:58.959272 43291 kubeadm.go:322] Unfortunately, an error has occurred:
I0128 11:34:58.959304 43291 kubeadm.go:322] timed out waiting for the condition
I0128 11:34:58.959308 43291 kubeadm.go:322]
I0128 11:34:58.959333 43291 kubeadm.go:322] This error is likely caused by:
I0128 11:34:58.959361 43291 kubeadm.go:322] - The kubelet is not running
I0128 11:34:58.959441 43291 kubeadm.go:322] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0128 11:34:58.959448 43291 kubeadm.go:322]
I0128 11:34:58.959527 43291 kubeadm.go:322] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0128 11:34:58.959561 43291 kubeadm.go:322] - 'systemctl status kubelet'
I0128 11:34:58.959600 43291 kubeadm.go:322] - 'journalctl -xeu kubelet'
I0128 11:34:58.959613 43291 kubeadm.go:322]
I0128 11:34:58.959710 43291 kubeadm.go:322] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0128 11:34:58.959788 43291 kubeadm.go:322] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I0128 11:34:58.959862 43291 kubeadm.go:322] Here is one example how you may list all Kubernetes containers running in docker:
I0128 11:34:58.959897 43291 kubeadm.go:322] - 'docker ps -a | grep kube | grep -v pause'
I0128 11:34:58.959949 43291 kubeadm.go:322] Once you have found the failing container, you can inspect its logs with:
I0128 11:34:58.959971 43291 kubeadm.go:322] - 'docker logs CONTAINERID'
I0128 11:34:58.962738 43291 kubeadm.go:322] [WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
I0128 11:34:58.962798 43291 kubeadm.go:322] [WARNING Swap]: running with swap on is not supported. Please disable swap
I0128 11:34:58.962904 43291 kubeadm.go:322] [WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.23. Latest validated version: 18.09
I0128 11:34:58.962986 43291 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0128 11:34:58.963049 43291 kubeadm.go:322] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0128 11:34:58.963118 43291 kubeadm.go:322] To see the stack trace of this error execute with --v=5 or higher
W0128 11:34:58.963283 43291 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-182000 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-182000 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.23. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-182000 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-182000 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.23. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0128 11:34:58.963325 43291 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"
I0128 11:34:59.384104 43291 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0128 11:34:59.394344 43291 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
I0128 11:34:59.394398 43291 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0128 11:34:59.402131 43291 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0128 11:34:59.402154 43291 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0128 11:34:59.462667 43291 kubeadm.go:322] [init] Using Kubernetes version: v1.16.0
I0128 11:34:59.462707 43291 kubeadm.go:322] [preflight] Running pre-flight checks
I0128 11:34:59.838201 43291 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0128 11:34:59.838302 43291 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0128 11:34:59.838404 43291 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0128 11:35:00.092722 43291 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0128 11:35:00.094472 43291 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0128 11:35:00.101304 43291 kubeadm.go:322] [kubelet-start] Activating the kubelet service
I0128 11:35:00.184377 43291 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0128 11:35:00.219469 43291 out.go:204] - Generating certificates and keys ...
I0128 11:35:00.219630 43291 kubeadm.go:322] [certs] Using existing ca certificate authority
I0128 11:35:00.219732 43291 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0128 11:35:00.219861 43291 kubeadm.go:322] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0128 11:35:00.219941 43291 kubeadm.go:322] [certs] Using existing front-proxy-ca certificate authority
I0128 11:35:00.220058 43291 kubeadm.go:322] [certs] Using existing front-proxy-client certificate and key on disk
I0128 11:35:00.220122 43291 kubeadm.go:322] [certs] Using existing etcd/ca certificate authority
I0128 11:35:00.220225 43291 kubeadm.go:322] [certs] Using existing etcd/server certificate and key on disk
I0128 11:35:00.220293 43291 kubeadm.go:322] [certs] Using existing etcd/peer certificate and key on disk
I0128 11:35:00.220393 43291 kubeadm.go:322] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0128 11:35:00.220486 43291 kubeadm.go:322] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0128 11:35:00.220552 43291 kubeadm.go:322] [certs] Using the existing "sa" key
I0128 11:35:00.220638 43291 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0128 11:35:00.352833 43291 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0128 11:35:00.413681 43291 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0128 11:35:00.508008 43291 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0128 11:35:00.550030 43291 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0128 11:35:00.551206 43291 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0128 11:35:00.573037 43291 out.go:204] - Booting up control plane ...
I0128 11:35:00.573180 43291 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0128 11:35:00.573279 43291 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0128 11:35:00.573369 43291 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0128 11:35:00.573462 43291 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0128 11:35:00.573643 43291 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0128 11:35:40.560875 43291 kubeadm.go:322] [kubelet-check] Initial timeout of 40s passed.
I0128 11:35:40.562075 43291 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0128 11:35:40.562336 43291 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0128 11:35:45.563908 43291 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0128 11:35:45.564137 43291 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0128 11:35:55.564621 43291 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0128 11:35:55.564797 43291 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0128 11:36:15.565375 43291 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0128 11:36:15.565569 43291 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0128 11:36:55.567407 43291 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0128 11:36:55.567612 43291 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0128 11:36:55.567623 43291 kubeadm.go:322]
I0128 11:36:55.567656 43291 kubeadm.go:322] Unfortunately, an error has occurred:
I0128 11:36:55.567693 43291 kubeadm.go:322] timed out waiting for the condition
I0128 11:36:55.567702 43291 kubeadm.go:322]
I0128 11:36:55.567740 43291 kubeadm.go:322] This error is likely caused by:
I0128 11:36:55.567769 43291 kubeadm.go:322] - The kubelet is not running
I0128 11:36:55.567935 43291 kubeadm.go:322] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0128 11:36:55.567949 43291 kubeadm.go:322]
I0128 11:36:55.568090 43291 kubeadm.go:322] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0128 11:36:55.568138 43291 kubeadm.go:322] - 'systemctl status kubelet'
I0128 11:36:55.568197 43291 kubeadm.go:322] - 'journalctl -xeu kubelet'
I0128 11:36:55.568207 43291 kubeadm.go:322]
I0128 11:36:55.568344 43291 kubeadm.go:322] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0128 11:36:55.568481 43291 kubeadm.go:322] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I0128 11:36:55.568639 43291 kubeadm.go:322] Here is one example how you may list all Kubernetes containers running in docker:
I0128 11:36:55.568712 43291 kubeadm.go:322] - 'docker ps -a | grep kube | grep -v pause'
I0128 11:36:55.568799 43291 kubeadm.go:322] Once you have found the failing container, you can inspect its logs with:
I0128 11:36:55.568840 43291 kubeadm.go:322] - 'docker logs CONTAINERID'
I0128 11:36:55.571229 43291 kubeadm.go:322] [WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
I0128 11:36:55.571293 43291 kubeadm.go:322] [WARNING Swap]: running with swap on is not supported. Please disable swap
I0128 11:36:55.571400 43291 kubeadm.go:322] [WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.23. Latest validated version: 18.09
I0128 11:36:55.571473 43291 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0128 11:36:55.571550 43291 kubeadm.go:322] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0128 11:36:55.571602 43291 kubeadm.go:322] To see the stack trace of this error execute with --v=5 or higher
I0128 11:36:55.571621 43291 kubeadm.go:403] StartCluster complete in 3m54.410251403s
I0128 11:36:55.571726 43291 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0128 11:36:55.595118 43291 logs.go:279] 0 containers: []
W0128 11:36:55.595130 43291 logs.go:281] No container was found matching "kube-apiserver"
I0128 11:36:55.595197 43291 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0128 11:36:55.618420 43291 logs.go:279] 0 containers: []
W0128 11:36:55.618434 43291 logs.go:281] No container was found matching "etcd"
I0128 11:36:55.618506 43291 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0128 11:36:55.643289 43291 logs.go:279] 0 containers: []
W0128 11:36:55.643302 43291 logs.go:281] No container was found matching "coredns"
I0128 11:36:55.643369 43291 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0128 11:36:55.666197 43291 logs.go:279] 0 containers: []
W0128 11:36:55.666210 43291 logs.go:281] No container was found matching "kube-scheduler"
I0128 11:36:55.666277 43291 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0128 11:36:55.689976 43291 logs.go:279] 0 containers: []
W0128 11:36:55.689990 43291 logs.go:281] No container was found matching "kube-proxy"
I0128 11:36:55.690059 43291 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0128 11:36:55.712763 43291 logs.go:279] 0 containers: []
W0128 11:36:55.712776 43291 logs.go:281] No container was found matching "kubernetes-dashboard"
I0128 11:36:55.712849 43291 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0128 11:36:55.736238 43291 logs.go:279] 0 containers: []
W0128 11:36:55.736252 43291 logs.go:281] No container was found matching "storage-provisioner"
I0128 11:36:55.736322 43291 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0128 11:36:55.760663 43291 logs.go:279] 0 containers: []
W0128 11:36:55.760676 43291 logs.go:281] No container was found matching "kube-controller-manager"
I0128 11:36:55.760683 43291 logs.go:124] Gathering logs for kubelet ...
I0128 11:36:55.760690 43291 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0128 11:36:55.798991 43291 logs.go:124] Gathering logs for dmesg ...
I0128 11:36:55.799003 43291 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0128 11:36:55.811451 43291 logs.go:124] Gathering logs for describe nodes ...
I0128 11:36:55.811466 43291 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0128 11:36:55.902272 43291 logs.go:131] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0128 11:36:55.902284 43291 logs.go:124] Gathering logs for Docker ...
I0128 11:36:55.902290 43291 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400"
I0128 11:36:55.919801 43291 logs.go:124] Gathering logs for container status ...
I0128 11:36:55.919817 43291 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0128 11:36:57.970987 43291 ssh_runner.go:235] Completed: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": (2.051152228s)
W0128 11:36:57.971121 43291 out.go:369] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.23. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0128 11:36:57.971137 43291 out.go:239] *
*
W0128 11:36:57.971313 43291 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.23. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.23. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0128 11:36:57.971333 43291 out.go:239] *
*
W0128 11:36:57.971970 43291 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0128 11:36:58.035583 43291 out.go:177]
W0128 11:36:58.078681 43291 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.23. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.23. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0128 11:36:58.078856 43291 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0128 11:36:58.078935 43291 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0128 11:36:58.136307 43291 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p old-k8s-version-182000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-182000
helpers_test.go:235: (dbg) docker inspect old-k8s-version-182000:
-- stdout --
[
{
"Id": "617ab90eb0df8d30a74a5dc57ab16039882655d65e3025362322b78aeec379ac",
"Created": "2023-01-28T19:32:55.313551858Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 664489,
"ExitCode": 0,
"Error": "",
"StartedAt": "2023-01-28T19:32:55.598829839Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:01c0ce65fff70ab1f019aa14679c46b23331bd108ae899438e589673efaa9c00",
"ResolvConfPath": "/var/lib/docker/containers/617ab90eb0df8d30a74a5dc57ab16039882655d65e3025362322b78aeec379ac/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/617ab90eb0df8d30a74a5dc57ab16039882655d65e3025362322b78aeec379ac/hostname",
"HostsPath": "/var/lib/docker/containers/617ab90eb0df8d30a74a5dc57ab16039882655d65e3025362322b78aeec379ac/hosts",
"LogPath": "/var/lib/docker/containers/617ab90eb0df8d30a74a5dc57ab16039882655d65e3025362322b78aeec379ac/617ab90eb0df8d30a74a5dc57ab16039882655d65e3025362322b78aeec379ac-json.log",
"Name": "/old-k8s-version-182000",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-182000:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-182000",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"ConsoleSize": [
0,
0
],
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": null,
"BlkioDeviceWriteBps": null,
"BlkioDeviceReadIOps": null,
"BlkioDeviceWriteIOps": null,
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"KernelMemory": 0,
"KernelMemoryTCP": 0,
"MemoryReservation": 0,
"MemorySwap": 2306867200,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": null,
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/cf358ab04dbdc1e02cf2f4479b1d8fec29dc7884849cab2c09927d672777c18a-init/diff:/var/lib/docker/overlay2/ebc03c916d1215717cc928cc2ae6bb5febcaf1787682b19b31688cb58ea354df/diff:/var/lib/docker/overlay2/aaa47387c6297b9482eaf2d8291628b9713643f21d066c37435b7e2cb9493e2a/diff:/var/lib/docker/overlay2/f4b2c82f60338b3f859441322400906b78ab112321f53e01c52ec81f29b4b492/diff:/var/lib/docker/overlay2/9425b655d46ca09e43b6484556a0c42b69e0c7947e14ec530546a61f36d3b950/diff:/var/lib/docker/overlay2/7d54571f62200ad4404fb9bb52649136f53eb6d6eedc5a51b22898df9001c1d4/diff:/var/lib/docker/overlay2/a4b4864baac235070d93e0940d897dd3006e6a93d705490108451f8d00ba148f/diff:/var/lib/docker/overlay2/8b092a30ffaf1c9230cef4864afb85d91ceb9fa92e484e3ebf7a31bb7df915bc/diff:/var/lib/docker/overlay2/96ac23e2e494a92e2287115c1a85e160e67543832baaaa3fa9a2351b370d5bd4/diff:/var/lib/docker/overlay2/c1e68f2d6c4ce95b33833a8d750a79aeaef16cc7d0a556369a63014eef7597b6/diff:/var/lib/docker/overlay2/89b3fe
fdd4bd8243826ccca31dec1aef9f91ad82adda108147b89c096792dfa5/diff:/var/lib/docker/overlay2/0b09be009751a25e4cbe64835151f1a814c4547d2c513994ae82f8093a22040d/diff:/var/lib/docker/overlay2/dc9a2b1667d67c8f0269966ef8862a4ffcfe4b68ad45f12e3ff27075c595c716/diff:/var/lib/docker/overlay2/d41ab03c6154f92111515bffc37c1d75570fa697ffa380631216096b52bfbc1b/diff:/var/lib/docker/overlay2/549b2cfc0a7d4f81f8d2624b1b2069b66d159ecd7b38148b476bb7a1b9e29100/diff:/var/lib/docker/overlay2/ecd7a1e2ce66c77afcf87a94383f14763eca5c8732c76b1b83765a278db91228/diff:/var/lib/docker/overlay2/6361f06734d312adc4271443765c435c4a7600356d1c6597fb7fa440cf1a2eb4/diff:/var/lib/docker/overlay2/cc7751a853d09ad130dccc1c835daa64e6ba830331636aca6a2a98da95ab52c1/diff:/var/lib/docker/overlay2/6612588f68e64e123a6e5cf6f6da339ee6072f8054f936be6d4f799d6c683e75/diff:/var/lib/docker/overlay2/673e42d3b5998d60bbb5c7c40da29902c3ea35068701966a7e3fd8a923d4a37a/diff:/var/lib/docker/overlay2/115d8a9e167d9b574c1d945d85d46da3ad2688595502524702976fc9b1051464/diff:/var/lib/d
ocker/overlay2/a8a2380c37eec6348eac27c7ee660b1f1d1ef94786cd68f197218066d99d80dd/diff:/var/lib/docker/overlay2/9261c5669bb687df6f9ad1ac00615cdf03b913ab9b3e1ca1a1f1cb6420702325/diff:/var/lib/docker/overlay2/46213bfa914da7941cec1c2c32185400a83c35a74274f39d74ad203ee5688535/diff:/var/lib/docker/overlay2/45ce48252aa0eeb54f2a1c27e570f8e85ac4a1d28a947b81618e608c64e3a700/diff:/var/lib/docker/overlay2/5631fae0fb00254444e3cc059b8b6062ee02fd66eefdf043970883f6724ce682/diff:/var/lib/docker/overlay2/e23ece345ff4dee7248a8e8cbd15cdbaef319d286a6490377fc337feecd6be04/diff:/var/lib/docker/overlay2/004bedb9de21965ae003d62b64a9e6506a10afa328b9af469eb51d3920d9c3b6/diff:/var/lib/docker/overlay2/c0ed692b610507b4315c2a43e64bd682bfdae35a7b4bcba499bba9cfb33121c4/diff:/var/lib/docker/overlay2/8396057830d1ed01256a5ee803b6310c8bf4c6ef3fb0f958240557352a12f3db/diff:/var/lib/docker/overlay2/c8024a29733fe87d5aad124df5ff33e97bcca94ee9fee196a6d51c9474692733/diff:/var/lib/docker/overlay2/9e59b455e481cdabd17790daddef6872e7b6452d1e8de1526998d92ab5f
c008f/diff:/var/lib/docker/overlay2/88cc3ecb1b979acbac3227fd30f3e879629eff2b47f416b3069463900f3e40e0/diff:/var/lib/docker/overlay2/5ef1713ef4e296c4637ccd2823c2b80cb5c53cd757947ff3fc17b7dd2d2dd21c/diff:/var/lib/docker/overlay2/17a697eb9c335b2a20567e3615e2222a113542532402dc62978ff64d65860c5e/diff:/var/lib/docker/overlay2/69e01a154090c42cbf63b88c7e922d483dd2d393fbab64725f79b3ff3800c3c1/diff:/var/lib/docker/overlay2/6ed77ee7b45230567431b0cbfb9cefedfd3f3d7eecf271f20a711bbcc4fdb1b3/diff:/var/lib/docker/overlay2/3bf095c6d6fe582e91d9a9ab0dc5b4d168f93f28ec2488a88f60b63ebf1e22f7/diff:/var/lib/docker/overlay2/cfc3bbbdc2702c8d23d146885b4da1a4482e8af461b5c87426fab855f97417a0/diff:/var/lib/docker/overlay2/1c4944ff8930ced790954d78530aeaf94eeb6c7367b474bdfbad30345cc1276a/diff:/var/lib/docker/overlay2/44cf435555d16eb68c4149bc53e4ae11797c7ddb429332f3d0d36328cb16ea5f/diff:/var/lib/docker/overlay2/4a7b4287594c4da981df984cd6e3910778bfdff2b5560a03d6cdcb589790c8e5/diff:/var/lib/docker/overlay2/76c287aa1bd3a7c3636e82df1bac8ead485e55
7a0fd68fdbfc0d5655d89f7113/diff:/var/lib/docker/overlay2/a2ab65056651b30980d6df9664f682519df2c2fc604d87ddb2bb2ca25b663d5e/diff:/var/lib/docker/overlay2/3a84daa5ad43dd7c27d884672613e37b8a5bed1fa79edee0e951b2e3fa39f21f/diff",
"MergedDir": "/var/lib/docker/overlay2/cf358ab04dbdc1e02cf2f4479b1d8fec29dc7884849cab2c09927d672777c18a/merged",
"UpperDir": "/var/lib/docker/overlay2/cf358ab04dbdc1e02cf2f4479b1d8fec29dc7884849cab2c09927d672777c18a/diff",
"WorkDir": "/var/lib/docker/overlay2/cf358ab04dbdc1e02cf2f4479b1d8fec29dc7884849cab2c09927d672777c18a/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-182000",
"Source": "/var/lib/docker/volumes/old-k8s-version-182000/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-182000",
"Domainname": "",
"User": "root",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase:v0.0.37@sha256:8bf7a0e8a062bc5e2b71d28b35bfa9cc862d9220e234e86176b3785f685d8b15",
"Volumes": null,
"WorkingDir": "",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-182000",
"name.minikube.sigs.k8s.io": "old-k8s-version-182000",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "de26b70de179023ab92799de40ef1eeb652a8d446f418d9a014b2020f75ff7b5",
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "62637"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "62638"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "62639"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "62635"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "62636"
}
]
},
"SandboxKey": "/var/run/docker/netns/de26b70de179",
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-182000": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": [
"617ab90eb0df",
"old-k8s-version-182000"
],
"NetworkID": "56bfdf73bec9b0196848fd6c701661b6f09d89a5213236097da597daf246c910",
"EndpointID": "f469f3373bcad5db987b8fe4d4eca778cf1ffe79ecee6ea42cb7f1d2530a653e",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"MacAddress": "02:42:c0:a8:4c:02",
"DriverOpts": null
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-182000 -n old-k8s-version-182000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-182000 -n old-k8s-version-182000: exit status 6 (406.406422ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0128 11:36:58.688607 44386 status.go:415] kubeconfig endpoint: extract IP: "old-k8s-version-182000" does not appear in /Users/jenkins/minikube-integration/15565-24808/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-182000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (251.93s)