=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-darwin-amd64 start -p old-k8s-version-865000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-865000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0: exit status 109 (4m11.254749485s)
-- stdout --
* [old-k8s-version-865000] minikube v1.29.0 on Darwin 13.2
- MINIKUBE_LOCATION=15909
- KUBECONFIG=/Users/jenkins/minikube-integration/15909-2664/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/15909-2664/.minikube
- MINIKUBE_FORCE_SYSTEMD=
* Using the docker driver based on user configuration
* Using Docker Desktop driver with root privileges
* Starting control plane node old-k8s-version-865000 in cluster old-k8s-version-865000
* Pulling base image ...
* Creating docker container (CPUs=2, Memory=2200MB) ...
* Preparing Kubernetes v1.16.0 on Docker 23.0.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0222 21:15:22.809218 20193 out.go:296] Setting OutFile to fd 1 ...
I0222 21:15:22.809484 20193 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0222 21:15:22.809491 20193 out.go:309] Setting ErrFile to fd 2...
I0222 21:15:22.809496 20193 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0222 21:15:22.809617 20193 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/15909-2664/.minikube/bin
I0222 21:15:22.811297 20193 out.go:303] Setting JSON to false
I0222 21:15:22.832109 20193 start.go:125] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":4497,"bootTime":1677124825,"procs":419,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.2","kernelVersion":"22.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
W0222 21:15:22.832190 20193 start.go:133] gopshost.Virtualization returned error: not implemented yet
I0222 21:15:22.869858 20193 out.go:177] * [old-k8s-version-865000] minikube v1.29.0 on Darwin 13.2
I0222 21:15:22.982110 20193 out.go:177] - MINIKUBE_LOCATION=15909
I0222 21:15:22.944862 20193 notify.go:220] Checking for updates...
I0222 21:15:23.040596 20193 out.go:177] - KUBECONFIG=/Users/jenkins/minikube-integration/15909-2664/kubeconfig
I0222 21:15:23.115031 20193 out.go:177] - MINIKUBE_BIN=out/minikube-darwin-amd64
I0222 21:15:23.190002 20193 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0222 21:15:23.264559 20193 out.go:177] - MINIKUBE_HOME=/Users/jenkins/minikube-integration/15909-2664/.minikube
I0222 21:15:23.323905 20193 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0222 21:15:23.360666 20193 config.go:182] Loaded profile config "kubenet-310000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.26.1
I0222 21:15:23.360753 20193 driver.go:365] Setting default libvirt URI to qemu:///system
I0222 21:15:23.427753 20193 docker.go:121] docker version: linux-20.10.22:Docker Desktop 4.16.2 (95914)
I0222 21:15:23.427920 20193 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0222 21:15:23.584947 20193 info.go:266] docker info: {ID:OZUI:YKWJ:UOTC:7ZLB:F6EB:CHWM:OTRK:2EBF:TWQA:NMVS:HOC3:AMA3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:62 OomKillDisable:false NGoroutines:56 SystemTime:2023-02-23 05:15:23.483225007 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:5 KernelVersion:5.15.49-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6231715840 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.22 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:9ba4b250366a5ddde94bb7c9d1def331423aa323 Expected:9ba4b250366a5ddde94bb7c9d1def331423aa323} RuncCommit:{ID:v1.1.4-0-g5fd4c4d Expected:v1.1.4-0-g5fd4c4d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defaul
t name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.10.0] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.15.1] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.0.5] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.17] map[Name:sbom Path
:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scan] ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I0222 21:15:23.624788 20193 out.go:177] * Using the docker driver based on user configuration
I0222 21:15:23.682851 20193 start.go:296] selected driver: docker
I0222 21:15:23.682883 20193 start.go:857] validating driver "docker" against <nil>
I0222 21:15:23.682909 20193 start.go:868] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0222 21:15:23.686820 20193 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0222 21:15:23.832754 20193 info.go:266] docker info: {ID:OZUI:YKWJ:UOTC:7ZLB:F6EB:CHWM:OTRK:2EBF:TWQA:NMVS:HOC3:AMA3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:62 OomKillDisable:false NGoroutines:56 SystemTime:2023-02-23 05:15:23.740307625 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:5 KernelVersion:5.15.49-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6231715840 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.22 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:9ba4b250366a5ddde94bb7c9d1def331423aa323 Expected:9ba4b250366a5ddde94bb7c9d1def331423aa323} RuncCommit:{ID:v1.1.4-0-g5fd4c4d Expected:v1.1.4-0-g5fd4c4d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defaul
t name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.10.0] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.15.1] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.0.5] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.17] map[Name:sbom Path
:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scan] ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I0222 21:15:23.832886 20193 start_flags.go:305] no existing cluster config was found, will generate one from the flags
I0222 21:15:23.833097 20193 start_flags.go:919] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0222 21:15:23.854797 20193 out.go:177] * Using Docker Desktop driver with root privileges
I0222 21:15:23.891701 20193 cni.go:84] Creating CNI manager for ""
I0222 21:15:23.891740 20193 cni.go:161] CNI unnecessary in this configuration, recommending no CNI
I0222 21:15:23.891754 20193 start_flags.go:319] config:
{Name:old-k8s-version-865000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.37-1676506612-15768@sha256:cc1cb283879fedae93096946a6953a50075ed680d467a47cbf669e0ed7d3aebc Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-865000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP:}
I0222 21:15:23.913752 20193 out.go:177] * Starting control plane node old-k8s-version-865000 in cluster old-k8s-version-865000
I0222 21:15:23.950855 20193 cache.go:120] Beginning downloading kic base image for docker with docker
I0222 21:15:23.987864 20193 out.go:177] * Pulling base image ...
I0222 21:15:24.024979 20193 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0222 21:15:24.025078 20193 image.go:77] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.37-1676506612-15768@sha256:cc1cb283879fedae93096946a6953a50075ed680d467a47cbf669e0ed7d3aebc in local docker daemon
I0222 21:15:24.025107 20193 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/15909-2664/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4
I0222 21:15:24.025127 20193 cache.go:57] Caching tarball of preloaded images
I0222 21:15:24.025386 20193 preload.go:174] Found /Users/jenkins/minikube-integration/15909-2664/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0222 21:15:24.025423 20193 cache.go:60] Finished verifying existence of preloaded tar for v1.16.0 on docker
I0222 21:15:24.025647 20193 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/config.json ...
I0222 21:15:24.026337 20193 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/config.json: {Name:mk92a5550f58eb5b42a60e5f19f57541a4fe93a5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0222 21:15:24.081939 20193 image.go:81] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.37-1676506612-15768@sha256:cc1cb283879fedae93096946a6953a50075ed680d467a47cbf669e0ed7d3aebc in local docker daemon, skipping pull
I0222 21:15:24.081958 20193 cache.go:143] gcr.io/k8s-minikube/kicbase-builds:v0.0.37-1676506612-15768@sha256:cc1cb283879fedae93096946a6953a50075ed680d467a47cbf669e0ed7d3aebc exists in daemon, skipping load
I0222 21:15:24.082141 20193 cache.go:193] Successfully downloaded all kic artifacts
I0222 21:15:24.082185 20193 start.go:364] acquiring machines lock for old-k8s-version-865000: {Name:mk6cb26d76424f531c6197cd66b272c20668b8f3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0222 21:15:24.082343 20193 start.go:368] acquired machines lock for "old-k8s-version-865000" in 145.577µs
I0222 21:15:24.082376 20193 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-865000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.37-1676506612-15768@sha256:cc1cb283879fedae93096946a6953a50075ed680d467a47cbf669e0ed7d3aebc Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-865000 Namespace:default APIServer
Name:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:f
alse DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0222 21:15:24.082455 20193 start.go:125] createHost starting for "" (driver="docker")
I0222 21:15:24.125737 20193 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0222 21:15:24.126184 20193 start.go:159] libmachine.API.Create for "old-k8s-version-865000" (driver="docker")
I0222 21:15:24.126228 20193 client.go:168] LocalClient.Create starting
I0222 21:15:24.126410 20193 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/15909-2664/.minikube/certs/ca.pem
I0222 21:15:24.126496 20193 main.go:141] libmachine: Decoding PEM data...
I0222 21:15:24.126532 20193 main.go:141] libmachine: Parsing certificate...
I0222 21:15:24.126652 20193 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/15909-2664/.minikube/certs/cert.pem
I0222 21:15:24.126717 20193 main.go:141] libmachine: Decoding PEM data...
I0222 21:15:24.126734 20193 main.go:141] libmachine: Parsing certificate...
I0222 21:15:24.127654 20193 cli_runner.go:164] Run: docker network inspect old-k8s-version-865000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0222 21:15:24.181562 20193 cli_runner.go:211] docker network inspect old-k8s-version-865000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0222 21:15:24.181686 20193 network_create.go:281] running [docker network inspect old-k8s-version-865000] to gather additional debugging logs...
I0222 21:15:24.181706 20193 cli_runner.go:164] Run: docker network inspect old-k8s-version-865000
W0222 21:15:24.235717 20193 cli_runner.go:211] docker network inspect old-k8s-version-865000 returned with exit code 1
I0222 21:15:24.235742 20193 network_create.go:284] error running [docker network inspect old-k8s-version-865000]: docker network inspect old-k8s-version-865000: exit status 1
stdout:
[]
stderr:
Error: No such network: old-k8s-version-865000
I0222 21:15:24.235756 20193 network_create.go:286] output of [docker network inspect old-k8s-version-865000]: -- stdout --
[]
-- /stdout --
** stderr **
Error: No such network: old-k8s-version-865000
** /stderr **
I0222 21:15:24.235839 20193 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0222 21:15:24.291693 20193 network.go:212] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0222 21:15:24.293073 20193 network.go:212] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0222 21:15:24.294603 20193 network.go:212] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0222 21:15:24.294922 20193 network.go:209] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00052ce60}
I0222 21:15:24.294935 20193 network_create.go:123] attempt to create docker network old-k8s-version-865000 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I0222 21:15:24.295008 20193 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-865000 old-k8s-version-865000
I0222 21:15:24.382717 20193 network_create.go:107] docker network old-k8s-version-865000 192.168.76.0/24 created
I0222 21:15:24.382747 20193 kic.go:117] calculated static IP "192.168.76.2" for the "old-k8s-version-865000" container
I0222 21:15:24.382859 20193 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0222 21:15:24.448493 20193 cli_runner.go:164] Run: docker volume create old-k8s-version-865000 --label name.minikube.sigs.k8s.io=old-k8s-version-865000 --label created_by.minikube.sigs.k8s.io=true
I0222 21:15:24.509062 20193 oci.go:103] Successfully created a docker volume old-k8s-version-865000
I0222 21:15:24.509215 20193 cli_runner.go:164] Run: docker run --rm --name old-k8s-version-865000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-865000 --entrypoint /usr/bin/test -v old-k8s-version-865000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.37-1676506612-15768@sha256:cc1cb283879fedae93096946a6953a50075ed680d467a47cbf669e0ed7d3aebc -d /var/lib
I0222 21:15:24.969253 20193 oci.go:107] Successfully prepared a docker volume old-k8s-version-865000
I0222 21:15:24.969293 20193 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0222 21:15:24.969309 20193 kic.go:190] Starting extracting preloaded images to volume ...
I0222 21:15:24.969434 20193 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/15909-2664/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-865000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.37-1676506612-15768@sha256:cc1cb283879fedae93096946a6953a50075ed680d467a47cbf669e0ed7d3aebc -I lz4 -xf /preloaded.tar -C /extractDir
I0222 21:15:31.217633 20193 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/15909-2664/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-865000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.37-1676506612-15768@sha256:cc1cb283879fedae93096946a6953a50075ed680d467a47cbf669e0ed7d3aebc -I lz4 -xf /preloaded.tar -C /extractDir: (6.248205483s)
I0222 21:15:31.217655 20193 kic.go:199] duration metric: took 6.248428 seconds to extract preloaded images to volume
I0222 21:15:31.217764 20193 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0222 21:15:31.360184 20193 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname old-k8s-version-865000 --name old-k8s-version-865000 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-865000 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=old-k8s-version-865000 --network old-k8s-version-865000 --ip 192.168.76.2 --volume old-k8s-version-865000:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.37-1676506612-15768@sha256:cc1cb283879fedae93096946a6953a50075ed680d467a47cbf669e0ed7d3aebc
I0222 21:15:31.728066 20193 cli_runner.go:164] Run: docker container inspect old-k8s-version-865000 --format={{.State.Running}}
I0222 21:15:31.791998 20193 cli_runner.go:164] Run: docker container inspect old-k8s-version-865000 --format={{.State.Status}}
I0222 21:15:31.860282 20193 cli_runner.go:164] Run: docker exec old-k8s-version-865000 stat /var/lib/dpkg/alternatives/iptables
I0222 21:15:31.998629 20193 oci.go:144] the created container "old-k8s-version-865000" has a running status.
I0222 21:15:31.998672 20193 kic.go:221] Creating ssh key for kic: /Users/jenkins/minikube-integration/15909-2664/.minikube/machines/old-k8s-version-865000/id_rsa...
I0222 21:15:32.259892 20193 kic_runner.go:191] docker (temp): /Users/jenkins/minikube-integration/15909-2664/.minikube/machines/old-k8s-version-865000/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0222 21:15:32.363469 20193 cli_runner.go:164] Run: docker container inspect old-k8s-version-865000 --format={{.State.Status}}
I0222 21:15:32.424392 20193 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0222 21:15:32.424411 20193 kic_runner.go:114] Args: [docker exec --privileged old-k8s-version-865000 chown docker:docker /home/docker/.ssh/authorized_keys]
I0222 21:15:32.532182 20193 cli_runner.go:164] Run: docker container inspect old-k8s-version-865000 --format={{.State.Status}}
I0222 21:15:32.589214 20193 machine.go:88] provisioning docker machine ...
I0222 21:15:32.589256 20193 ubuntu.go:169] provisioning hostname "old-k8s-version-865000"
I0222 21:15:32.589363 20193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-865000
I0222 21:15:32.649128 20193 main.go:141] libmachine: Using SSH client type: native
I0222 21:15:32.649517 20193 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 127.0.0.1 54450 <nil> <nil>}
I0222 21:15:32.649530 20193 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-865000 && echo "old-k8s-version-865000" | sudo tee /etc/hostname
I0222 21:15:32.791344 20193 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-865000
I0222 21:15:32.791435 20193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-865000
I0222 21:15:32.849718 20193 main.go:141] libmachine: Using SSH client type: native
I0222 21:15:32.850089 20193 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 127.0.0.1 54450 <nil> <nil>}
I0222 21:15:32.850102 20193 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-865000' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-865000/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-865000' | sudo tee -a /etc/hosts;
fi
fi
I0222 21:15:32.984121 20193 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0222 21:15:32.984144 20193 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/15909-2664/.minikube CaCertPath:/Users/jenkins/minikube-integration/15909-2664/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/15909-2664/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/15909-2664/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/15909-2664/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/15909-2664/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/15909-2664/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/15909-2664/.minikube}
I0222 21:15:32.984161 20193 ubuntu.go:177] setting up certificates
I0222 21:15:32.984174 20193 provision.go:83] configureAuth start
I0222 21:15:32.984273 20193 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-865000
I0222 21:15:33.042444 20193 provision.go:138] copyHostCerts
I0222 21:15:33.042548 20193 exec_runner.go:144] found /Users/jenkins/minikube-integration/15909-2664/.minikube/ca.pem, removing ...
I0222 21:15:33.042563 20193 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15909-2664/.minikube/ca.pem
I0222 21:15:33.042699 20193 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15909-2664/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/15909-2664/.minikube/ca.pem (1082 bytes)
I0222 21:15:33.042916 20193 exec_runner.go:144] found /Users/jenkins/minikube-integration/15909-2664/.minikube/cert.pem, removing ...
I0222 21:15:33.042922 20193 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15909-2664/.minikube/cert.pem
I0222 21:15:33.042990 20193 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15909-2664/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/15909-2664/.minikube/cert.pem (1123 bytes)
I0222 21:15:33.043135 20193 exec_runner.go:144] found /Users/jenkins/minikube-integration/15909-2664/.minikube/key.pem, removing ...
I0222 21:15:33.043144 20193 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15909-2664/.minikube/key.pem
I0222 21:15:33.043210 20193 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15909-2664/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/15909-2664/.minikube/key.pem (1675 bytes)
I0222 21:15:33.043335 20193 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/15909-2664/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/15909-2664/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/15909-2664/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-865000 san=[192.168.76.2 127.0.0.1 localhost 127.0.0.1 minikube old-k8s-version-865000]
I0222 21:15:33.094699 20193 provision.go:172] copyRemoteCerts
I0222 21:15:33.094753 20193 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0222 21:15:33.094811 20193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-865000
I0222 21:15:33.154772 20193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54450 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2664/.minikube/machines/old-k8s-version-865000/id_rsa Username:docker}
I0222 21:15:33.250873 20193 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2664/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0222 21:15:33.268387 20193 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2664/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
I0222 21:15:33.285707 20193 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2664/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0222 21:15:33.302755 20193 provision.go:86] duration metric: configureAuth took 318.569888ms
I0222 21:15:33.302770 20193 ubuntu.go:193] setting minikube options for container-runtime
I0222 21:15:33.302920 20193 config.go:182] Loaded profile config "old-k8s-version-865000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
I0222 21:15:33.302987 20193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-865000
I0222 21:15:33.360259 20193 main.go:141] libmachine: Using SSH client type: native
I0222 21:15:33.360608 20193 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 127.0.0.1 54450 <nil> <nil>}
I0222 21:15:33.360622 20193 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0222 21:15:33.493738 20193 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0222 21:15:33.493760 20193 ubuntu.go:71] root file system type: overlay
I0222 21:15:33.493872 20193 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0222 21:15:33.493961 20193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-865000
I0222 21:15:33.554003 20193 main.go:141] libmachine: Using SSH client type: native
I0222 21:15:33.554343 20193 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 127.0.0.1 54450 <nil> <nil>}
I0222 21:15:33.554390 20193 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0222 21:15:33.699682 20193 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0222 21:15:33.699771 20193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-865000
I0222 21:15:33.758046 20193 main.go:141] libmachine: Using SSH client type: native
I0222 21:15:33.758436 20193 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 127.0.0.1 54450 <nil> <nil>}
I0222 21:15:33.758449 20193 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0222 21:15:34.400745 20193 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2023-02-09 19:46:56.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2023-02-23 05:15:33.697897346 +0000
@@ -1,30 +1,32 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service time-set.target
-Wants=network-online.target containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
+Wants=network-online.target
Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutStartSec=0
-RestartSec=2
-Restart=always
+Restart=on-failure
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
@@ -32,16 +34,16 @@
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0222 21:15:34.400772 20193 machine.go:91] provisioned docker machine in 1.811563633s
I0222 21:15:34.400780 20193 client.go:171] LocalClient.Create took 10.274679647s
I0222 21:15:34.400800 20193 start.go:167] duration metric: libmachine.API.Create for "old-k8s-version-865000" took 10.274752327s
I0222 21:15:34.400812 20193 start.go:300] post-start starting for "old-k8s-version-865000" (driver="docker")
I0222 21:15:34.400823 20193 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0222 21:15:34.400915 20193 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0222 21:15:34.400969 20193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-865000
I0222 21:15:34.464661 20193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54450 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2664/.minikube/machines/old-k8s-version-865000/id_rsa Username:docker}
I0222 21:15:34.561012 20193 ssh_runner.go:195] Run: cat /etc/os-release
I0222 21:15:34.564621 20193 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0222 21:15:34.564639 20193 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0222 21:15:34.564646 20193 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0222 21:15:34.564652 20193 info.go:137] Remote host: Ubuntu 20.04.5 LTS
I0222 21:15:34.564663 20193 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15909-2664/.minikube/addons for local assets ...
I0222 21:15:34.564781 20193 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15909-2664/.minikube/files for local assets ...
I0222 21:15:34.564968 20193 filesync.go:149] local asset: /Users/jenkins/minikube-integration/15909-2664/.minikube/files/etc/ssl/certs/31332.pem -> 31332.pem in /etc/ssl/certs
I0222 21:15:34.565168 20193 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0222 21:15:34.572460 20193 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2664/.minikube/files/etc/ssl/certs/31332.pem --> /etc/ssl/certs/31332.pem (1708 bytes)
I0222 21:15:34.589836 20193 start.go:303] post-start completed in 189.015892ms
I0222 21:15:34.590352 20193 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-865000
I0222 21:15:34.650618 20193 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/config.json ...
I0222 21:15:34.651047 20193 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0222 21:15:34.651105 20193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-865000
I0222 21:15:34.708783 20193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54450 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2664/.minikube/machines/old-k8s-version-865000/id_rsa Username:docker}
I0222 21:15:34.800351 20193 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0222 21:15:34.804883 20193 start.go:128] duration metric: createHost completed in 10.722561881s
I0222 21:15:34.804901 20193 start.go:83] releasing machines lock for "old-k8s-version-865000", held for 10.722690846s
I0222 21:15:34.804991 20193 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-865000
I0222 21:15:34.862206 20193 ssh_runner.go:195] Run: cat /version.json
I0222 21:15:34.862211 20193 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
I0222 21:15:34.862273 20193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-865000
I0222 21:15:34.862296 20193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-865000
I0222 21:15:34.934310 20193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54450 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2664/.minikube/machines/old-k8s-version-865000/id_rsa Username:docker}
I0222 21:15:34.934344 20193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54450 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2664/.minikube/machines/old-k8s-version-865000/id_rsa Username:docker}
I0222 21:15:35.244619 20193 ssh_runner.go:195] Run: systemctl --version
I0222 21:15:35.249795 20193 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0222 21:15:35.254706 20193 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0222 21:15:35.274734 20193 cni.go:229] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0222 21:15:35.274805 20193 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
I0222 21:15:35.288626 20193 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
I0222 21:15:35.296495 20193 cni.go:307] configured [/etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0222 21:15:35.296510 20193 start.go:485] detecting cgroup driver to use...
I0222 21:15:35.296521 20193 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0222 21:15:35.296608 20193 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
image-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0222 21:15:35.310038 20193 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "k8s.gcr.io/pause:3.1"|' /etc/containerd/config.toml"
I0222 21:15:35.318868 20193 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0222 21:15:35.327739 20193 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
I0222 21:15:35.327805 20193 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0222 21:15:35.336443 20193 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0222 21:15:35.344906 20193 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0222 21:15:35.353336 20193 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0222 21:15:35.362047 20193 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0222 21:15:35.370058 20193 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0222 21:15:35.378815 20193 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0222 21:15:35.386076 20193 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0222 21:15:35.393426 20193 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0222 21:15:35.464225 20193 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0222 21:15:35.537200 20193 start.go:485] detecting cgroup driver to use...
I0222 21:15:35.537220 20193 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0222 21:15:35.537295 20193 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0222 21:15:35.550232 20193 cruntime.go:273] skipping containerd shutdown because we are bound to it
I0222 21:15:35.550318 20193 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0222 21:15:35.562695 20193 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
image-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0222 21:15:35.577770 20193 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0222 21:15:35.676492 20193 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0222 21:15:35.762008 20193 docker.go:529] configuring docker to use "cgroupfs" as cgroup driver...
I0222 21:15:35.762035 20193 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)
I0222 21:15:35.776760 20193 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0222 21:15:35.864235 20193 ssh_runner.go:195] Run: sudo systemctl restart docker
I0222 21:15:36.100794 20193 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0222 21:15:36.128196 20193 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0222 21:15:36.198973 20193 out.go:204] * Preparing Kubernetes v1.16.0 on Docker 23.0.1 ...
I0222 21:15:36.199181 20193 cli_runner.go:164] Run: docker exec -t old-k8s-version-865000 dig +short host.docker.internal
I0222 21:15:36.325936 20193 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2
I0222 21:15:36.326055 20193 ssh_runner.go:195] Run: grep 192.168.65.2 host.minikube.internal$ /etc/hosts
I0222 21:15:36.330806 20193 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0222 21:15:36.342404 20193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-865000
I0222 21:15:36.406212 20193 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0222 21:15:36.406293 20193 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0222 21:15:36.429529 20193 docker.go:630] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0222 21:15:36.429548 20193 docker.go:560] Images already preloaded, skipping extraction
I0222 21:15:36.429649 20193 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0222 21:15:36.455191 20193 docker.go:630] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0222 21:15:36.455207 20193 cache_images.go:84] Images are preloaded, skipping loading
I0222 21:15:36.455309 20193 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0222 21:15:36.483834 20193 cni.go:84] Creating CNI manager for ""
I0222 21:15:36.483858 20193 cni.go:161] CNI unnecessary in this configuration, recommending no CNI
I0222 21:15:36.483880 20193 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0222 21:15:36.483905 20193 kubeadm.go:172] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-865000 NodeName:old-k8s-version-865000 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticP
odPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m]}
I0222 21:15:36.484031 20193 kubeadm.go:177] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-865000"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-865000
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.76.2:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0222 21:15:36.484134 20193 kubeadm.go:968] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-865000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-865000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0222 21:15:36.484215 20193 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0222 21:15:36.492769 20193 binaries.go:44] Found k8s binaries, skipping transfer
I0222 21:15:36.492836 20193 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0222 21:15:36.500718 20193 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (348 bytes)
I0222 21:15:36.513692 20193 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0222 21:15:36.527206 20193 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2174 bytes)
I0222 21:15:36.540520 20193 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0222 21:15:36.544624 20193 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0222 21:15:36.555078 20193 certs.go:56] Setting up /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000 for IP: 192.168.76.2
I0222 21:15:36.555096 20193 certs.go:186] acquiring lock for shared ca certs: {Name:mkb249024925691007345c8175e91f91eb2c1055 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0222 21:15:36.555285 20193 certs.go:195] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/15909-2664/.minikube/ca.key
I0222 21:15:36.555368 20193 certs.go:195] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/15909-2664/.minikube/proxy-client-ca.key
I0222 21:15:36.555414 20193 certs.go:315] generating minikube-user signed cert: /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/client.key
I0222 21:15:36.555427 20193 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/client.crt with IP's: []
I0222 21:15:36.766134 20193 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/client.crt ...
I0222 21:15:36.766152 20193 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/client.crt: {Name:mk66d23f21b13aaf2b17a214c7c2b148dd21f5bd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0222 21:15:36.766448 20193 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/client.key ...
I0222 21:15:36.766455 20193 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/client.key: {Name:mk0d47468cb8091d4284b6a5e277185a5cd67f98 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0222 21:15:36.766664 20193 certs.go:315] generating minikube signed cert: /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/apiserver.key.31bdca25
I0222 21:15:36.766679 20193 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/apiserver.crt.31bdca25 with IP's: [192.168.76.2 10.96.0.1 127.0.0.1 10.0.0.1]
I0222 21:15:36.870267 20193 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/apiserver.crt.31bdca25 ...
I0222 21:15:36.870283 20193 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/apiserver.crt.31bdca25: {Name:mk2706b5d0d00acf72ca6bc56e0d049cd81bf06a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0222 21:15:36.870578 20193 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/apiserver.key.31bdca25 ...
I0222 21:15:36.870586 20193 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/apiserver.key.31bdca25: {Name:mkcf5c95768f5b3695211128e6846a0c0c82f3ee Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0222 21:15:36.870765 20193 certs.go:333] copying /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/apiserver.crt.31bdca25 -> /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/apiserver.crt
I0222 21:15:36.870934 20193 certs.go:337] copying /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/apiserver.key.31bdca25 -> /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/apiserver.key
I0222 21:15:36.871108 20193 certs.go:315] generating aggregator signed cert: /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/proxy-client.key
I0222 21:15:36.871122 20193 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/proxy-client.crt with IP's: []
I0222 21:15:36.994966 20193 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/proxy-client.crt ...
I0222 21:15:36.994989 20193 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/proxy-client.crt: {Name:mkc6e16149a6bc147edd8ef6233ab7b33f706c25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0222 21:15:36.995280 20193 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/proxy-client.key ...
I0222 21:15:36.995291 20193 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/proxy-client.key: {Name:mkc6f260b2ad104efb3c36d9964176f6124e8cbb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0222 21:15:36.995710 20193 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2664/.minikube/certs/Users/jenkins/minikube-integration/15909-2664/.minikube/certs/3133.pem (1338 bytes)
W0222 21:15:36.995762 20193 certs.go:397] ignoring /Users/jenkins/minikube-integration/15909-2664/.minikube/certs/Users/jenkins/minikube-integration/15909-2664/.minikube/certs/3133_empty.pem, impossibly tiny 0 bytes
I0222 21:15:36.995774 20193 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2664/.minikube/certs/Users/jenkins/minikube-integration/15909-2664/.minikube/certs/ca-key.pem (1675 bytes)
I0222 21:15:36.995831 20193 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2664/.minikube/certs/Users/jenkins/minikube-integration/15909-2664/.minikube/certs/ca.pem (1082 bytes)
I0222 21:15:36.995865 20193 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2664/.minikube/certs/Users/jenkins/minikube-integration/15909-2664/.minikube/certs/cert.pem (1123 bytes)
I0222 21:15:36.995896 20193 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2664/.minikube/certs/Users/jenkins/minikube-integration/15909-2664/.minikube/certs/key.pem (1675 bytes)
I0222 21:15:36.995968 20193 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2664/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/15909-2664/.minikube/files/etc/ssl/certs/31332.pem (1708 bytes)
I0222 21:15:36.996480 20193 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0222 21:15:37.015172 20193 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0222 21:15:37.032766 20193 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0222 21:15:37.051037 20193 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2664/.minikube/profiles/old-k8s-version-865000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0222 21:15:37.068532 20193 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2664/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0222 21:15:37.086953 20193 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2664/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0222 21:15:37.104439 20193 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2664/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0222 21:15:37.121800 20193 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2664/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0222 21:15:37.139810 20193 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2664/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0222 21:15:37.157607 20193 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2664/.minikube/certs/3133.pem --> /usr/share/ca-certificates/3133.pem (1338 bytes)
I0222 21:15:37.175202 20193 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2664/.minikube/files/etc/ssl/certs/31332.pem --> /usr/share/ca-certificates/31332.pem (1708 bytes)
I0222 21:15:37.197376 20193 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0222 21:15:37.217841 20193 ssh_runner.go:195] Run: openssl version
I0222 21:15:37.223860 20193 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0222 21:15:37.232336 20193 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0222 21:15:37.237636 20193 certs.go:444] hashing: -rw-r--r-- 1 root root 1111 Feb 23 04:22 /usr/share/ca-certificates/minikubeCA.pem
I0222 21:15:37.237707 20193 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0222 21:15:37.243745 20193 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0222 21:15:37.253221 20193 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3133.pem && ln -fs /usr/share/ca-certificates/3133.pem /etc/ssl/certs/3133.pem"
I0222 21:15:37.263422 20193 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3133.pem
I0222 21:15:37.267618 20193 certs.go:444] hashing: -rw-r--r-- 1 root root 1338 Feb 23 04:27 /usr/share/ca-certificates/3133.pem
I0222 21:15:37.267691 20193 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3133.pem
I0222 21:15:37.273235 20193 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/3133.pem /etc/ssl/certs/51391683.0"
I0222 21:15:37.282250 20193 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/31332.pem && ln -fs /usr/share/ca-certificates/31332.pem /etc/ssl/certs/31332.pem"
I0222 21:15:37.294572 20193 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/31332.pem
I0222 21:15:37.301189 20193 certs.go:444] hashing: -rw-r--r-- 1 root root 1708 Feb 23 04:27 /usr/share/ca-certificates/31332.pem
I0222 21:15:37.301281 20193 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/31332.pem
I0222 21:15:37.309019 20193 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/31332.pem /etc/ssl/certs/3ec20f2e.0"
I0222 21:15:37.318099 20193 kubeadm.go:401] StartCluster: {Name:old-k8s-version-865000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.37-1676506612-15768@sha256:cc1cb283879fedae93096946a6953a50075ed680d467a47cbf669e0ed7d3aebc Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-865000 Namespace:default APIServerName:minikubeCA APISer
verNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disab
leMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP:}
I0222 21:15:37.318212 20193 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0222 21:15:37.337550 20193 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0222 21:15:37.346051 20193 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0222 21:15:37.353985 20193 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
I0222 21:15:37.354038 20193 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0222 21:15:37.361743 20193 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0222 21:15:37.361770 20193 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0222 21:15:37.414724 20193 kubeadm.go:322] [init] Using Kubernetes version: v1.16.0
I0222 21:15:37.414788 20193 kubeadm.go:322] [preflight] Running pre-flight checks
I0222 21:15:37.589937 20193 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0222 21:15:37.590082 20193 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0222 21:15:37.590157 20193 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0222 21:15:37.760083 20193 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0222 21:15:37.760186 20193 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0222 21:15:37.768405 20193 kubeadm.go:322] [kubelet-start] Activating the kubelet service
I0222 21:15:37.838795 20193 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0222 21:15:37.858499 20193 out.go:204] - Generating certificates and keys ...
I0222 21:15:37.858636 20193 kubeadm.go:322] [certs] Using existing ca certificate authority
I0222 21:15:37.858749 20193 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0222 21:15:38.353342 20193 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
I0222 21:15:38.450899 20193 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
I0222 21:15:38.645331 20193 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
I0222 21:15:38.989232 20193 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
I0222 21:15:39.069801 20193 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
I0222 21:15:39.070237 20193 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [old-k8s-version-865000 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I0222 21:15:39.211743 20193 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
I0222 21:15:39.238275 20193 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-865000 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I0222 21:15:39.400846 20193 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
I0222 21:15:39.603025 20193 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
I0222 21:15:39.725878 20193 kubeadm.go:322] [certs] Generating "sa" key and public key
I0222 21:15:39.725945 20193 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0222 21:15:39.903063 20193 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0222 21:15:39.990179 20193 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0222 21:15:40.113714 20193 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0222 21:15:40.226142 20193 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0222 21:15:40.226737 20193 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0222 21:15:40.251245 20193 out.go:204] - Booting up control plane ...
I0222 21:15:40.251470 20193 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0222 21:15:40.251616 20193 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0222 21:15:40.251714 20193 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0222 21:15:40.251809 20193 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0222 21:15:40.251997 20193 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0222 21:16:20.235047 20193 kubeadm.go:322] [kubelet-check] Initial timeout of 40s passed.
I0222 21:16:20.235592 20193 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0222 21:16:20.235792 20193 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0222 21:16:25.236468 20193 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0222 21:16:25.236610 20193 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0222 21:16:35.237827 20193 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0222 21:16:35.238104 20193 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0222 21:16:55.239387 20193 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0222 21:16:55.239629 20193 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0222 21:17:35.240663 20193 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0222 21:17:35.240878 20193 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0222 21:17:35.240893 20193 kubeadm.go:322]
I0222 21:17:35.240931 20193 kubeadm.go:322] Unfortunately, an error has occurred:
I0222 21:17:35.240972 20193 kubeadm.go:322] timed out waiting for the condition
I0222 21:17:35.240981 20193 kubeadm.go:322]
I0222 21:17:35.241036 20193 kubeadm.go:322] This error is likely caused by:
I0222 21:17:35.241093 20193 kubeadm.go:322] - The kubelet is not running
I0222 21:17:35.241242 20193 kubeadm.go:322] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0222 21:17:35.241256 20193 kubeadm.go:322]
I0222 21:17:35.241388 20193 kubeadm.go:322] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0222 21:17:35.241424 20193 kubeadm.go:322] - 'systemctl status kubelet'
I0222 21:17:35.241456 20193 kubeadm.go:322] - 'journalctl -xeu kubelet'
I0222 21:17:35.241464 20193 kubeadm.go:322]
I0222 21:17:35.241595 20193 kubeadm.go:322] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0222 21:17:35.241695 20193 kubeadm.go:322] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I0222 21:17:35.241802 20193 kubeadm.go:322] Here is one example how you may list all Kubernetes containers running in docker:
I0222 21:17:35.241855 20193 kubeadm.go:322] - 'docker ps -a | grep kube | grep -v pause'
I0222 21:17:35.241946 20193 kubeadm.go:322] Once you have found the failing container, you can inspect its logs with:
I0222 21:17:35.241992 20193 kubeadm.go:322] - 'docker logs CONTAINERID'
I0222 21:17:35.244707 20193 kubeadm.go:322] [WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
I0222 21:17:35.244787 20193 kubeadm.go:322] [WARNING Swap]: running with swap on is not supported. Please disable swap
I0222 21:17:35.244884 20193 kubeadm.go:322] [WARNING SystemVerification]: this Docker version is not on the list of validated versions: 23.0.1. Latest validated version: 18.09
I0222 21:17:35.244975 20193 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0222 21:17:35.245040 20193 kubeadm.go:322] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0222 21:17:35.245107 20193 kubeadm.go:322] To see the stack trace of this error execute with --v=5 or higher
W0222 21:17:35.245293 20193 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-865000 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-865000 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 23.0.1. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-865000 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-865000 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 23.0.1. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0222 21:17:35.245324 20193 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"
I0222 21:17:35.656575 20193 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0222 21:17:35.666448 20193 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
I0222 21:17:35.666511 20193 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0222 21:17:35.674161 20193 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0222 21:17:35.674183 20193 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0222 21:17:35.721182 20193 kubeadm.go:322] [init] Using Kubernetes version: v1.16.0
I0222 21:17:35.721232 20193 kubeadm.go:322] [preflight] Running pre-flight checks
I0222 21:17:35.887406 20193 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0222 21:17:35.887494 20193 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0222 21:17:35.887562 20193 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0222 21:17:36.043376 20193 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0222 21:17:36.044020 20193 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0222 21:17:36.050600 20193 kubeadm.go:322] [kubelet-start] Activating the kubelet service
I0222 21:17:36.111918 20193 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0222 21:17:36.154305 20193 out.go:204] - Generating certificates and keys ...
I0222 21:17:36.154408 20193 kubeadm.go:322] [certs] Using existing ca certificate authority
I0222 21:17:36.154480 20193 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0222 21:17:36.154535 20193 kubeadm.go:322] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0222 21:17:36.154582 20193 kubeadm.go:322] [certs] Using existing front-proxy-ca certificate authority
I0222 21:17:36.154646 20193 kubeadm.go:322] [certs] Using existing front-proxy-client certificate and key on disk
I0222 21:17:36.154698 20193 kubeadm.go:322] [certs] Using existing etcd/ca certificate authority
I0222 21:17:36.154776 20193 kubeadm.go:322] [certs] Using existing etcd/server certificate and key on disk
I0222 21:17:36.154831 20193 kubeadm.go:322] [certs] Using existing etcd/peer certificate and key on disk
I0222 21:17:36.154924 20193 kubeadm.go:322] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0222 21:17:36.154997 20193 kubeadm.go:322] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0222 21:17:36.155031 20193 kubeadm.go:322] [certs] Using the existing "sa" key
I0222 21:17:36.155095 20193 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0222 21:17:36.201275 20193 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0222 21:17:36.326654 20193 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0222 21:17:36.380596 20193 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0222 21:17:36.449360 20193 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0222 21:17:36.450154 20193 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0222 21:17:36.471914 20193 out.go:204] - Booting up control plane ...
I0222 21:17:36.472074 20193 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0222 21:17:36.472272 20193 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0222 21:17:36.472409 20193 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0222 21:17:36.472571 20193 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0222 21:17:36.472842 20193 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0222 21:18:16.459206 20193 kubeadm.go:322] [kubelet-check] Initial timeout of 40s passed.
I0222 21:18:16.459570 20193 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0222 21:18:16.459749 20193 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0222 21:18:21.461453 20193 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0222 21:18:21.461661 20193 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0222 21:18:31.462567 20193 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0222 21:18:31.462789 20193 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0222 21:18:51.463987 20193 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0222 21:18:51.464199 20193 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0222 21:19:31.464054 20193 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0222 21:19:31.464211 20193 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0222 21:19:31.464222 20193 kubeadm.go:322]
I0222 21:19:31.464254 20193 kubeadm.go:322] Unfortunately, an error has occurred:
I0222 21:19:31.464293 20193 kubeadm.go:322] timed out waiting for the condition
I0222 21:19:31.464298 20193 kubeadm.go:322]
I0222 21:19:31.464338 20193 kubeadm.go:322] This error is likely caused by:
I0222 21:19:31.464370 20193 kubeadm.go:322] - The kubelet is not running
I0222 21:19:31.464460 20193 kubeadm.go:322] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0222 21:19:31.464475 20193 kubeadm.go:322]
I0222 21:19:31.464570 20193 kubeadm.go:322] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0222 21:19:31.464594 20193 kubeadm.go:322] - 'systemctl status kubelet'
I0222 21:19:31.464617 20193 kubeadm.go:322] - 'journalctl -xeu kubelet'
I0222 21:19:31.464621 20193 kubeadm.go:322]
I0222 21:19:31.464690 20193 kubeadm.go:322] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0222 21:19:31.464768 20193 kubeadm.go:322] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I0222 21:19:31.464833 20193 kubeadm.go:322] Here is one example how you may list all Kubernetes containers running in docker:
I0222 21:19:31.464873 20193 kubeadm.go:322] - 'docker ps -a | grep kube | grep -v pause'
I0222 21:19:31.464941 20193 kubeadm.go:322] Once you have found the failing container, you can inspect its logs with:
I0222 21:19:31.464974 20193 kubeadm.go:322] - 'docker logs CONTAINERID'
I0222 21:19:31.467750 20193 kubeadm.go:322] [WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
I0222 21:19:31.467809 20193 kubeadm.go:322] [WARNING Swap]: running with swap on is not supported. Please disable swap
I0222 21:19:31.467919 20193 kubeadm.go:322] [WARNING SystemVerification]: this Docker version is not on the list of validated versions: 23.0.1. Latest validated version: 18.09
I0222 21:19:31.468014 20193 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0222 21:19:31.468096 20193 kubeadm.go:322] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0222 21:19:31.468152 20193 kubeadm.go:322] To see the stack trace of this error execute with --v=5 or higher
I0222 21:19:31.468177 20193 kubeadm.go:403] StartCluster complete in 3m54.153160044s
I0222 21:19:31.468272 20193 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0222 21:19:31.488197 20193 logs.go:278] 0 containers: []
W0222 21:19:31.488210 20193 logs.go:280] No container was found matching "kube-apiserver"
I0222 21:19:31.488282 20193 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0222 21:19:31.508265 20193 logs.go:278] 0 containers: []
W0222 21:19:31.508278 20193 logs.go:280] No container was found matching "etcd"
I0222 21:19:31.508353 20193 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0222 21:19:31.527185 20193 logs.go:278] 0 containers: []
W0222 21:19:31.527197 20193 logs.go:280] No container was found matching "coredns"
I0222 21:19:31.527272 20193 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0222 21:19:31.546608 20193 logs.go:278] 0 containers: []
W0222 21:19:31.546621 20193 logs.go:280] No container was found matching "kube-scheduler"
I0222 21:19:31.546686 20193 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0222 21:19:31.565326 20193 logs.go:278] 0 containers: []
W0222 21:19:31.565339 20193 logs.go:280] No container was found matching "kube-proxy"
I0222 21:19:31.565407 20193 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0222 21:19:31.584803 20193 logs.go:278] 0 containers: []
W0222 21:19:31.584816 20193 logs.go:280] No container was found matching "kube-controller-manager"
I0222 21:19:31.584884 20193 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0222 21:19:31.603671 20193 logs.go:278] 0 containers: []
W0222 21:19:31.603684 20193 logs.go:280] No container was found matching "kindnet"
I0222 21:19:31.603750 20193 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0222 21:19:31.623704 20193 logs.go:278] 0 containers: []
W0222 21:19:31.623718 20193 logs.go:280] No container was found matching "storage-provisioner"
I0222 21:19:31.623726 20193 logs.go:124] Gathering logs for dmesg ...
I0222 21:19:31.623733 20193 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0222 21:19:31.635990 20193 logs.go:124] Gathering logs for describe nodes ...
I0222 21:19:31.636003 20193 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0222 21:19:31.691327 20193 logs.go:131] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0222 21:19:31.691339 20193 logs.go:124] Gathering logs for Docker ...
I0222 21:19:31.691346 20193 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400"
I0222 21:19:31.716520 20193 logs.go:124] Gathering logs for container status ...
I0222 21:19:31.716535 20193 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0222 21:19:33.762783 20193 ssh_runner.go:235] Completed: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": (2.046263442s)
I0222 21:19:33.762892 20193 logs.go:124] Gathering logs for kubelet ...
I0222 21:19:33.762899 20193 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0222 21:19:33.799731 20193 out.go:369] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 23.0.1. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0222 21:19:33.799750 20193 out.go:239] *
*
W0222 21:19:33.799864 20193 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 23.0.1. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 23.0.1. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0222 21:19:33.799876 20193 out.go:239] *
*
W0222 21:19:33.800676 20193 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0222 21:19:33.864057 20193 out.go:177]
W0222 21:19:33.906277 20193 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 23.0.1. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 23.0.1. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0222 21:19:33.906338 20193 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0222 21:19:33.906377 20193 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0222 21:19:33.948226 20193 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p old-k8s-version-865000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-865000
helpers_test.go:235: (dbg) docker inspect old-k8s-version-865000:
-- stdout --
[
{
"Id": "106a8b1953836258f3265e97e2547029eeec326da49bfa086827f0a086a7096c",
"Created": "2023-02-23T05:15:31.417090555Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 272975,
"ExitCode": 0,
"Error": "",
"StartedAt": "2023-02-23T05:15:31.720510028Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:b74f629d1852fc20b6085123d98944654faddf1d7e642b41aa2866d7a48081ea",
"ResolvConfPath": "/var/lib/docker/containers/106a8b1953836258f3265e97e2547029eeec326da49bfa086827f0a086a7096c/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/106a8b1953836258f3265e97e2547029eeec326da49bfa086827f0a086a7096c/hostname",
"HostsPath": "/var/lib/docker/containers/106a8b1953836258f3265e97e2547029eeec326da49bfa086827f0a086a7096c/hosts",
"LogPath": "/var/lib/docker/containers/106a8b1953836258f3265e97e2547029eeec326da49bfa086827f0a086a7096c/106a8b1953836258f3265e97e2547029eeec326da49bfa086827f0a086a7096c-json.log",
"Name": "/old-k8s-version-865000",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-865000:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-865000",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"ConsoleSize": [
0,
0
],
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": null,
"BlkioDeviceWriteBps": null,
"BlkioDeviceReadIOps": null,
"BlkioDeviceWriteIOps": null,
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"KernelMemory": 0,
"KernelMemoryTCP": 0,
"MemoryReservation": 0,
"MemorySwap": 2306867200,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": null,
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/a658bced79351bc8f8d55536fa19a842f3cb91ab79c29dce7c641a4b21b2aa93-init/diff:/var/lib/docker/overlay2/d735a905256a842f090e2c879afc9d92376c839b4676aab2d392ae501e606232/diff:/var/lib/docker/overlay2/d1f2f3f6ac23ac49767fdc30d9c98225ca88bf64cd567e0d86d56a9233fd763d/diff:/var/lib/docker/overlay2/f0fa698605bd05ca65a330d4275608edcd970cd76859d3cb8354bb4254d0f08b/diff:/var/lib/docker/overlay2/63febb00ae34d33919004ab9942589dece0f8c645f1d216ccb4299944904202d/diff:/var/lib/docker/overlay2/c3b69572a9377c568e6ba6262a57fed7babe20b40ee8de365575e7f5edb8a33c/diff:/var/lib/docker/overlay2/94ef868439834d58280ec26aeb7d1549bc4f2eed9a9b7a214aaadfe9801d8638/diff:/var/lib/docker/overlay2/b13946ad442fea4a8d40bdbfe4c5d25c00fd8943577be95102c710f9a16278f3/diff:/var/lib/docker/overlay2/e9393d1f48ae5ce65f214ef58518cffd0dcae338efd05a200bc2a9c4952a7e11/diff:/var/lib/docker/overlay2/ee489b944eee182f771ca641762318eca8c44e5315622e5003d7215a77926c43/diff:/var/lib/docker/overlay2/7fc06d
6bf7ccc4b1c6af5a9aef949eb7c79e7f19568861f2b3d145ecf82f892c/diff:/var/lib/docker/overlay2/6551f474d7a059dd528cd8a102d8d3daf9f787cd3867d4cf0a8ecbe3137845f7/diff:/var/lib/docker/overlay2/16cb6b8eb7f92e97399c2b93c8436919e1224e15bf1a6c93349763abd15dd3d0/diff:/var/lib/docker/overlay2/aec62818fca9efa0d3d657164ce0265a5b62d0895cbf6df521724fe91cec3edb/diff:/var/lib/docker/overlay2/3f69fa56b42132fa5af6a30509a1490ac967ab0bb13b085d9e02158a27a1d86c/diff:/var/lib/docker/overlay2/8d1cebecde0fae7654d090a1091c9b2390b0b7c9d82e6273c294842aab59de34/diff:/var/lib/docker/overlay2/158a459a2e1f3458d0019dd0b14b04015255b1ed87f965306282f7b3e70a38fc/diff:/var/lib/docker/overlay2/a56ff1809b9696eaecf1befd98d45d0991a44a736550ac02d8d6118644da603d/diff:/var/lib/docker/overlay2/8c96c8d23c323c83538e80ac561282484d79fe84e63ad053ae788e86f87c1ef4/diff:/var/lib/docker/overlay2/ec09433094ead97c6aaea064f2f1e48b8307ae5816c5d97df91cb7bd05fec68f/diff:/var/lib/docker/overlay2/cd9fc5eaeb18492d8b784c4c8fc92a8fa34551a0910b052700985d2a9380a4dd/diff:/var/lib/d
ocker/overlay2/04b42e69265100106da7547a97dd3662e94986998055ab81e820f8db49dc2971/diff:/var/lib/docker/overlay2/5db9f3630a76a8469b949dd07eb98cfc6237154c800f8f3aca8ccaf39f05448f/diff:/var/lib/docker/overlay2/2d16c0b3e1ed51f470f9c35de90354910962c318d531641b26e7bb615367d319/diff:/var/lib/docker/overlay2/8901b538fcccec8e0f6b3fd323c372021b9ec98d0d87e32302bcd1081f43379a/diff:/var/lib/docker/overlay2/da09afbc05fd27e3beb8c85c2097a8c2472689b52ee4998b494df79026a685bd/diff:/var/lib/docker/overlay2/8588968b29feb5e06cc9a0c784934eceb4ac9ba4e418b6137a1dd4d21c1caaa2/diff:/var/lib/docker/overlay2/7f2af1b3ff78cc5bbc7bba935d67e913a5f9e678f66467e4d29ebbba94ada290/diff:/var/lib/docker/overlay2/3705f200b0512d179b1d47648fe9de6303de6edb16366b71147debcd908852cc/diff:/var/lib/docker/overlay2/a65b125a93208a4dd9c0c32ba885c17b95d8ca095b1e3663e47ef3d40eb46c4a/diff:/var/lib/docker/overlay2/699456f0b88dd59d3c858cb5b72c591e6c9548ad5424c399cde92ac6fbb62c1f/diff:/var/lib/docker/overlay2/d68cc821b6f53d22b3e4278c433e3253b61e11e323942f292495520f5c1
56d09/diff:/var/lib/docker/overlay2/1160486e9945f24f96fc29bdbc90043530e8a836438e8ac2f15584c126e7becf/diff:/var/lib/docker/overlay2/ade2a355e817a502244b9949538fab6a121e5470090805f56cedcc1d326eaa50/diff:/var/lib/docker/overlay2/b9610e93be96ad7fa3449bc85812a48b31f473d4f9665177b09344c0da63676a/diff:/var/lib/docker/overlay2/a84b42adc3239ead9ad6efb1b79d87c7a425b9c699f8a19c79624219e4993a4d/diff:/var/lib/docker/overlay2/e95299454110b8c49ed959b2de345e2030d1ab766008f754b0f765e1dfdd2d83/diff:/var/lib/docker/overlay2/4ae785a0642ee329a8c37b6b14982d4cf62c236dfc1924baaf06121c717bc7d7/diff:/var/lib/docker/overlay2/d622f6e4652a4f47b54d0c94fc2f898039074d50181b1c295c171f465f6df163/diff:/var/lib/docker/overlay2/250d59aa3acb4cfd98726e26ac853da8694439cd310db826ac7202b81c1db23a/diff:/var/lib/docker/overlay2/92d316e8010485b8001e0b4afb059d38754579ceef0552bb4e8d9185fd1bff67/diff:/var/lib/docker/overlay2/e1e3f48218f59ff3e5116128a23b26c974f5c70a446819c352249cb546476eb2/diff:/var/lib/docker/overlay2/77a9ef264190dd4d87402d2c9ac7cb20d76097
ff77087beff536b2cd4b965b31/diff",
"MergedDir": "/var/lib/docker/overlay2/a658bced79351bc8f8d55536fa19a842f3cb91ab79c29dce7c641a4b21b2aa93/merged",
"UpperDir": "/var/lib/docker/overlay2/a658bced79351bc8f8d55536fa19a842f3cb91ab79c29dce7c641a4b21b2aa93/diff",
"WorkDir": "/var/lib/docker/overlay2/a658bced79351bc8f8d55536fa19a842f3cb91ab79c29dce7c641a4b21b2aa93/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-865000",
"Source": "/var/lib/docker/volumes/old-k8s-version-865000/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-865000",
"Domainname": "",
"User": "root",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.37-1676506612-15768@sha256:cc1cb283879fedae93096946a6953a50075ed680d467a47cbf669e0ed7d3aebc",
"Volumes": null,
"WorkingDir": "",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-865000",
"name.minikube.sigs.k8s.io": "old-k8s-version-865000",
"org.opencontainers.image.ref.name": "ubuntu",
"org.opencontainers.image.version": "20.04",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "846d4edb0dc70a09bd7bcf368401555188a079858000e0bc8c50de2b0547be2c",
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "54450"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "54451"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "54452"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "54453"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "54454"
}
]
},
"SandboxKey": "/var/run/docker/netns/846d4edb0dc7",
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-865000": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": [
"106a8b195383",
"old-k8s-version-865000"
],
"NetworkID": "947893b68cb410e9e5982aa5b8afeae1844c1ff30155168ea70efca5bffdb638",
"EndpointID": "33790e86f4bb325b05c03827ee43602ee09867aed1cb461cd243797f092d3a80",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"MacAddress": "02:42:c0:a8:4c:02",
"DriverOpts": null
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-865000 -n old-k8s-version-865000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-865000 -n old-k8s-version-865000: exit status 6 (414.055276ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0222 21:19:34.512263 21353 status.go:415] kubeconfig endpoint: extract IP: "old-k8s-version-865000" does not appear in /Users/jenkins/minikube-integration/15909-2664/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-865000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (251.77s)