=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-darwin-amd64 start -p old-k8s-version-720000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0
E0127 20:24:13.109021 4406 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/calico-259000/client.crt: no such file or directory
=== CONT TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-720000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0: exit status 109 (4m13.343695135s)
-- stdout --
* [old-k8s-version-720000] minikube v1.28.0 on Darwin 13.2
- MINIKUBE_LOCATION=15565
- KUBECONFIG=/Users/jenkins/minikube-integration/15565-3092/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/15565-3092/.minikube
- MINIKUBE_FORCE_SYSTEMD=
* Using the docker driver based on user configuration
* Using Docker Desktop driver with root privileges
* Starting control plane node old-k8s-version-720000 in cluster old-k8s-version-720000
* Pulling base image ...
* Creating docker container (CPUs=2, Memory=2200MB) ...
* Preparing Kubernetes v1.16.0 on Docker 20.10.22 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0127 20:23:49.162742 21770 out.go:296] Setting OutFile to fd 1 ...
I0127 20:23:49.162906 21770 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0127 20:23:49.162912 21770 out.go:309] Setting ErrFile to fd 2...
I0127 20:23:49.162916 21770 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0127 20:23:49.163049 21770 root.go:334] Updating PATH: /Users/jenkins/minikube-integration/15565-3092/.minikube/bin
I0127 20:23:49.163595 21770 out.go:303] Setting JSON to false
I0127 20:23:49.185480 21770 start.go:125] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":5003,"bootTime":1674874826,"procs":437,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.2","kernelVersion":"22.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
W0127 20:23:49.185625 21770 start.go:133] gopshost.Virtualization returned error: not implemented yet
I0127 20:23:49.208173 21770 out.go:177] * [old-k8s-version-720000] minikube v1.28.0 on Darwin 13.2
I0127 20:23:49.250030 21770 notify.go:220] Checking for updates...
I0127 20:23:49.271684 21770 out.go:177] - MINIKUBE_LOCATION=15565
I0127 20:23:49.345922 21770 out.go:177] - KUBECONFIG=/Users/jenkins/minikube-integration/15565-3092/kubeconfig
I0127 20:23:49.420790 21770 out.go:177] - MINIKUBE_BIN=out/minikube-darwin-amd64
I0127 20:23:49.494877 21770 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0127 20:23:49.536673 21770 out.go:177] - MINIKUBE_HOME=/Users/jenkins/minikube-integration/15565-3092/.minikube
I0127 20:23:49.578497 21770 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0127 20:23:49.600142 21770 config.go:180] Loaded profile config "kubenet-259000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.26.1
I0127 20:23:49.600210 21770 driver.go:365] Setting default libvirt URI to qemu:///system
I0127 20:23:49.666290 21770 docker.go:141] docker version: linux-20.10.22:Docker Desktop 4.16.2 (95914)
I0127 20:23:49.666477 21770 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0127 20:23:49.822651 21770 info.go:266] docker info: {ID:XCAM:233U:IDBC:CZDL:7XI4:H6O5:GF2W:UEZ3:QAV3:CHAS:H4H5:PY7S Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:51 OomKillDisable:false NGoroutines:52 SystemTime:2023-01-28 04:23:49.722093601 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:5 KernelVersion:5.15.49-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6231715840 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.22 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:9ba4b250366a5ddde94bb7c9d1def331423aa323 Expected:9ba4b250366a5ddde94bb7c9d1def331423aa323} RuncCommit:{ID:v1.1.4-0-g5fd4c4d Expected:v1.1.4-0-g5fd4c4d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defaul
t name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.10.0] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.15.1] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.0.5] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.17] map[Name:sbom Path
:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scan] ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I0127 20:23:49.852622 21770 out.go:177] * Using the docker driver based on user configuration
I0127 20:23:49.862595 21770 start.go:296] selected driver: docker
I0127 20:23:49.862611 21770 start.go:840] validating driver "docker" against <nil>
I0127 20:23:49.862644 21770 start.go:851] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0127 20:23:49.865368 21770 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0127 20:23:50.037602 21770 info.go:266] docker info: {ID:XCAM:233U:IDBC:CZDL:7XI4:H6O5:GF2W:UEZ3:QAV3:CHAS:H4H5:PY7S Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:53 OomKillDisable:false NGoroutines:70 SystemTime:2023-01-28 04:23:49.922790337 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:5 KernelVersion:5.15.49-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6231715840 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.22 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:9ba4b250366a5ddde94bb7c9d1def331423aa323 Expected:9ba4b250366a5ddde94bb7c9d1def331423aa323} RuncCommit:{ID:v1.1.4-0-g5fd4c4d Expected:v1.1.4-0-g5fd4c4d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defaul
t name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.10.0] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.15.1] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.0.5] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.17] map[Name:sbom Path
:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scan] ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I0127 20:23:50.037711 21770 start_flags.go:305] no existing cluster config was found, will generate one from the flags
I0127 20:23:50.037866 21770 start_flags.go:917] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0127 20:23:50.076503 21770 out.go:177] * Using Docker Desktop driver with root privileges
I0127 20:23:50.098455 21770 cni.go:84] Creating CNI manager for ""
I0127 20:23:50.098494 21770 cni.go:161] CNI unnecessary in this configuration, recommending no CNI
I0127 20:23:50.098512 21770 start_flags.go:319] config:
{Name:old-k8s-version-720000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-720000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}
I0127 20:23:50.142312 21770 out.go:177] * Starting control plane node old-k8s-version-720000 in cluster old-k8s-version-720000
I0127 20:23:50.163367 21770 cache.go:120] Beginning downloading kic base image for docker with docker
I0127 20:23:50.185369 21770 out.go:177] * Pulling base image ...
I0127 20:23:50.227674 21770 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0127 20:23:50.227762 21770 image.go:77] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a in local docker daemon
I0127 20:23:50.227796 21770 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/15565-3092/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4
I0127 20:23:50.227830 21770 cache.go:57] Caching tarball of preloaded images
I0127 20:23:50.228021 21770 preload.go:174] Found /Users/jenkins/minikube-integration/15565-3092/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0127 20:23:50.228039 21770 cache.go:60] Finished verifying existence of preloaded tar for v1.16.0 on docker
I0127 20:23:50.228898 21770 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/config.json ...
I0127 20:23:50.229034 21770 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/config.json: {Name:mk2c595e87b88b1e259e12d7369d76203aa9366d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 20:23:50.289430 21770 image.go:81] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a in local docker daemon, skipping pull
I0127 20:23:50.289448 21770 cache.go:143] gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a exists in daemon, skipping load
I0127 20:23:50.289466 21770 cache.go:193] Successfully downloaded all kic artifacts
I0127 20:23:50.289579 21770 start.go:364] acquiring machines lock for old-k8s-version-720000: {Name:mk4c4e23ea55570fd8854da14e914c261c97da33 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0127 20:23:50.289731 21770 start.go:368] acquired machines lock for "old-k8s-version-720000" in 139.702µs
I0127 20:23:50.289762 21770 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-720000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-720000 Namespace:default APIServer
Name:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:f
alse DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0127 20:23:50.289846 21770 start.go:125] createHost starting for "" (driver="docker")
I0127 20:23:50.364488 21770 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0127 20:23:50.364897 21770 start.go:159] libmachine.API.Create for "old-k8s-version-720000" (driver="docker")
I0127 20:23:50.364953 21770 client.go:168] LocalClient.Create starting
I0127 20:23:50.365152 21770 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/15565-3092/.minikube/certs/ca.pem
I0127 20:23:50.365292 21770 main.go:141] libmachine: Decoding PEM data...
I0127 20:23:50.365331 21770 main.go:141] libmachine: Parsing certificate...
I0127 20:23:50.365480 21770 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/15565-3092/.minikube/certs/cert.pem
I0127 20:23:50.365561 21770 main.go:141] libmachine: Decoding PEM data...
I0127 20:23:50.365580 21770 main.go:141] libmachine: Parsing certificate...
I0127 20:23:50.366430 21770 cli_runner.go:164] Run: docker network inspect old-k8s-version-720000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0127 20:23:50.427403 21770 cli_runner.go:211] docker network inspect old-k8s-version-720000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0127 20:23:50.427510 21770 network_create.go:281] running [docker network inspect old-k8s-version-720000] to gather additional debugging logs...
I0127 20:23:50.427528 21770 cli_runner.go:164] Run: docker network inspect old-k8s-version-720000
W0127 20:23:50.488474 21770 cli_runner.go:211] docker network inspect old-k8s-version-720000 returned with exit code 1
I0127 20:23:50.488509 21770 network_create.go:284] error running [docker network inspect old-k8s-version-720000]: docker network inspect old-k8s-version-720000: exit status 1
stdout:
[]
stderr:
Error: No such network: old-k8s-version-720000
I0127 20:23:50.488524 21770 network_create.go:286] output of [docker network inspect old-k8s-version-720000]: -- stdout --
[]
-- /stdout --
** stderr **
Error: No such network: old-k8s-version-720000
** /stderr **
I0127 20:23:50.488607 21770 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0127 20:23:50.552814 21770 network.go:209] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0127 20:23:50.554295 21770 network.go:209] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0127 20:23:50.555850 21770 network.go:209] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0127 20:23:50.556143 21770 network.go:206] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0012439b0}
I0127 20:23:50.556155 21770 network_create.go:123] attempt to create docker network old-k8s-version-720000 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I0127 20:23:50.556226 21770 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-720000 old-k8s-version-720000
I0127 20:23:50.656461 21770 network_create.go:107] docker network old-k8s-version-720000 192.168.76.0/24 created
I0127 20:23:50.656500 21770 kic.go:117] calculated static IP "192.168.76.2" for the "old-k8s-version-720000" container
I0127 20:23:50.656625 21770 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0127 20:23:50.719599 21770 cli_runner.go:164] Run: docker volume create old-k8s-version-720000 --label name.minikube.sigs.k8s.io=old-k8s-version-720000 --label created_by.minikube.sigs.k8s.io=true
I0127 20:23:50.788912 21770 oci.go:103] Successfully created a docker volume old-k8s-version-720000
I0127 20:23:50.789073 21770 cli_runner.go:164] Run: docker run --rm --name old-k8s-version-720000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-720000 --entrypoint /usr/bin/test -v old-k8s-version-720000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a -d /var/lib
I0127 20:23:51.424053 21770 oci.go:107] Successfully prepared a docker volume old-k8s-version-720000
I0127 20:23:51.424089 21770 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0127 20:23:51.424105 21770 kic.go:190] Starting extracting preloaded images to volume ...
I0127 20:23:51.424217 21770 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/15565-3092/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-720000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a -I lz4 -xf /preloaded.tar -C /extractDir
I0127 20:23:59.244033 21770 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/15565-3092/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-720000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a -I lz4 -xf /preloaded.tar -C /extractDir: (7.819787135s)
I0127 20:23:59.244056 21770 kic.go:199] duration metric: took 7.819986 seconds to extract preloaded images to volume
I0127 20:23:59.244169 21770 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0127 20:23:59.400876 21770 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname old-k8s-version-720000 --name old-k8s-version-720000 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-720000 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=old-k8s-version-720000 --network old-k8s-version-720000 --ip 192.168.76.2 --volume old-k8s-version-720000:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a
I0127 20:23:59.791368 21770 cli_runner.go:164] Run: docker container inspect old-k8s-version-720000 --format={{.State.Running}}
I0127 20:23:59.865972 21770 cli_runner.go:164] Run: docker container inspect old-k8s-version-720000 --format={{.State.Status}}
I0127 20:23:59.948076 21770 cli_runner.go:164] Run: docker exec old-k8s-version-720000 stat /var/lib/dpkg/alternatives/iptables
I0127 20:24:00.081001 21770 oci.go:144] the created container "old-k8s-version-720000" has a running status.
I0127 20:24:00.081053 21770 kic.go:221] Creating ssh key for kic: /Users/jenkins/minikube-integration/15565-3092/.minikube/machines/old-k8s-version-720000/id_rsa...
I0127 20:24:00.228467 21770 kic_runner.go:191] docker (temp): /Users/jenkins/minikube-integration/15565-3092/.minikube/machines/old-k8s-version-720000/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0127 20:24:00.351029 21770 cli_runner.go:164] Run: docker container inspect old-k8s-version-720000 --format={{.State.Status}}
I0127 20:24:00.415544 21770 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0127 20:24:00.415566 21770 kic_runner.go:114] Args: [docker exec --privileged old-k8s-version-720000 chown docker:docker /home/docker/.ssh/authorized_keys]
I0127 20:24:00.527632 21770 cli_runner.go:164] Run: docker container inspect old-k8s-version-720000 --format={{.State.Status}}
I0127 20:24:00.591442 21770 machine.go:88] provisioning docker machine ...
I0127 20:24:00.591485 21770 ubuntu.go:169] provisioning hostname "old-k8s-version-720000"
I0127 20:24:00.591569 21770 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-720000
I0127 20:24:00.653908 21770 main.go:141] libmachine: Using SSH client type: native
I0127 20:24:00.654121 21770 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil> [] 0s} 127.0.0.1 55059 <nil> <nil>}
I0127 20:24:00.654139 21770 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-720000 && echo "old-k8s-version-720000" | sudo tee /etc/hostname
I0127 20:24:00.796898 21770 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-720000
I0127 20:24:00.796998 21770 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-720000
I0127 20:24:00.858348 21770 main.go:141] libmachine: Using SSH client type: native
I0127 20:24:00.858519 21770 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil> [] 0s} 127.0.0.1 55059 <nil> <nil>}
I0127 20:24:00.858533 21770 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-720000' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-720000/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-720000' | sudo tee -a /etc/hosts;
fi
fi
I0127 20:24:00.991192 21770 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0127 20:24:00.991223 21770 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/15565-3092/.minikube CaCertPath:/Users/jenkins/minikube-integration/15565-3092/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/15565-3092/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/15565-3092/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/15565-3092/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/15565-3092/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/15565-3092/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/15565-3092/.minikube}
I0127 20:24:00.991243 21770 ubuntu.go:177] setting up certificates
I0127 20:24:00.991256 21770 provision.go:83] configureAuth start
I0127 20:24:00.991344 21770 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-720000
I0127 20:24:01.054245 21770 provision.go:138] copyHostCerts
I0127 20:24:01.054352 21770 exec_runner.go:144] found /Users/jenkins/minikube-integration/15565-3092/.minikube/ca.pem, removing ...
I0127 20:24:01.054363 21770 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15565-3092/.minikube/ca.pem
I0127 20:24:01.054461 21770 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15565-3092/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/15565-3092/.minikube/ca.pem (1078 bytes)
I0127 20:24:01.054678 21770 exec_runner.go:144] found /Users/jenkins/minikube-integration/15565-3092/.minikube/cert.pem, removing ...
I0127 20:24:01.054685 21770 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15565-3092/.minikube/cert.pem
I0127 20:24:01.054746 21770 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15565-3092/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/15565-3092/.minikube/cert.pem (1123 bytes)
I0127 20:24:01.054904 21770 exec_runner.go:144] found /Users/jenkins/minikube-integration/15565-3092/.minikube/key.pem, removing ...
I0127 20:24:01.054910 21770 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15565-3092/.minikube/key.pem
I0127 20:24:01.054968 21770 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15565-3092/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/15565-3092/.minikube/key.pem (1679 bytes)
I0127 20:24:01.055085 21770 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/15565-3092/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/15565-3092/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/15565-3092/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-720000 san=[192.168.76.2 127.0.0.1 localhost 127.0.0.1 minikube old-k8s-version-720000]
I0127 20:24:01.248129 21770 provision.go:172] copyRemoteCerts
I0127 20:24:01.248237 21770 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0127 20:24:01.248307 21770 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-720000
I0127 20:24:01.311671 21770 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55059 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3092/.minikube/machines/old-k8s-version-720000/id_rsa Username:docker}
I0127 20:24:01.408228 21770 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3092/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0127 20:24:01.428441 21770 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3092/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
I0127 20:24:01.447052 21770 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3092/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0127 20:24:01.464765 21770 provision.go:86] duration metric: configureAuth took 473.498315ms
I0127 20:24:01.464778 21770 ubuntu.go:193] setting minikube options for container-runtime
I0127 20:24:01.464926 21770 config.go:180] Loaded profile config "old-k8s-version-720000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
I0127 20:24:01.464996 21770 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-720000
I0127 20:24:01.525494 21770 main.go:141] libmachine: Using SSH client type: native
I0127 20:24:01.525654 21770 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil> [] 0s} 127.0.0.1 55059 <nil> <nil>}
I0127 20:24:01.525670 21770 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0127 20:24:01.658469 21770 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0127 20:24:01.658482 21770 ubuntu.go:71] root file system type: overlay
I0127 20:24:01.658652 21770 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0127 20:24:01.658741 21770 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-720000
I0127 20:24:01.719450 21770 main.go:141] libmachine: Using SSH client type: native
I0127 20:24:01.719603 21770 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil> [] 0s} 127.0.0.1 55059 <nil> <nil>}
I0127 20:24:01.719657 21770 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0127 20:24:01.863168 21770 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0127 20:24:01.863277 21770 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-720000
I0127 20:24:01.925154 21770 main.go:141] libmachine: Using SSH client type: native
I0127 20:24:01.925304 21770 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil> [] 0s} 127.0.0.1 55059 <nil> <nil>}
I0127 20:24:01.925318 21770 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0127 20:24:02.545827 21770 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2022-12-15 22:25:58.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2023-01-28 04:24:01.860496385 +0000
@@ -1,30 +1,32 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
Wants=network-online.target
-Requires=docker.socket containerd.service
+Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutSec=0
-RestartSec=2
-Restart=always
-
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
+Restart=on-failure
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
@@ -32,16 +34,16 @@
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0127 20:24:02.545856 21770 machine.go:91] provisioned docker machine in 1.954402139s
I0127 20:24:02.545863 21770 client.go:171] LocalClient.Create took 12.180951756s
I0127 20:24:02.545884 21770 start.go:167] duration metric: libmachine.API.Create for "old-k8s-version-720000" took 12.18104299s
I0127 20:24:02.545893 21770 start.go:300] post-start starting for "old-k8s-version-720000" (driver="docker")
I0127 20:24:02.545898 21770 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0127 20:24:02.545984 21770 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0127 20:24:02.546048 21770 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-720000
I0127 20:24:02.609040 21770 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55059 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3092/.minikube/machines/old-k8s-version-720000/id_rsa Username:docker}
I0127 20:24:02.704416 21770 ssh_runner.go:195] Run: cat /etc/os-release
I0127 20:24:02.708845 21770 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0127 20:24:02.708867 21770 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0127 20:24:02.708874 21770 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0127 20:24:02.708881 21770 info.go:137] Remote host: Ubuntu 20.04.5 LTS
I0127 20:24:02.708890 21770 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15565-3092/.minikube/addons for local assets ...
I0127 20:24:02.709018 21770 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15565-3092/.minikube/files for local assets ...
I0127 20:24:02.709224 21770 filesync.go:149] local asset: /Users/jenkins/minikube-integration/15565-3092/.minikube/files/etc/ssl/certs/44062.pem -> 44062.pem in /etc/ssl/certs
I0127 20:24:02.709433 21770 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0127 20:24:02.718337 21770 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3092/.minikube/files/etc/ssl/certs/44062.pem --> /etc/ssl/certs/44062.pem (1708 bytes)
I0127 20:24:02.739031 21770 start.go:303] post-start completed in 193.128895ms
I0127 20:24:02.739544 21770 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-720000
I0127 20:24:02.815536 21770 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/config.json ...
I0127 20:24:02.816038 21770 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0127 20:24:02.816100 21770 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-720000
I0127 20:24:02.878932 21770 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55059 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3092/.minikube/machines/old-k8s-version-720000/id_rsa Username:docker}
I0127 20:24:02.971424 21770 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0127 20:24:02.978151 21770 start.go:128] duration metric: createHost completed in 12.688350135s
I0127 20:24:02.978177 21770 start.go:83] releasing machines lock for "old-k8s-version-720000", held for 12.688489506s
I0127 20:24:02.978259 21770 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-720000
I0127 20:24:03.045649 21770 ssh_runner.go:195] Run: cat /version.json
I0127 20:24:03.045663 21770 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
I0127 20:24:03.045718 21770 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-720000
I0127 20:24:03.045771 21770 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-720000
I0127 20:24:03.112021 21770 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55059 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3092/.minikube/machines/old-k8s-version-720000/id_rsa Username:docker}
I0127 20:24:03.112471 21770 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55059 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3092/.minikube/machines/old-k8s-version-720000/id_rsa Username:docker}
I0127 20:24:03.201008 21770 ssh_runner.go:195] Run: systemctl --version
I0127 20:24:03.401290 21770 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0127 20:24:03.406874 21770 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0127 20:24:03.429302 21770 cni.go:229] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0127 20:24:03.429388 21770 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
I0127 20:24:03.445791 21770 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
I0127 20:24:03.454478 21770 cni.go:307] configured [/etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0127 20:24:03.454496 21770 start.go:472] detecting cgroup driver to use...
I0127 20:24:03.454512 21770 detect.go:158] detected "cgroupfs" cgroup driver on host os
I0127 20:24:03.454634 21770 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
image-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0127 20:24:03.469814 21770 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "k8s.gcr.io/pause:3.1"|' /etc/containerd/config.toml"
I0127 20:24:03.479984 21770 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0127 20:24:03.489258 21770 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
I0127 20:24:03.489331 21770 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0127 20:24:03.498497 21770 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0127 20:24:03.508631 21770 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0127 20:24:03.518304 21770 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0127 20:24:03.530883 21770 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0127 20:24:03.541700 21770 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0127 20:24:03.553663 21770 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0127 20:24:03.562722 21770 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0127 20:24:03.573303 21770 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0127 20:24:03.646668 21770 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0127 20:24:03.731310 21770 start.go:472] detecting cgroup driver to use...
I0127 20:24:03.731332 21770 detect.go:158] detected "cgroupfs" cgroup driver on host os
I0127 20:24:03.731406 21770 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0127 20:24:03.745036 21770 cruntime.go:273] skipping containerd shutdown because we are bound to it
I0127 20:24:03.745118 21770 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0127 20:24:03.758565 21770 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
image-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0127 20:24:03.777738 21770 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0127 20:24:03.855644 21770 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0127 20:24:03.950654 21770 docker.go:529] configuring docker to use "cgroupfs" as cgroup driver...
I0127 20:24:03.950676 21770 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)
I0127 20:24:03.965655 21770 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0127 20:24:04.052504 21770 ssh_runner.go:195] Run: sudo systemctl restart docker
I0127 20:24:04.290545 21770 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0127 20:24:04.324916 21770 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0127 20:24:04.403974 21770 out.go:204] * Preparing Kubernetes v1.16.0 on Docker 20.10.22 ...
I0127 20:24:04.404165 21770 cli_runner.go:164] Run: docker exec -t old-k8s-version-720000 dig +short host.docker.internal
I0127 20:24:04.520793 21770 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2
I0127 20:24:04.520908 21770 ssh_runner.go:195] Run: grep 192.168.65.2 host.minikube.internal$ /etc/hosts
I0127 20:24:04.525340 21770 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0127 20:24:04.536787 21770 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-720000
I0127 20:24:04.600202 21770 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0127 20:24:04.600285 21770 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0127 20:24:04.626019 21770 docker.go:630] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0127 20:24:04.626040 21770 docker.go:560] Images already preloaded, skipping extraction
I0127 20:24:04.626135 21770 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0127 20:24:04.651487 21770 docker.go:630] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0127 20:24:04.651501 21770 cache_images.go:84] Images are preloaded, skipping loading
I0127 20:24:04.651595 21770 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0127 20:24:04.731078 21770 cni.go:84] Creating CNI manager for ""
I0127 20:24:04.731100 21770 cni.go:161] CNI unnecessary in this configuration, recommending no CNI
I0127 20:24:04.731122 21770 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0127 20:24:04.731147 21770 kubeadm.go:172] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-720000 NodeName:old-k8s-version-720000 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticP
odPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m]}
I0127 20:24:04.731284 21770 kubeadm.go:177] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-720000"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-720000
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.76.2:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0127 20:24:04.731380 21770 kubeadm.go:968] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-720000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-720000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0127 20:24:04.731459 21770 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0127 20:24:04.746900 21770 binaries.go:44] Found k8s binaries, skipping transfer
I0127 20:24:04.746979 21770 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0127 20:24:04.756217 21770 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (348 bytes)
I0127 20:24:04.773459 21770 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0127 20:24:04.788025 21770 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2174 bytes)
I0127 20:24:04.802993 21770 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0127 20:24:04.807474 21770 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0127 20:24:04.819496 21770 certs.go:56] Setting up /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000 for IP: 192.168.76.2
I0127 20:24:04.819517 21770 certs.go:186] acquiring lock for shared ca certs: {Name:mk2d86ad31f10478b3fe72eedd54ef2fcd74cf4b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 20:24:04.819692 21770 certs.go:195] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/15565-3092/.minikube/ca.key
I0127 20:24:04.819755 21770 certs.go:195] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/15565-3092/.minikube/proxy-client-ca.key
I0127 20:24:04.819794 21770 certs.go:315] generating minikube-user signed cert: /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/client.key
I0127 20:24:04.819809 21770 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/client.crt with IP's: []
I0127 20:24:04.980985 21770 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/client.crt ...
I0127 20:24:04.981012 21770 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/client.crt: {Name:mk68dd2ad24e6314f8fe8caab92fd82a3a339d82 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 20:24:04.981391 21770 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/client.key ...
I0127 20:24:04.981401 21770 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/client.key: {Name:mk3483a7242b7f34e8f083eb64c01cae7b12a023 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 20:24:04.981632 21770 certs.go:315] generating minikube signed cert: /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/apiserver.key.31bdca25
I0127 20:24:04.981652 21770 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/apiserver.crt.31bdca25 with IP's: [192.168.76.2 10.96.0.1 127.0.0.1 10.0.0.1]
I0127 20:24:05.037465 21770 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/apiserver.crt.31bdca25 ...
I0127 20:24:05.037480 21770 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/apiserver.crt.31bdca25: {Name:mk4041fb9ae5bf652149bf45c4ba3f781d852cfe Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 20:24:05.037799 21770 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/apiserver.key.31bdca25 ...
I0127 20:24:05.037812 21770 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/apiserver.key.31bdca25: {Name:mkd6c57a72c8494f3d647ac089cde51d03c2f649 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 20:24:05.038011 21770 certs.go:333] copying /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/apiserver.crt.31bdca25 -> /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/apiserver.crt
I0127 20:24:05.038217 21770 certs.go:337] copying /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/apiserver.key.31bdca25 -> /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/apiserver.key
I0127 20:24:05.038409 21770 certs.go:315] generating aggregator signed cert: /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/proxy-client.key
I0127 20:24:05.038427 21770 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/proxy-client.crt with IP's: []
I0127 20:24:05.265297 21770 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/proxy-client.crt ...
I0127 20:24:05.265310 21770 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/proxy-client.crt: {Name:mk716a259d49e2cbddbce67adf764645d38cf40f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 20:24:05.265567 21770 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/proxy-client.key ...
I0127 20:24:05.265578 21770 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/proxy-client.key: {Name:mk1fafbfffed08ad414d5387fc242ba867969c95 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 20:24:05.266019 21770 certs.go:401] found cert: /Users/jenkins/minikube-integration/15565-3092/.minikube/certs/Users/jenkins/minikube-integration/15565-3092/.minikube/certs/4406.pem (1338 bytes)
W0127 20:24:05.266073 21770 certs.go:397] ignoring /Users/jenkins/minikube-integration/15565-3092/.minikube/certs/Users/jenkins/minikube-integration/15565-3092/.minikube/certs/4406_empty.pem, impossibly tiny 0 bytes
I0127 20:24:05.266103 21770 certs.go:401] found cert: /Users/jenkins/minikube-integration/15565-3092/.minikube/certs/Users/jenkins/minikube-integration/15565-3092/.minikube/certs/ca-key.pem (1679 bytes)
I0127 20:24:05.266145 21770 certs.go:401] found cert: /Users/jenkins/minikube-integration/15565-3092/.minikube/certs/Users/jenkins/minikube-integration/15565-3092/.minikube/certs/ca.pem (1078 bytes)
I0127 20:24:05.266184 21770 certs.go:401] found cert: /Users/jenkins/minikube-integration/15565-3092/.minikube/certs/Users/jenkins/minikube-integration/15565-3092/.minikube/certs/cert.pem (1123 bytes)
I0127 20:24:05.266220 21770 certs.go:401] found cert: /Users/jenkins/minikube-integration/15565-3092/.minikube/certs/Users/jenkins/minikube-integration/15565-3092/.minikube/certs/key.pem (1679 bytes)
I0127 20:24:05.266305 21770 certs.go:401] found cert: /Users/jenkins/minikube-integration/15565-3092/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/15565-3092/.minikube/files/etc/ssl/certs/44062.pem (1708 bytes)
I0127 20:24:05.266883 21770 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0127 20:24:05.287476 21770 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0127 20:24:05.306590 21770 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0127 20:24:05.325591 21770 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3092/.minikube/profiles/old-k8s-version-720000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0127 20:24:05.345282 21770 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3092/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0127 20:24:05.365450 21770 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3092/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0127 20:24:05.384525 21770 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3092/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0127 20:24:05.403060 21770 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3092/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0127 20:24:05.421900 21770 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3092/.minikube/files/etc/ssl/certs/44062.pem --> /usr/share/ca-certificates/44062.pem (1708 bytes)
I0127 20:24:05.440960 21770 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3092/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0127 20:24:05.460721 21770 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3092/.minikube/certs/4406.pem --> /usr/share/ca-certificates/4406.pem (1338 bytes)
I0127 20:24:05.482330 21770 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0127 20:24:05.496976 21770 ssh_runner.go:195] Run: openssl version
I0127 20:24:05.503461 21770 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/44062.pem && ln -fs /usr/share/ca-certificates/44062.pem /etc/ssl/certs/44062.pem"
I0127 20:24:05.512426 21770 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/44062.pem
I0127 20:24:05.516870 21770 certs.go:444] hashing: -rw-r--r-- 1 root root 1708 Jan 28 03:36 /usr/share/ca-certificates/44062.pem
I0127 20:24:05.516949 21770 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/44062.pem
I0127 20:24:05.523278 21770 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/44062.pem /etc/ssl/certs/3ec20f2e.0"
I0127 20:24:05.532226 21770 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0127 20:24:05.541213 21770 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0127 20:24:05.546084 21770 certs.go:444] hashing: -rw-r--r-- 1 root root 1111 Jan 28 03:31 /usr/share/ca-certificates/minikubeCA.pem
I0127 20:24:05.546148 21770 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0127 20:24:05.552121 21770 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0127 20:24:05.561182 21770 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/4406.pem && ln -fs /usr/share/ca-certificates/4406.pem /etc/ssl/certs/4406.pem"
I0127 20:24:05.570285 21770 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/4406.pem
I0127 20:24:05.574347 21770 certs.go:444] hashing: -rw-r--r-- 1 root root 1338 Jan 28 03:36 /usr/share/ca-certificates/4406.pem
I0127 20:24:05.574403 21770 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/4406.pem
I0127 20:24:05.580264 21770 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/4406.pem /etc/ssl/certs/51391683.0"
I0127 20:24:05.590229 21770 kubeadm.go:401] StartCluster: {Name:old-k8s-version-720000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-720000 Namespace:default APIServerName:minikubeCA APISer
verNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disab
leMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}
I0127 20:24:05.590341 21770 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0127 20:24:05.616255 21770 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0127 20:24:05.625095 21770 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0127 20:24:05.633510 21770 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
I0127 20:24:05.633567 21770 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0127 20:24:05.642051 21770 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0127 20:24:05.642081 21770 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0127 20:24:05.695310 21770 kubeadm.go:322] [init] Using Kubernetes version: v1.16.0
I0127 20:24:05.695392 21770 kubeadm.go:322] [preflight] Running pre-flight checks
I0127 20:24:06.021026 21770 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0127 20:24:06.021114 21770 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0127 20:24:06.021211 21770 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0127 20:24:06.269061 21770 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0127 20:24:06.270000 21770 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0127 20:24:06.277084 21770 kubeadm.go:322] [kubelet-start] Activating the kubelet service
I0127 20:24:06.346906 21770 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0127 20:24:06.368763 21770 out.go:204] - Generating certificates and keys ...
I0127 20:24:06.368870 21770 kubeadm.go:322] [certs] Using existing ca certificate authority
I0127 20:24:06.368942 21770 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0127 20:24:06.488020 21770 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
I0127 20:24:06.641792 21770 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
I0127 20:24:06.719005 21770 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
I0127 20:24:06.824249 21770 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
I0127 20:24:06.921035 21770 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
I0127 20:24:06.921167 21770 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [old-k8s-version-720000 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I0127 20:24:07.060199 21770 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
I0127 20:24:07.060368 21770 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-720000 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I0127 20:24:07.255671 21770 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
I0127 20:24:07.553469 21770 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
I0127 20:24:07.683588 21770 kubeadm.go:322] [certs] Generating "sa" key and public key
I0127 20:24:07.683678 21770 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0127 20:24:07.743211 21770 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0127 20:24:07.978743 21770 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0127 20:24:08.087483 21770 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0127 20:24:08.147009 21770 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0127 20:24:08.147696 21770 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0127 20:24:08.169163 21770 out.go:204] - Booting up control plane ...
I0127 20:24:08.169262 21770 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0127 20:24:08.169335 21770 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0127 20:24:08.169432 21770 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0127 20:24:08.169503 21770 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0127 20:24:08.169625 21770 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0127 20:24:48.157580 21770 kubeadm.go:322] [kubelet-check] Initial timeout of 40s passed.
I0127 20:24:48.158185 21770 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 20:24:48.158406 21770 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 20:24:53.159505 21770 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 20:24:53.159753 21770 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 20:25:03.159791 21770 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 20:25:03.159952 21770 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 20:25:23.160724 21770 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 20:25:23.160986 21770 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 20:26:03.161426 21770 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 20:26:03.161589 21770 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 20:26:03.161598 21770 kubeadm.go:322]
I0127 20:26:03.161670 21770 kubeadm.go:322] Unfortunately, an error has occurred:
I0127 20:26:03.161713 21770 kubeadm.go:322] timed out waiting for the condition
I0127 20:26:03.161718 21770 kubeadm.go:322]
I0127 20:26:03.161742 21770 kubeadm.go:322] This error is likely caused by:
I0127 20:26:03.161769 21770 kubeadm.go:322] - The kubelet is not running
I0127 20:26:03.161911 21770 kubeadm.go:322] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0127 20:26:03.161923 21770 kubeadm.go:322]
I0127 20:26:03.162030 21770 kubeadm.go:322] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0127 20:26:03.162062 21770 kubeadm.go:322] - 'systemctl status kubelet'
I0127 20:26:03.162095 21770 kubeadm.go:322] - 'journalctl -xeu kubelet'
I0127 20:26:03.162104 21770 kubeadm.go:322]
I0127 20:26:03.162191 21770 kubeadm.go:322] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0127 20:26:03.162271 21770 kubeadm.go:322] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I0127 20:26:03.162345 21770 kubeadm.go:322] Here is one example how you may list all Kubernetes containers running in docker:
I0127 20:26:03.162392 21770 kubeadm.go:322] - 'docker ps -a | grep kube | grep -v pause'
I0127 20:26:03.162458 21770 kubeadm.go:322] Once you have found the failing container, you can inspect its logs with:
I0127 20:26:03.162510 21770 kubeadm.go:322] - 'docker logs CONTAINERID'
I0127 20:26:03.164923 21770 kubeadm.go:322] [WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
I0127 20:26:03.165010 21770 kubeadm.go:322] [WARNING Swap]: running with swap on is not supported. Please disable swap
I0127 20:26:03.165122 21770 kubeadm.go:322] [WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.22. Latest validated version: 18.09
I0127 20:26:03.165226 21770 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0127 20:26:03.165348 21770 kubeadm.go:322] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0127 20:26:03.165441 21770 kubeadm.go:322] To see the stack trace of this error execute with --v=5 or higher
W0127 20:26:03.165604 21770 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-720000 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-720000 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.22. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-720000 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-720000 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.22. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0127 20:26:03.165633 21770 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"
I0127 20:26:03.581337 21770 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0127 20:26:03.591362 21770 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
I0127 20:26:03.591423 21770 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0127 20:26:03.599167 21770 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0127 20:26:03.599188 21770 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0127 20:26:03.649483 21770 kubeadm.go:322] [init] Using Kubernetes version: v1.16.0
I0127 20:26:03.649555 21770 kubeadm.go:322] [preflight] Running pre-flight checks
I0127 20:26:03.956323 21770 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0127 20:26:03.956480 21770 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0127 20:26:03.956584 21770 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0127 20:26:04.190671 21770 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0127 20:26:04.191400 21770 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0127 20:26:04.198051 21770 kubeadm.go:322] [kubelet-start] Activating the kubelet service
I0127 20:26:04.261788 21770 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0127 20:26:04.283118 21770 out.go:204] - Generating certificates and keys ...
I0127 20:26:04.283210 21770 kubeadm.go:322] [certs] Using existing ca certificate authority
I0127 20:26:04.283278 21770 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0127 20:26:04.283359 21770 kubeadm.go:322] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0127 20:26:04.283421 21770 kubeadm.go:322] [certs] Using existing front-proxy-ca certificate authority
I0127 20:26:04.283486 21770 kubeadm.go:322] [certs] Using existing front-proxy-client certificate and key on disk
I0127 20:26:04.283536 21770 kubeadm.go:322] [certs] Using existing etcd/ca certificate authority
I0127 20:26:04.283621 21770 kubeadm.go:322] [certs] Using existing etcd/server certificate and key on disk
I0127 20:26:04.283680 21770 kubeadm.go:322] [certs] Using existing etcd/peer certificate and key on disk
I0127 20:26:04.283776 21770 kubeadm.go:322] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0127 20:26:04.283851 21770 kubeadm.go:322] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0127 20:26:04.283885 21770 kubeadm.go:322] [certs] Using the existing "sa" key
I0127 20:26:04.283935 21770 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0127 20:26:04.384532 21770 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0127 20:26:04.551888 21770 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0127 20:26:04.634941 21770 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0127 20:26:04.795453 21770 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0127 20:26:04.797220 21770 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0127 20:26:04.818771 21770 out.go:204] - Booting up control plane ...
I0127 20:26:04.818860 21770 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0127 20:26:04.818931 21770 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0127 20:26:04.818989 21770 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0127 20:26:04.819069 21770 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0127 20:26:04.819205 21770 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0127 20:26:44.841284 21770 kubeadm.go:322] [kubelet-check] Initial timeout of 40s passed.
I0127 20:26:44.842276 21770 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 20:26:44.842520 21770 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 20:26:49.846802 21770 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 20:26:49.847032 21770 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 20:26:59.851923 21770 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 20:26:59.852212 21770 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 20:27:19.856750 21770 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 20:27:19.857053 21770 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 20:27:59.859696 21770 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 20:27:59.859949 21770 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 20:27:59.859972 21770 kubeadm.go:322]
I0127 20:27:59.860017 21770 kubeadm.go:322] Unfortunately, an error has occurred:
I0127 20:27:59.860078 21770 kubeadm.go:322] timed out waiting for the condition
I0127 20:27:59.860099 21770 kubeadm.go:322]
I0127 20:27:59.860171 21770 kubeadm.go:322] This error is likely caused by:
I0127 20:27:59.860212 21770 kubeadm.go:322] - The kubelet is not running
I0127 20:27:59.860310 21770 kubeadm.go:322] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0127 20:27:59.860316 21770 kubeadm.go:322]
I0127 20:27:59.860437 21770 kubeadm.go:322] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0127 20:27:59.860480 21770 kubeadm.go:322] - 'systemctl status kubelet'
I0127 20:27:59.860517 21770 kubeadm.go:322] - 'journalctl -xeu kubelet'
I0127 20:27:59.860529 21770 kubeadm.go:322]
I0127 20:27:59.860663 21770 kubeadm.go:322] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0127 20:27:59.860739 21770 kubeadm.go:322] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I0127 20:27:59.860813 21770 kubeadm.go:322] Here is one example how you may list all Kubernetes containers running in docker:
I0127 20:27:59.860859 21770 kubeadm.go:322] - 'docker ps -a | grep kube | grep -v pause'
I0127 20:27:59.860931 21770 kubeadm.go:322] Once you have found the failing container, you can inspect its logs with:
I0127 20:27:59.860960 21770 kubeadm.go:322] - 'docker logs CONTAINERID'
I0127 20:27:59.863546 21770 kubeadm.go:322] [WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
I0127 20:27:59.863613 21770 kubeadm.go:322] [WARNING Swap]: running with swap on is not supported. Please disable swap
I0127 20:27:59.863723 21770 kubeadm.go:322] [WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.22. Latest validated version: 18.09
I0127 20:27:59.863802 21770 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0127 20:27:59.863871 21770 kubeadm.go:322] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0127 20:27:59.863936 21770 kubeadm.go:322] To see the stack trace of this error execute with --v=5 or higher
I0127 20:27:59.863959 21770 kubeadm.go:403] StartCluster complete in 3m54.227922875s
I0127 20:27:59.864050 21770 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0127 20:27:59.887349 21770 logs.go:279] 0 containers: []
W0127 20:27:59.887363 21770 logs.go:281] No container was found matching "kube-apiserver"
I0127 20:27:59.887434 21770 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0127 20:27:59.910104 21770 logs.go:279] 0 containers: []
W0127 20:27:59.910117 21770 logs.go:281] No container was found matching "etcd"
I0127 20:27:59.910189 21770 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0127 20:27:59.933486 21770 logs.go:279] 0 containers: []
W0127 20:27:59.933502 21770 logs.go:281] No container was found matching "coredns"
I0127 20:27:59.933572 21770 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0127 20:27:59.956986 21770 logs.go:279] 0 containers: []
W0127 20:27:59.957002 21770 logs.go:281] No container was found matching "kube-scheduler"
I0127 20:27:59.957071 21770 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0127 20:27:59.979821 21770 logs.go:279] 0 containers: []
W0127 20:27:59.979838 21770 logs.go:281] No container was found matching "kube-proxy"
I0127 20:27:59.979918 21770 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0127 20:28:00.002283 21770 logs.go:279] 0 containers: []
W0127 20:28:00.002295 21770 logs.go:281] No container was found matching "kubernetes-dashboard"
I0127 20:28:00.002368 21770 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0127 20:28:00.026785 21770 logs.go:279] 0 containers: []
W0127 20:28:00.026799 21770 logs.go:281] No container was found matching "storage-provisioner"
I0127 20:28:00.026859 21770 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0127 20:28:00.051436 21770 logs.go:279] 0 containers: []
W0127 20:28:00.051450 21770 logs.go:281] No container was found matching "kube-controller-manager"
I0127 20:28:00.051465 21770 logs.go:124] Gathering logs for Docker ...
I0127 20:28:00.051472 21770 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400"
I0127 20:28:00.068913 21770 logs.go:124] Gathering logs for container status ...
I0127 20:28:00.068928 21770 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0127 20:28:02.120845 21770 ssh_runner.go:235] Completed: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": (2.051888356s)
I0127 20:28:02.120955 21770 logs.go:124] Gathering logs for kubelet ...
I0127 20:28:02.120963 21770 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0127 20:28:02.160114 21770 logs.go:124] Gathering logs for dmesg ...
I0127 20:28:02.160131 21770 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0127 20:28:02.173174 21770 logs.go:124] Gathering logs for describe nodes ...
I0127 20:28:02.173188 21770 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0127 20:28:02.228630 21770 logs.go:131] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
W0127 20:28:02.228664 21770 out.go:369] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.22. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0127 20:28:02.228704 21770 out.go:239] *
*
W0127 20:28:02.228865 21770 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.22. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.22. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0127 20:28:02.228901 21770 out.go:239] *
*
W0127 20:28:02.229550 21770 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0127 20:28:02.294214 21770 out.go:177]
W0127 20:28:02.368110 21770 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.22. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.22. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0127 20:28:02.368205 21770 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0127 20:28:02.368242 21770 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0127 20:28:02.426207 21770 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p old-k8s-version-720000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-720000
helpers_test.go:235: (dbg) docker inspect old-k8s-version-720000:
-- stdout --
[
{
"Id": "7a7d076a498516c111ce76cf45095cad595fe9bdc6a8bcc5deafc4bf3ccd225c",
"Created": "2023-01-28T04:23:59.460794108Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 280095,
"ExitCode": 0,
"Error": "",
"StartedAt": "2023-01-28T04:23:59.779920163Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:c4f6061730f518104bba7f63d4b9eb2ccd1634c6b2943801ca33b3f1c3908566",
"ResolvConfPath": "/var/lib/docker/containers/7a7d076a498516c111ce76cf45095cad595fe9bdc6a8bcc5deafc4bf3ccd225c/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/7a7d076a498516c111ce76cf45095cad595fe9bdc6a8bcc5deafc4bf3ccd225c/hostname",
"HostsPath": "/var/lib/docker/containers/7a7d076a498516c111ce76cf45095cad595fe9bdc6a8bcc5deafc4bf3ccd225c/hosts",
"LogPath": "/var/lib/docker/containers/7a7d076a498516c111ce76cf45095cad595fe9bdc6a8bcc5deafc4bf3ccd225c/7a7d076a498516c111ce76cf45095cad595fe9bdc6a8bcc5deafc4bf3ccd225c-json.log",
"Name": "/old-k8s-version-720000",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-720000:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-720000",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"ConsoleSize": [
0,
0
],
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": null,
"BlkioDeviceWriteBps": null,
"BlkioDeviceReadIOps": null,
"BlkioDeviceWriteIOps": null,
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"KernelMemory": 0,
"KernelMemoryTCP": 0,
"MemoryReservation": 0,
"MemorySwap": 2306867200,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": null,
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/da1298bdc7c690d976cddf11ec06c53f3c0498e2fa7dca8218cb9dd123e574fb-init/diff:/var/lib/docker/overlay2/c98618a945a30d9da49b77c20d284b1fc9d5dd07c718be403064c7b12592fcc2/diff:/var/lib/docker/overlay2/acd2ad577a4ceef715a354a1b9ea7e57ed745eb557fea5ca8ee3cd1d85439275/diff:/var/lib/docker/overlay2/bfd2a98291f2fc5a30237c375509cfde5e7166ba0a8ae30e3ccd369fe3404b2e/diff:/var/lib/docker/overlay2/45332007b433d2510247edff31bc8b0d2e21c20238be950857d76066aaec8480/diff:/var/lib/docker/overlay2/4b42718e588e48c6a44dd97f98bb830d297eb8995ed59933f921307f1da2803f/diff:/var/lib/docker/overlay2/e72c33bb852ee68875a33b7bec813305a6b91f8b16ae32db22762cf43402323b/diff:/var/lib/docker/overlay2/8a99955944f9a0b68c5f113e61b6f6bc01bb3fd7f9c4a20ea12f00a88a33a1d4/diff:/var/lib/docker/overlay2/e0b0e841059ef79e6129bad0f0d8e18a1336a52c5467f7a05ca2794e8efcce2d/diff:/var/lib/docker/overlay2/a3fbb33b25e86980b42b0b45685f47a46023b703857d79cbb4c4d672ce639e39/diff:/var/lib/docker/overlay2/2dbe3b
e8eb01629a936e78c682f26882b187944fe5d24c049195654e490c802a/diff:/var/lib/docker/overlay2/c504395aedc09b4cd13feebc2043d4d0bcfab1b35c130806b4e9520c179b0231/diff:/var/lib/docker/overlay2/f333ac1dcf89b80f616501fd62797fbd7f8ecfb83f5fef081c7bb51ae911625d/diff:/var/lib/docker/overlay2/fb5c9b21669e5a9b084584933ae954fc9493d2e96daa25d19d7279da8cc2f52b/diff:/var/lib/docker/overlay2/af90405e66f7ffa61f79803e02798331195ec7594578c593fce0df6bfb9ba86c/diff:/var/lib/docker/overlay2/3c83186f707e3de251f810e96b25d5ab03a565e3d763f2605b2a762589e1e340/diff:/var/lib/docker/overlay2/37e178ca91bc815e59b4d08c255c2f134b1c800819cbe12cb2afa0e87379624c/diff:/var/lib/docker/overlay2/799d4146ec7c90cfddfab6c2610abdc1c7d41ee4bec84be82f7c9df0485d6390/diff:/var/lib/docker/overlay2/01936bf347c896d2075792750c427d32d5515aefdc4c8be60a70dd7a7c624e88/diff:/var/lib/docker/overlay2/58fd101e232f75bbf4159575ebc8bae8f27dbd7cb72659aa4d4d35385bbb3536/diff:/var/lib/docker/overlay2/eaadede4d4519ffc32dfe786221881f7d39ac8d5b7b9323f56508a90a0c52b29/diff:/var/lib/d
ocker/overlay2/0e2fed7ab7b98f63c8a787aa64d282e8001afa68ce1ce45be62168b53cd630c8/diff:/var/lib/docker/overlay2/f07d5613ff9c68f1a33650faf6224c6c0144b576c512a1211ec55360997eef5c/diff:/var/lib/docker/overlay2/254e8c42a01d4006c729fd67c19479b78041ca3abaa9f5c30b8a96e728a23732/diff:/var/lib/docker/overlay2/16eeb409b96071e187db369c3e8977b6807e5000a9b65c39d22530888a6f50b3/diff:/var/lib/docker/overlay2/32434435c4ce07daf39b43c678342ae7f62769a08740307e23f9e2c816b52714/diff:/var/lib/docker/overlay2/b507767acd4ce2a505273a8d30a25a000e198a7fe2321d1e75619467f87c982e/diff:/var/lib/docker/overlay2/89eb528b30472cbbf69cfd5c04fd59958f4bcf1106a7246c576b37103c1c29ea/diff:/var/lib/docker/overlay2/2fe626935915dbcc5d89b91e7aedb7e415c8c5f60a447d3bf29da7153c2e2d51/diff:/var/lib/docker/overlay2/12e2e6c023d453521828bd672af514cfbfd23ed029fa49ad76bf06789bac9d82/diff:/var/lib/docker/overlay2/10893bc4db033fb9504bdfc0ce61a991a48be0ba3ce06487da02434390b992d6/diff:/var/lib/docker/overlay2/557d846a56175ff15f5fafe1a4e7488be2955f8362bb2bdfe69f36464f3
3450d/diff:/var/lib/docker/overlay2/037768a4494ebb110f1c274f3a38f986eb8131aa1059266fe2da896b01b49739/diff:/var/lib/docker/overlay2/d659cca8a2d2085353fce997d8c419c9c181ce1ea97f9a8e905c3f9529966fc1/diff:/var/lib/docker/overlay2/9d6fbc388597a7a6d8f4f89812b20cc2dca57eba35dfd4c86723cf513c5bc37d/diff:/var/lib/docker/overlay2/1fb8a6e1e3555d3f1437c69ded87ac2ef056b8a5ec422146c07c694478c4b005/diff:/var/lib/docker/overlay2/fb0364b23eadc6eeadc7f5bf8ef08c906adcd94c9b2b1725e6e2352f4c9dcf50/diff:/var/lib/docker/overlay2/b4535ed62cf27bc04fe79b87d2d35f5d0151c3d95343f6cacc95a945de87c736/diff:/var/lib/docker/overlay2/07c066adfccd26b1b3982b81b6d662d47058772375f0b3623a4644d5fa9dacbb/diff:/var/lib/docker/overlay2/17fde45fbe3450cac98412542274d7b0906726ad3228a23912e31a0cca96a610/diff:/var/lib/docker/overlay2/9f923d8bd4daeab1de35589fa5d37738ce7f9b42d2e37d6cbb9a37058aeb63ec/diff:/var/lib/docker/overlay2/4cf5d2f7a3bfbed0d8f8632fce96b6b105c27eae1b84e7afb03e51f1325654b0/diff:/var/lib/docker/overlay2/2fc58532ce127557e21e34263872706f550748
939bbe53ba13cc9c6f8db039fd/diff:/var/lib/docker/overlay2/cfde536f5c21d7e98d79b854c716cdf5fad89d16d96526334ff303d0382952bc/diff:/var/lib/docker/overlay2/7ea9a21ee484f34b47c36a3279f32faadb0cb1fe47024a0db2169fba9890c080/diff",
"MergedDir": "/var/lib/docker/overlay2/da1298bdc7c690d976cddf11ec06c53f3c0498e2fa7dca8218cb9dd123e574fb/merged",
"UpperDir": "/var/lib/docker/overlay2/da1298bdc7c690d976cddf11ec06c53f3c0498e2fa7dca8218cb9dd123e574fb/diff",
"WorkDir": "/var/lib/docker/overlay2/da1298bdc7c690d976cddf11ec06c53f3c0498e2fa7dca8218cb9dd123e574fb/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-720000",
"Source": "/var/lib/docker/volumes/old-k8s-version-720000/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-720000",
"Domainname": "",
"User": "root",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a",
"Volumes": null,
"WorkingDir": "",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-720000",
"name.minikube.sigs.k8s.io": "old-k8s-version-720000",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "4bde41110b4751090c526e013b9c06a4cd379268e62e360c4f7771f7880047bf",
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "55059"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "55060"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "55061"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "55062"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "55063"
}
]
},
"SandboxKey": "/var/run/docker/netns/4bde41110b47",
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-720000": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": [
"7a7d076a4985",
"old-k8s-version-720000"
],
"NetworkID": "4a101da36ff964d86adf1945f3a9a22581d700864206dd1558c9c4957ae7df32",
"EndpointID": "478be67097d6d7fc644b5283841991783cd14bb90384bfcac470136266a2f598",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"MacAddress": "02:42:c0:a8:4c:02",
"DriverOpts": null
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-720000 -n old-k8s-version-720000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-720000 -n old-k8s-version-720000: exit status 6 (421.274368ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0127 20:28:03.004321 22963 status.go:415] kubeconfig endpoint: extract IP: "old-k8s-version-720000" does not appear in /Users/jenkins/minikube-integration/15565-3092/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-720000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (253.87s)