=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-darwin-amd64 start -p old-k8s-version-093929 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0
E1107 09:39:30.065424 3267 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/cilium-092105/client.crt: no such file or directory
E1107 09:39:32.625661 3267 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/cilium-092105/client.crt: no such file or directory
E1107 09:39:37.745940 3267 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/cilium-092105/client.crt: no such file or directory
E1107 09:39:43.570863 3267 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/kindnet-092104/client.crt: no such file or directory
E1107 09:39:47.986345 3267 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/cilium-092105/client.crt: no such file or directory
E1107 09:40:08.467773 3267 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/cilium-092105/client.crt: no such file or directory
=== CONT TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-093929 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0: exit status 109 (4m11.469736308s)
-- stdout --
* [old-k8s-version-093929] minikube v1.28.0 on Darwin 13.0
- MINIKUBE_LOCATION=15310
- KUBECONFIG=/Users/jenkins/minikube-integration/15310-2115/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/15310-2115/.minikube
* Using the docker driver based on user configuration
* Using Docker Desktop driver with root privileges
* Starting control plane node old-k8s-version-093929 in cluster old-k8s-version-093929
* Pulling base image ...
* Creating docker container (CPUs=2, Memory=2200MB) ...
* Preparing Kubernetes v1.16.0 on Docker 20.10.20 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I1107 09:39:29.294575 16797 out.go:296] Setting OutFile to fd 1 ...
I1107 09:39:29.295284 16797 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1107 09:39:29.295295 16797 out.go:309] Setting ErrFile to fd 2...
I1107 09:39:29.295303 16797 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1107 09:39:29.295565 16797 root.go:334] Updating PATH: /Users/jenkins/minikube-integration/15310-2115/.minikube/bin
I1107 09:39:29.296676 16797 out.go:303] Setting JSON to false
I1107 09:39:29.319106 16797 start.go:116] hostinfo: {"hostname":"MacOS-Agent-3.local","uptime":4144,"bootTime":1667838625,"procs":397,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.0","kernelVersion":"22.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}
W1107 09:39:29.319217 16797 start.go:124] gopshost.Virtualization returned error: not implemented yet
I1107 09:39:29.340985 16797 out.go:177] * [old-k8s-version-093929] minikube v1.28.0 on Darwin 13.0
I1107 09:39:29.361758 16797 notify.go:220] Checking for updates...
I1107 09:39:29.382717 16797 out.go:177] - MINIKUBE_LOCATION=15310
I1107 09:39:29.403611 16797 out.go:177] - KUBECONFIG=/Users/jenkins/minikube-integration/15310-2115/kubeconfig
I1107 09:39:29.424805 16797 out.go:177] - MINIKUBE_BIN=out/minikube-darwin-amd64
I1107 09:39:29.445721 16797 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1107 09:39:29.466656 16797 out.go:177] - MINIKUBE_HOME=/Users/jenkins/minikube-integration/15310-2115/.minikube
I1107 09:39:29.488190 16797 config.go:180] Loaded profile config "kubenet-092103": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.25.3
I1107 09:39:29.488261 16797 driver.go:365] Setting default libvirt URI to qemu:///system
I1107 09:39:29.558862 16797 docker.go:137] docker version: linux-20.10.20
I1107 09:39:29.559061 16797 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1107 09:39:29.728617 16797 info.go:266] docker info: {ID:QFCO:F62N:MHXK:7ALZ:TX2O:ANBM:VPCR:JFHZ:3RWK:DKG3:X765:OYAT Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:55 OomKillDisable:false NGoroutines:59 SystemTime:2022-11-07 17:39:29.622855965 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.15.49-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6231719936 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.20 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:9cd3357b7fd7218e4aec3eae239db1f68a5a6ec6 Expected:9cd3357b7fd7218e4aec3eae239db1f68a5a6ec6} RuncCommit:{ID:v1.1.4-0-g5fd4c4d Expected:v1.1.4-0-g5fd4c4d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defaul
t name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.9.1] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.12.1] map[Name:dev Path:/usr/local/lib/docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.0.3] map[Name:extension Path:/usr/local/lib/docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.13] map[Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/lo
cal/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.21.0]] Warnings:<nil>}}
I1107 09:39:29.750545 16797 out.go:177] * Using the docker driver based on user configuration
I1107 09:39:29.771087 16797 start.go:282] selected driver: docker
I1107 09:39:29.771102 16797 start.go:808] validating driver "docker" against <nil>
I1107 09:39:29.771131 16797 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1107 09:39:29.773934 16797 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1107 09:39:29.939195 16797 info.go:266] docker info: {ID:QFCO:F62N:MHXK:7ALZ:TX2O:ANBM:VPCR:JFHZ:3RWK:DKG3:X765:OYAT Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:55 OomKillDisable:false NGoroutines:59 SystemTime:2022-11-07 17:39:29.83789566 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.15.49-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServe
rAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6231719936 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.20 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:9cd3357b7fd7218e4aec3eae239db1f68a5a6ec6 Expected:9cd3357b7fd7218e4aec3eae239db1f68a5a6ec6} RuncCommit:{ID:v1.1.4-0-g5fd4c4d Expected:v1.1.4-0-g5fd4c4d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default
name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.9.1] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.12.1] map[Name:dev Path:/usr/local/lib/docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.0.3] map[Name:extension Path:/usr/local/lib/docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.13] map[Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/loc
al/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.21.0]] Warnings:<nil>}}
I1107 09:39:29.939327 16797 start_flags.go:303] no existing cluster config was found, will generate one from the flags
I1107 09:39:29.939473 16797 start_flags.go:901] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1107 09:39:29.961125 16797 out.go:177] * Using Docker Desktop driver with root privileges
I1107 09:39:29.981864 16797 cni.go:95] Creating CNI manager for ""
I1107 09:39:29.981881 16797 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I1107 09:39:29.981892 16797 start_flags.go:317] config:
{Name:old-k8s-version-093929 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.36@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-093929 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocke
t: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet}
I1107 09:39:30.002660 16797 out.go:177] * Starting control plane node old-k8s-version-093929 in cluster old-k8s-version-093929
I1107 09:39:30.044914 16797 cache.go:120] Beginning downloading kic base image for docker with docker
I1107 09:39:30.065685 16797 out.go:177] * Pulling base image ...
I1107 09:39:30.107892 16797 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I1107 09:39:30.107921 16797 image.go:76] Checking for gcr.io/k8s-minikube/kicbase:v0.0.36@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 in local docker daemon
I1107 09:39:30.107957 16797 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/15310-2115/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4
I1107 09:39:30.107969 16797 cache.go:57] Caching tarball of preloaded images
I1107 09:39:30.108108 16797 preload.go:174] Found /Users/jenkins/minikube-integration/15310-2115/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I1107 09:39:30.108120 16797 cache.go:60] Finished verifying existence of preloaded tar for v1.16.0 on docker
I1107 09:39:30.108680 16797 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/config.json ...
I1107 09:39:30.108751 16797 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/config.json: {Name:mk3182e4739a1c9eda1ab5059c366bc95c85f31e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1107 09:39:30.186072 16797 image.go:80] Found gcr.io/k8s-minikube/kicbase:v0.0.36@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 in local docker daemon, skipping pull
I1107 09:39:30.186103 16797 cache.go:142] gcr.io/k8s-minikube/kicbase:v0.0.36@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 exists in daemon, skipping load
I1107 09:39:30.186117 16797 cache.go:208] Successfully downloaded all kic artifacts
I1107 09:39:30.186187 16797 start.go:364] acquiring machines lock for old-k8s-version-093929: {Name:mk1219dfd9d2598aff29791b7c2ffd86213e8a98 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1107 09:39:30.186395 16797 start.go:368] acquired machines lock for "old-k8s-version-093929" in 192.365µs
I1107 09:39:30.186440 16797 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-093929 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.36@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-093929 Namespace:default APIServerName:minikubeCA APIServe
rNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fals
e CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I1107 09:39:30.186524 16797 start.go:125] createHost starting for "" (driver="docker")
I1107 09:39:30.232935 16797 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I1107 09:39:30.233256 16797 start.go:159] libmachine.API.Create for "old-k8s-version-093929" (driver="docker")
I1107 09:39:30.233297 16797 client.go:168] LocalClient.Create starting
I1107 09:39:30.233463 16797 main.go:134] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/15310-2115/.minikube/certs/ca.pem
I1107 09:39:30.233535 16797 main.go:134] libmachine: Decoding PEM data...
I1107 09:39:30.233555 16797 main.go:134] libmachine: Parsing certificate...
I1107 09:39:30.233627 16797 main.go:134] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/15310-2115/.minikube/certs/cert.pem
I1107 09:39:30.233676 16797 main.go:134] libmachine: Decoding PEM data...
I1107 09:39:30.233688 16797 main.go:134] libmachine: Parsing certificate...
I1107 09:39:30.254437 16797 cli_runner.go:164] Run: docker network inspect old-k8s-version-093929 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W1107 09:39:30.316615 16797 cli_runner.go:211] docker network inspect old-k8s-version-093929 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I1107 09:39:30.316789 16797 network_create.go:272] running [docker network inspect old-k8s-version-093929] to gather additional debugging logs...
I1107 09:39:30.316810 16797 cli_runner.go:164] Run: docker network inspect old-k8s-version-093929
W1107 09:39:30.383555 16797 cli_runner.go:211] docker network inspect old-k8s-version-093929 returned with exit code 1
I1107 09:39:30.383586 16797 network_create.go:275] error running [docker network inspect old-k8s-version-093929]: docker network inspect old-k8s-version-093929: exit status 1
stdout:
[]
stderr:
Error: No such network: old-k8s-version-093929
I1107 09:39:30.383600 16797 network_create.go:277] output of [docker network inspect old-k8s-version-093929]: -- stdout --
[]
-- /stdout --
** stderr **
Error: No such network: old-k8s-version-093929
** /stderr **
I1107 09:39:30.383728 16797 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1107 09:39:30.447035 16797 network.go:295] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc00017c420] misses:0}
I1107 09:39:30.447085 16797 network.go:241] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I1107 09:39:30.447107 16797 network_create.go:115] attempt to create docker network old-k8s-version-093929 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I1107 09:39:30.447218 16797 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-093929 old-k8s-version-093929
W1107 09:39:30.508705 16797 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-093929 old-k8s-version-093929 returned with exit code 1
W1107 09:39:30.508751 16797 network_create.go:107] failed to create docker network old-k8s-version-093929 192.168.49.0/24, will retry: subnet is taken
I1107 09:39:30.509099 16797 network.go:286] skipping subnet 192.168.49.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc00017c420] amended:false}} dirty:map[] misses:0}
I1107 09:39:30.509117 16797 network.go:244] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I1107 09:39:30.509367 16797 network.go:295] reserving subnet 192.168.58.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc00017c420] amended:true}} dirty:map[192.168.49.0:0xc00017c420 192.168.58.0:0xc00061e1f8] misses:0}
I1107 09:39:30.509382 16797 network.go:241] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I1107 09:39:30.509395 16797 network_create.go:115] attempt to create docker network old-k8s-version-093929 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ...
I1107 09:39:30.509490 16797 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-093929 old-k8s-version-093929
W1107 09:39:30.573114 16797 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-093929 old-k8s-version-093929 returned with exit code 1
W1107 09:39:30.573148 16797 network_create.go:107] failed to create docker network old-k8s-version-093929 192.168.58.0/24, will retry: subnet is taken
I1107 09:39:30.573453 16797 network.go:286] skipping subnet 192.168.58.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc00017c420] amended:true}} dirty:map[192.168.49.0:0xc00017c420 192.168.58.0:0xc00061e1f8] misses:1}
I1107 09:39:30.573475 16797 network.go:244] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I1107 09:39:30.573689 16797 network.go:295] reserving subnet 192.168.67.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc00017c420] amended:true}} dirty:map[192.168.49.0:0xc00017c420 192.168.58.0:0xc00061e1f8 192.168.67.0:0xc00061e230] misses:1}
I1107 09:39:30.573705 16797 network.go:241] using free private subnet 192.168.67.0/24: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I1107 09:39:30.573712 16797 network_create.go:115] attempt to create docker network old-k8s-version-093929 192.168.67.0/24 with gateway 192.168.67.1 and MTU of 1500 ...
I1107 09:39:30.573805 16797 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-093929 old-k8s-version-093929
W1107 09:39:30.637052 16797 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-093929 old-k8s-version-093929 returned with exit code 1
W1107 09:39:30.637090 16797 network_create.go:107] failed to create docker network old-k8s-version-093929 192.168.67.0/24, will retry: subnet is taken
I1107 09:39:30.637373 16797 network.go:286] skipping subnet 192.168.67.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc00017c420] amended:true}} dirty:map[192.168.49.0:0xc00017c420 192.168.58.0:0xc00061e1f8 192.168.67.0:0xc00061e230] misses:2}
I1107 09:39:30.637392 16797 network.go:244] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I1107 09:39:30.637641 16797 network.go:295] reserving subnet 192.168.76.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc00017c420] amended:true}} dirty:map[192.168.49.0:0xc00017c420 192.168.58.0:0xc00061e1f8 192.168.67.0:0xc00061e230 192.168.76.0:0xc00019ce20] misses:2}
I1107 09:39:30.637659 16797 network.go:241] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I1107 09:39:30.637669 16797 network_create.go:115] attempt to create docker network old-k8s-version-093929 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I1107 09:39:30.637771 16797 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-093929 old-k8s-version-093929
I1107 09:39:31.004328 16797 network_create.go:99] docker network old-k8s-version-093929 192.168.76.0/24 created
I1107 09:39:31.004386 16797 kic.go:106] calculated static IP "192.168.76.2" for the "old-k8s-version-093929" container
I1107 09:39:31.004539 16797 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I1107 09:39:31.069652 16797 cli_runner.go:164] Run: docker volume create old-k8s-version-093929 --label name.minikube.sigs.k8s.io=old-k8s-version-093929 --label created_by.minikube.sigs.k8s.io=true
I1107 09:39:31.131936 16797 oci.go:103] Successfully created a docker volume old-k8s-version-093929
I1107 09:39:31.132096 16797 cli_runner.go:164] Run: docker run --rm --name old-k8s-version-093929-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-093929 --entrypoint /usr/bin/test -v old-k8s-version-093929:/var gcr.io/k8s-minikube/kicbase:v0.0.36@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 -d /var/lib
I1107 09:39:32.147298 16797 cli_runner.go:217] Completed: docker run --rm --name old-k8s-version-093929-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-093929 --entrypoint /usr/bin/test -v old-k8s-version-093929:/var gcr.io/k8s-minikube/kicbase:v0.0.36@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 -d /var/lib: (1.015096355s)
I1107 09:39:32.147323 16797 oci.go:107] Successfully prepared a docker volume old-k8s-version-093929
I1107 09:39:32.147341 16797 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I1107 09:39:32.147361 16797 kic.go:179] Starting extracting preloaded images to volume ...
I1107 09:39:32.147470 16797 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/15310-2115/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-093929:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.36@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 -I lz4 -xf /preloaded.tar -C /extractDir
I1107 09:39:36.591241 16797 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/15310-2115/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-093929:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.36@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 -I lz4 -xf /preloaded.tar -C /extractDir: (4.44357068s)
I1107 09:39:36.591264 16797 kic.go:188] duration metric: took 4.443770 seconds to extract preloaded images to volume
I1107 09:39:36.591399 16797 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I1107 09:39:36.741340 16797 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname old-k8s-version-093929 --name old-k8s-version-093929 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-093929 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=old-k8s-version-093929 --network old-k8s-version-093929 --ip 192.168.76.2 --volume old-k8s-version-093929:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=8443 --publish=22 --publish=2376 --publish=5000 --publish=32443 gcr.io/k8s-minikube/kicbase:v0.0.36@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456
I1107 09:39:37.142513 16797 cli_runner.go:164] Run: docker container inspect old-k8s-version-093929 --format={{.State.Running}}
I1107 09:39:37.209371 16797 cli_runner.go:164] Run: docker container inspect old-k8s-version-093929 --format={{.State.Status}}
I1107 09:39:37.279011 16797 cli_runner.go:164] Run: docker exec old-k8s-version-093929 stat /var/lib/dpkg/alternatives/iptables
I1107 09:39:37.403024 16797 oci.go:144] the created container "old-k8s-version-093929" has a running status.
I1107 09:39:37.403061 16797 kic.go:210] Creating ssh key for kic: /Users/jenkins/minikube-integration/15310-2115/.minikube/machines/old-k8s-version-093929/id_rsa...
I1107 09:39:37.811702 16797 kic_runner.go:191] docker (temp): /Users/jenkins/minikube-integration/15310-2115/.minikube/machines/old-k8s-version-093929/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I1107 09:39:37.925518 16797 cli_runner.go:164] Run: docker container inspect old-k8s-version-093929 --format={{.State.Status}}
I1107 09:39:37.986948 16797 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I1107 09:39:37.986978 16797 kic_runner.go:114] Args: [docker exec --privileged old-k8s-version-093929 chown docker:docker /home/docker/.ssh/authorized_keys]
I1107 09:39:38.141719 16797 cli_runner.go:164] Run: docker container inspect old-k8s-version-093929 --format={{.State.Status}}
I1107 09:39:38.204267 16797 machine.go:88] provisioning docker machine ...
I1107 09:39:38.204313 16797 ubuntu.go:169] provisioning hostname "old-k8s-version-093929"
I1107 09:39:38.204446 16797 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-093929
I1107 09:39:38.266774 16797 main.go:134] libmachine: Using SSH client type: native
I1107 09:39:38.266976 16797 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13e6c00] 0x13e9d80 <nil> [] 0s} 127.0.0.1 53729 <nil> <nil>}
I1107 09:39:38.266995 16797 main.go:134] libmachine: About to run SSH command:
sudo hostname old-k8s-version-093929 && echo "old-k8s-version-093929" | sudo tee /etc/hostname
I1107 09:39:38.394281 16797 main.go:134] libmachine: SSH cmd err, output: <nil>: old-k8s-version-093929
I1107 09:39:38.394419 16797 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-093929
I1107 09:39:38.457784 16797 main.go:134] libmachine: Using SSH client type: native
I1107 09:39:38.457970 16797 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13e6c00] 0x13e9d80 <nil> [] 0s} 127.0.0.1 53729 <nil> <nil>}
I1107 09:39:38.457984 16797 main.go:134] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-093929' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-093929/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-093929' | sudo tee -a /etc/hosts;
fi
fi
I1107 09:39:38.578951 16797 main.go:134] libmachine: SSH cmd err, output: <nil>:
I1107 09:39:38.578972 16797 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/15310-2115/.minikube CaCertPath:/Users/jenkins/minikube-integration/15310-2115/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/15310-2115/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/15310-2115/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/15310-2115/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/15310-2115/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/15310-2115/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/15310-2115/.minikube}
I1107 09:39:38.578996 16797 ubuntu.go:177] setting up certificates
I1107 09:39:38.579006 16797 provision.go:83] configureAuth start
I1107 09:39:38.579104 16797 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-093929
I1107 09:39:38.641427 16797 provision.go:138] copyHostCerts
I1107 09:39:38.641534 16797 exec_runner.go:144] found /Users/jenkins/minikube-integration/15310-2115/.minikube/key.pem, removing ...
I1107 09:39:38.641544 16797 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15310-2115/.minikube/key.pem
I1107 09:39:38.641679 16797 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15310-2115/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/15310-2115/.minikube/key.pem (1679 bytes)
I1107 09:39:38.641922 16797 exec_runner.go:144] found /Users/jenkins/minikube-integration/15310-2115/.minikube/ca.pem, removing ...
I1107 09:39:38.641929 16797 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15310-2115/.minikube/ca.pem
I1107 09:39:38.642000 16797 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15310-2115/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/15310-2115/.minikube/ca.pem (1082 bytes)
I1107 09:39:38.642174 16797 exec_runner.go:144] found /Users/jenkins/minikube-integration/15310-2115/.minikube/cert.pem, removing ...
I1107 09:39:38.642181 16797 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15310-2115/.minikube/cert.pem
I1107 09:39:38.642256 16797 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15310-2115/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/15310-2115/.minikube/cert.pem (1123 bytes)
I1107 09:39:38.642417 16797 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/15310-2115/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/15310-2115/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/15310-2115/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-093929 san=[192.168.76.2 127.0.0.1 localhost 127.0.0.1 minikube old-k8s-version-093929]
I1107 09:39:39.024319 16797 provision.go:172] copyRemoteCerts
I1107 09:39:39.024402 16797 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1107 09:39:39.024467 16797 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-093929
I1107 09:39:39.085036 16797 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53729 SSHKeyPath:/Users/jenkins/minikube-integration/15310-2115/.minikube/machines/old-k8s-version-093929/id_rsa Username:docker}
I1107 09:39:39.170654 16797 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15310-2115/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I1107 09:39:39.189694 16797 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15310-2115/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
I1107 09:39:39.211372 16797 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15310-2115/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I1107 09:39:39.230313 16797 provision.go:86] duration metric: configureAuth took 651.275664ms
I1107 09:39:39.230327 16797 ubuntu.go:193] setting minikube options for container-runtime
I1107 09:39:39.230478 16797 config.go:180] Loaded profile config "old-k8s-version-093929": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
I1107 09:39:39.230552 16797 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-093929
I1107 09:39:39.292990 16797 main.go:134] libmachine: Using SSH client type: native
I1107 09:39:39.293157 16797 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13e6c00] 0x13e9d80 <nil> [] 0s} 127.0.0.1 53729 <nil> <nil>}
I1107 09:39:39.293174 16797 main.go:134] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I1107 09:39:39.410412 16797 main.go:134] libmachine: SSH cmd err, output: <nil>: overlay
I1107 09:39:39.410433 16797 ubuntu.go:71] root file system type: overlay
I1107 09:39:39.410600 16797 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I1107 09:39:39.410710 16797 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-093929
I1107 09:39:39.472574 16797 main.go:134] libmachine: Using SSH client type: native
I1107 09:39:39.472737 16797 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13e6c00] 0x13e9d80 <nil> [] 0s} 127.0.0.1 53729 <nil> <nil>}
I1107 09:39:39.472791 16797 main.go:134] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I1107 09:39:39.601064 16797 main.go:134] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I1107 09:39:39.601193 16797 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-093929
I1107 09:39:39.667512 16797 main.go:134] libmachine: Using SSH client type: native
I1107 09:39:39.667703 16797 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13e6c00] 0x13e9d80 <nil> [] 0s} 127.0.0.1 53729 <nil> <nil>}
I1107 09:39:39.667716 16797 main.go:134] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I1107 09:39:40.352477 16797 main.go:134] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2022-10-18 18:18:12.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2022-11-07 17:39:39.610077794 +0000
@@ -1,30 +1,32 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
Wants=network-online.target
-Requires=docker.socket containerd.service
+Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutSec=0
-RestartSec=2
-Restart=always
-
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
+Restart=on-failure
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
@@ -32,16 +34,16 @@
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I1107 09:39:40.352498 16797 machine.go:91] provisioned docker machine in 2.148145407s
I1107 09:39:40.352505 16797 client.go:171] LocalClient.Create took 10.118899449s
I1107 09:39:40.352545 16797 start.go:167] duration metric: libmachine.API.Create for "old-k8s-version-093929" took 10.118964237s
I1107 09:39:40.352555 16797 start.go:300] post-start starting for "old-k8s-version-093929" (driver="docker")
I1107 09:39:40.352560 16797 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1107 09:39:40.352637 16797 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1107 09:39:40.352707 16797 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-093929
I1107 09:39:40.412551 16797 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53729 SSHKeyPath:/Users/jenkins/minikube-integration/15310-2115/.minikube/machines/old-k8s-version-093929/id_rsa Username:docker}
I1107 09:39:40.498757 16797 ssh_runner.go:195] Run: cat /etc/os-release
I1107 09:39:40.502687 16797 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I1107 09:39:40.502703 16797 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1107 09:39:40.502711 16797 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I1107 09:39:40.502718 16797 info.go:137] Remote host: Ubuntu 20.04.5 LTS
I1107 09:39:40.502728 16797 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15310-2115/.minikube/addons for local assets ...
I1107 09:39:40.502828 16797 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15310-2115/.minikube/files for local assets ...
I1107 09:39:40.503011 16797 filesync.go:149] local asset: /Users/jenkins/minikube-integration/15310-2115/.minikube/files/etc/ssl/certs/32672.pem -> 32672.pem in /etc/ssl/certs
I1107 09:39:40.503234 16797 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1107 09:39:40.511671 16797 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15310-2115/.minikube/files/etc/ssl/certs/32672.pem --> /etc/ssl/certs/32672.pem (1708 bytes)
I1107 09:39:40.531929 16797 start.go:303] post-start completed in 179.359398ms
I1107 09:39:40.532576 16797 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-093929
I1107 09:39:40.593073 16797 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/config.json ...
I1107 09:39:40.593530 16797 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1107 09:39:40.593601 16797 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-093929
I1107 09:39:40.653528 16797 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53729 SSHKeyPath:/Users/jenkins/minikube-integration/15310-2115/.minikube/machines/old-k8s-version-093929/id_rsa Username:docker}
I1107 09:39:40.735516 16797 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1107 09:39:40.740642 16797 start.go:128] duration metric: createHost completed in 10.553794417s
I1107 09:39:40.740663 16797 start.go:83] releasing machines lock for "old-k8s-version-093929", held for 10.553938553s
I1107 09:39:40.740781 16797 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-093929
I1107 09:39:40.803569 16797 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
I1107 09:39:40.803576 16797 ssh_runner.go:195] Run: systemctl --version
I1107 09:39:40.803656 16797 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-093929
I1107 09:39:40.803682 16797 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-093929
I1107 09:39:40.870353 16797 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53729 SSHKeyPath:/Users/jenkins/minikube-integration/15310-2115/.minikube/machines/old-k8s-version-093929/id_rsa Username:docker}
I1107 09:39:40.893026 16797 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53729 SSHKeyPath:/Users/jenkins/minikube-integration/15310-2115/.minikube/machines/old-k8s-version-093929/id_rsa Username:docker}
I1107 09:39:41.195442 16797 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I1107 09:39:41.206200 16797 cruntime.go:273] skipping containerd shutdown because we are bound to it
I1107 09:39:41.206267 16797 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1107 09:39:41.215858 16797 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
image-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I1107 09:39:41.229445 16797 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I1107 09:39:41.301706 16797 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I1107 09:39:41.376325 16797 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1107 09:39:41.443959 16797 ssh_runner.go:195] Run: sudo systemctl restart docker
I1107 09:39:41.661549 16797 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I1107 09:39:41.697610 16797 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I1107 09:39:41.774056 16797 out.go:204] * Preparing Kubernetes v1.16.0 on Docker 20.10.20 ...
I1107 09:39:41.774160 16797 cli_runner.go:164] Run: docker exec -t old-k8s-version-093929 dig +short host.docker.internal
I1107 09:39:41.898022 16797 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2
I1107 09:39:41.898146 16797 ssh_runner.go:195] Run: grep 192.168.65.2 host.minikube.internal$ /etc/hosts
I1107 09:39:41.902375 16797 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1107 09:39:41.912300 16797 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-093929
I1107 09:39:41.972044 16797 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I1107 09:39:41.972135 16797 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I1107 09:39:41.998285 16797 docker.go:613] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I1107 09:39:41.998304 16797 docker.go:543] Images already preloaded, skipping extraction
I1107 09:39:41.998408 16797 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I1107 09:39:42.024191 16797 docker.go:613] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I1107 09:39:42.024208 16797 cache_images.go:84] Images are preloaded, skipping loading
I1107 09:39:42.024330 16797 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I1107 09:39:42.104706 16797 cni.go:95] Creating CNI manager for ""
I1107 09:39:42.104725 16797 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I1107 09:39:42.104735 16797 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I1107 09:39:42.104753 16797 kubeadm.go:156] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-093929 NodeName:old-k8s-version-093929 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false}
I1107 09:39:42.104872 16797 kubeadm.go:161] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-093929"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-093929
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.76.2:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1107 09:39:42.104955 16797 kubeadm.go:962] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-093929 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-093929 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I1107 09:39:42.105034 16797 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I1107 09:39:42.114709 16797 binaries.go:44] Found k8s binaries, skipping transfer
I1107 09:39:42.114799 16797 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1107 09:39:42.122804 16797 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (348 bytes)
I1107 09:39:42.139095 16797 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1107 09:39:42.153565 16797 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I1107 09:39:42.168078 16797 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I1107 09:39:42.172723 16797 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1107 09:39:42.183211 16797 certs.go:54] Setting up /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929 for IP: 192.168.76.2
I1107 09:39:42.183332 16797 certs.go:182] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/15310-2115/.minikube/ca.key
I1107 09:39:42.183387 16797 certs.go:182] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/15310-2115/.minikube/proxy-client-ca.key
I1107 09:39:42.183441 16797 certs.go:302] generating minikube-user signed cert: /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/client.key
I1107 09:39:42.183466 16797 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/client.crt with IP's: []
I1107 09:39:42.418044 16797 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/client.crt ...
I1107 09:39:42.418058 16797 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/client.crt: {Name:mk8ef399bad7ce9aaf7970946c30aa5f7ca1ad37 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1107 09:39:42.418398 16797 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/client.key ...
I1107 09:39:42.418407 16797 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/client.key: {Name:mk8bbcf412935328080da50c8fe235bd3b5a5c63 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1107 09:39:42.418639 16797 certs.go:302] generating minikube signed cert: /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/apiserver.key.31bdca25
I1107 09:39:42.418659 16797 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/apiserver.crt.31bdca25 with IP's: [192.168.76.2 10.96.0.1 127.0.0.1 10.0.0.1]
I1107 09:39:42.588578 16797 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/apiserver.crt.31bdca25 ...
I1107 09:39:42.588597 16797 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/apiserver.crt.31bdca25: {Name:mk2d15f7969e8ffb5ebdee725954a904bdb9c391 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1107 09:39:42.588907 16797 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/apiserver.key.31bdca25 ...
I1107 09:39:42.588916 16797 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/apiserver.key.31bdca25: {Name:mk5f233418d28d98d468a24d297b2ef233cbcef3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1107 09:39:42.589132 16797 certs.go:320] copying /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/apiserver.crt.31bdca25 -> /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/apiserver.crt
I1107 09:39:42.589306 16797 certs.go:324] copying /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/apiserver.key.31bdca25 -> /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/apiserver.key
I1107 09:39:42.589484 16797 certs.go:302] generating aggregator signed cert: /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/proxy-client.key
I1107 09:39:42.589503 16797 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/proxy-client.crt with IP's: []
I1107 09:39:42.712266 16797 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/proxy-client.crt ...
I1107 09:39:42.712281 16797 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/proxy-client.crt: {Name:mkf86b6770a9d78879917fdd9adac9dd0be3c3fa Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1107 09:39:42.712611 16797 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/proxy-client.key ...
I1107 09:39:42.712619 16797 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/proxy-client.key: {Name:mk2d1b822a728b1c67539efc292c7a9018bbc640 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1107 09:39:42.713030 16797 certs.go:388] found cert: /Users/jenkins/minikube-integration/15310-2115/.minikube/certs/Users/jenkins/minikube-integration/15310-2115/.minikube/certs/3267.pem (1338 bytes)
W1107 09:39:42.713081 16797 certs.go:384] ignoring /Users/jenkins/minikube-integration/15310-2115/.minikube/certs/Users/jenkins/minikube-integration/15310-2115/.minikube/certs/3267_empty.pem, impossibly tiny 0 bytes
I1107 09:39:42.713096 16797 certs.go:388] found cert: /Users/jenkins/minikube-integration/15310-2115/.minikube/certs/Users/jenkins/minikube-integration/15310-2115/.minikube/certs/ca-key.pem (1679 bytes)
I1107 09:39:42.713136 16797 certs.go:388] found cert: /Users/jenkins/minikube-integration/15310-2115/.minikube/certs/Users/jenkins/minikube-integration/15310-2115/.minikube/certs/ca.pem (1082 bytes)
I1107 09:39:42.713172 16797 certs.go:388] found cert: /Users/jenkins/minikube-integration/15310-2115/.minikube/certs/Users/jenkins/minikube-integration/15310-2115/.minikube/certs/cert.pem (1123 bytes)
I1107 09:39:42.713205 16797 certs.go:388] found cert: /Users/jenkins/minikube-integration/15310-2115/.minikube/certs/Users/jenkins/minikube-integration/15310-2115/.minikube/certs/key.pem (1679 bytes)
I1107 09:39:42.713294 16797 certs.go:388] found cert: /Users/jenkins/minikube-integration/15310-2115/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/15310-2115/.minikube/files/etc/ssl/certs/32672.pem (1708 bytes)
I1107 09:39:42.713795 16797 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I1107 09:39:42.733234 16797 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I1107 09:39:42.755635 16797 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1107 09:39:42.776103 16797 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15310-2115/.minikube/profiles/old-k8s-version-093929/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1107 09:39:42.796447 16797 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15310-2115/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1107 09:39:42.814945 16797 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15310-2115/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I1107 09:39:42.832584 16797 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15310-2115/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1107 09:39:42.850679 16797 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15310-2115/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I1107 09:39:42.868469 16797 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15310-2115/.minikube/files/etc/ssl/certs/32672.pem --> /usr/share/ca-certificates/32672.pem (1708 bytes)
I1107 09:39:42.885714 16797 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15310-2115/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1107 09:39:42.904217 16797 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15310-2115/.minikube/certs/3267.pem --> /usr/share/ca-certificates/3267.pem (1338 bytes)
I1107 09:39:42.922116 16797 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1107 09:39:42.940565 16797 ssh_runner.go:195] Run: openssl version
I1107 09:39:42.947959 16797 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/32672.pem && ln -fs /usr/share/ca-certificates/32672.pem /etc/ssl/certs/32672.pem"
I1107 09:39:42.957983 16797 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/32672.pem
I1107 09:39:42.962302 16797 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Nov 7 16:50 /usr/share/ca-certificates/32672.pem
I1107 09:39:42.962376 16797 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/32672.pem
I1107 09:39:42.968618 16797 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/32672.pem /etc/ssl/certs/3ec20f2e.0"
I1107 09:39:42.976852 16797 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1107 09:39:42.986848 16797 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1107 09:39:42.991807 16797 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Nov 7 16:46 /usr/share/ca-certificates/minikubeCA.pem
I1107 09:39:42.991861 16797 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1107 09:39:42.997453 16797 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1107 09:39:43.005506 16797 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3267.pem && ln -fs /usr/share/ca-certificates/3267.pem /etc/ssl/certs/3267.pem"
I1107 09:39:43.013465 16797 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3267.pem
I1107 09:39:43.017559 16797 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Nov 7 16:50 /usr/share/ca-certificates/3267.pem
I1107 09:39:43.017631 16797 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3267.pem
I1107 09:39:43.023100 16797 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/3267.pem /etc/ssl/certs/51391683.0"
I1107 09:39:43.031118 16797 kubeadm.go:396] StartCluster: {Name:old-k8s-version-093929 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.36@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-093929 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs
:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQe
muFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet}
I1107 09:39:43.031316 16797 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I1107 09:39:43.055774 16797 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1107 09:39:43.063653 16797 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1107 09:39:43.070909 16797 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I1107 09:39:43.070964 16797 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1107 09:39:43.078295 16797 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1107 09:39:43.078323 16797 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I1107 09:39:43.125609 16797 kubeadm.go:317] [init] Using Kubernetes version: v1.16.0
I1107 09:39:43.125672 16797 kubeadm.go:317] [preflight] Running pre-flight checks
I1107 09:39:43.442494 16797 kubeadm.go:317] [preflight] Pulling images required for setting up a Kubernetes cluster
I1107 09:39:43.442586 16797 kubeadm.go:317] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1107 09:39:43.442663 16797 kubeadm.go:317] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I1107 09:39:43.675520 16797 kubeadm.go:317] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1107 09:39:43.677488 16797 kubeadm.go:317] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1107 09:39:43.684348 16797 kubeadm.go:317] [kubelet-start] Activating the kubelet service
I1107 09:39:43.749355 16797 kubeadm.go:317] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1107 09:39:43.774724 16797 out.go:204] - Generating certificates and keys ...
I1107 09:39:43.774824 16797 kubeadm.go:317] [certs] Using existing ca certificate authority
I1107 09:39:43.774913 16797 kubeadm.go:317] [certs] Using existing apiserver certificate and key on disk
I1107 09:39:44.010627 16797 kubeadm.go:317] [certs] Generating "apiserver-kubelet-client" certificate and key
I1107 09:39:44.292525 16797 kubeadm.go:317] [certs] Generating "front-proxy-ca" certificate and key
I1107 09:39:44.438015 16797 kubeadm.go:317] [certs] Generating "front-proxy-client" certificate and key
I1107 09:39:44.594144 16797 kubeadm.go:317] [certs] Generating "etcd/ca" certificate and key
I1107 09:39:44.676422 16797 kubeadm.go:317] [certs] Generating "etcd/server" certificate and key
I1107 09:39:44.676555 16797 kubeadm.go:317] [certs] etcd/server serving cert is signed for DNS names [old-k8s-version-093929 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I1107 09:39:44.824910 16797 kubeadm.go:317] [certs] Generating "etcd/peer" certificate and key
I1107 09:39:44.825016 16797 kubeadm.go:317] [certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-093929 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I1107 09:39:45.184530 16797 kubeadm.go:317] [certs] Generating "etcd/healthcheck-client" certificate and key
I1107 09:39:45.301547 16797 kubeadm.go:317] [certs] Generating "apiserver-etcd-client" certificate and key
I1107 09:39:45.713921 16797 kubeadm.go:317] [certs] Generating "sa" key and public key
I1107 09:39:45.714097 16797 kubeadm.go:317] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1107 09:39:45.951441 16797 kubeadm.go:317] [kubeconfig] Writing "admin.conf" kubeconfig file
I1107 09:39:46.063115 16797 kubeadm.go:317] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1107 09:39:46.229421 16797 kubeadm.go:317] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1107 09:39:46.427356 16797 kubeadm.go:317] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1107 09:39:46.428408 16797 kubeadm.go:317] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1107 09:39:46.450130 16797 out.go:204] - Booting up control plane ...
I1107 09:39:46.450269 16797 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1107 09:39:46.450401 16797 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1107 09:39:46.450527 16797 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1107 09:39:46.450673 16797 kubeadm.go:317] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1107 09:39:46.450955 16797 kubeadm.go:317] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I1107 09:40:26.409481 16797 kubeadm.go:317] [kubelet-check] Initial timeout of 40s passed.
I1107 09:40:26.410485 16797 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1107 09:40:26.410763 16797 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1107 09:40:31.407863 16797 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1107 09:40:31.408086 16797 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1107 09:40:41.402851 16797 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1107 09:40:41.403135 16797 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1107 09:41:01.390758 16797 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1107 09:41:01.390970 16797 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1107 09:41:41.363742 16797 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1107 09:41:41.364088 16797 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1107 09:41:41.364111 16797 kubeadm.go:317]
I1107 09:41:41.364153 16797 kubeadm.go:317] Unfortunately, an error has occurred:
I1107 09:41:41.364194 16797 kubeadm.go:317] timed out waiting for the condition
I1107 09:41:41.364206 16797 kubeadm.go:317]
I1107 09:41:41.364234 16797 kubeadm.go:317] This error is likely caused by:
I1107 09:41:41.364257 16797 kubeadm.go:317] - The kubelet is not running
I1107 09:41:41.364329 16797 kubeadm.go:317] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I1107 09:41:41.364333 16797 kubeadm.go:317]
I1107 09:41:41.364426 16797 kubeadm.go:317] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I1107 09:41:41.364462 16797 kubeadm.go:317] - 'systemctl status kubelet'
I1107 09:41:41.364501 16797 kubeadm.go:317] - 'journalctl -xeu kubelet'
I1107 09:41:41.364509 16797 kubeadm.go:317]
I1107 09:41:41.364603 16797 kubeadm.go:317] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I1107 09:41:41.364773 16797 kubeadm.go:317] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I1107 09:41:41.364919 16797 kubeadm.go:317] Here is one example how you may list all Kubernetes containers running in docker:
I1107 09:41:41.364973 16797 kubeadm.go:317] - 'docker ps -a | grep kube | grep -v pause'
I1107 09:41:41.365026 16797 kubeadm.go:317] Once you have found the failing container, you can inspect its logs with:
I1107 09:41:41.365049 16797 kubeadm.go:317] - 'docker logs CONTAINERID'
I1107 09:41:41.372140 16797 kubeadm.go:317] [WARNING Swap]: running with swap on is not supported. Please disable swap
I1107 09:41:41.372311 16797 kubeadm.go:317] [WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
I1107 09:41:41.372442 16797 kubeadm.go:317] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1107 09:41:41.372611 16797 kubeadm.go:317] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I1107 09:41:41.372790 16797 kubeadm.go:317] To see the stack trace of this error execute with --v=5 or higher
W1107 09:41:41.372939 16797 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-093929 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-093929 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-093929 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-093929 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I1107 09:41:41.372971 16797 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"
I1107 09:41:41.866188 16797 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1107 09:41:41.876560 16797 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I1107 09:41:41.876627 16797 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1107 09:41:41.884751 16797 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1107 09:41:41.884777 16797 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I1107 09:41:41.935564 16797 kubeadm.go:317] [init] Using Kubernetes version: v1.16.0
I1107 09:41:41.935644 16797 kubeadm.go:317] [preflight] Running pre-flight checks
I1107 09:41:42.253427 16797 kubeadm.go:317] [preflight] Pulling images required for setting up a Kubernetes cluster
I1107 09:41:42.253525 16797 kubeadm.go:317] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1107 09:41:42.253618 16797 kubeadm.go:317] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I1107 09:41:42.516407 16797 kubeadm.go:317] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1107 09:41:42.516983 16797 kubeadm.go:317] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1107 09:41:42.524233 16797 kubeadm.go:317] [kubelet-start] Activating the kubelet service
I1107 09:41:42.611493 16797 kubeadm.go:317] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1107 09:41:42.645355 16797 out.go:204] - Generating certificates and keys ...
I1107 09:41:42.645471 16797 kubeadm.go:317] [certs] Using existing ca certificate authority
I1107 09:41:42.645564 16797 kubeadm.go:317] [certs] Using existing apiserver certificate and key on disk
I1107 09:41:42.645649 16797 kubeadm.go:317] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I1107 09:41:42.645705 16797 kubeadm.go:317] [certs] Using existing front-proxy-ca certificate authority
I1107 09:41:42.645798 16797 kubeadm.go:317] [certs] Using existing front-proxy-client certificate and key on disk
I1107 09:41:42.645850 16797 kubeadm.go:317] [certs] Using existing etcd/ca certificate authority
I1107 09:41:42.645911 16797 kubeadm.go:317] [certs] Using existing etcd/server certificate and key on disk
I1107 09:41:42.646023 16797 kubeadm.go:317] [certs] Using existing etcd/peer certificate and key on disk
I1107 09:41:42.646152 16797 kubeadm.go:317] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I1107 09:41:42.646233 16797 kubeadm.go:317] [certs] Using existing apiserver-etcd-client certificate and key on disk
I1107 09:41:42.646272 16797 kubeadm.go:317] [certs] Using the existing "sa" key
I1107 09:41:42.646327 16797 kubeadm.go:317] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1107 09:41:42.678270 16797 kubeadm.go:317] [kubeconfig] Writing "admin.conf" kubeconfig file
I1107 09:41:42.759741 16797 kubeadm.go:317] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1107 09:41:42.887811 16797 kubeadm.go:317] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1107 09:41:43.146851 16797 kubeadm.go:317] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1107 09:41:43.147440 16797 kubeadm.go:317] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1107 09:41:43.170075 16797 out.go:204] - Booting up control plane ...
I1107 09:41:43.170198 16797 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1107 09:41:43.170272 16797 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1107 09:41:43.170349 16797 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1107 09:41:43.170439 16797 kubeadm.go:317] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1107 09:41:43.170606 16797 kubeadm.go:317] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I1107 09:42:23.131063 16797 kubeadm.go:317] [kubelet-check] Initial timeout of 40s passed.
I1107 09:42:23.132476 16797 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1107 09:42:23.132684 16797 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1107 09:42:28.131112 16797 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1107 09:42:28.131317 16797 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1107 09:42:38.125429 16797 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1107 09:42:38.125711 16797 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1107 09:42:58.113213 16797 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1107 09:42:58.113442 16797 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1107 09:43:38.086582 16797 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1107 09:43:38.086735 16797 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1107 09:43:38.086749 16797 kubeadm.go:317]
I1107 09:43:38.086798 16797 kubeadm.go:317] Unfortunately, an error has occurred:
I1107 09:43:38.086829 16797 kubeadm.go:317] timed out waiting for the condition
I1107 09:43:38.086835 16797 kubeadm.go:317]
I1107 09:43:38.086861 16797 kubeadm.go:317] This error is likely caused by:
I1107 09:43:38.086911 16797 kubeadm.go:317] - The kubelet is not running
I1107 09:43:38.087007 16797 kubeadm.go:317] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I1107 09:43:38.087017 16797 kubeadm.go:317]
I1107 09:43:38.087108 16797 kubeadm.go:317] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I1107 09:43:38.087141 16797 kubeadm.go:317] - 'systemctl status kubelet'
I1107 09:43:38.087164 16797 kubeadm.go:317] - 'journalctl -xeu kubelet'
I1107 09:43:38.087175 16797 kubeadm.go:317]
I1107 09:43:38.087262 16797 kubeadm.go:317] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I1107 09:43:38.087352 16797 kubeadm.go:317] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I1107 09:43:38.087427 16797 kubeadm.go:317] Here is one example how you may list all Kubernetes containers running in docker:
I1107 09:43:38.087469 16797 kubeadm.go:317] - 'docker ps -a | grep kube | grep -v pause'
I1107 09:43:38.087523 16797 kubeadm.go:317] Once you have found the failing container, you can inspect its logs with:
I1107 09:43:38.087551 16797 kubeadm.go:317] - 'docker logs CONTAINERID'
I1107 09:43:38.090625 16797 kubeadm.go:317] [WARNING Swap]: running with swap on is not supported. Please disable swap
I1107 09:43:38.090735 16797 kubeadm.go:317] [WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
I1107 09:43:38.090823 16797 kubeadm.go:317] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1107 09:43:38.090892 16797 kubeadm.go:317] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I1107 09:43:38.090945 16797 kubeadm.go:317] To see the stack trace of this error execute with --v=5 or higher
I1107 09:43:38.090971 16797 kubeadm.go:398] StartCluster complete in 3m55.052809114s
I1107 09:43:38.091072 16797 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I1107 09:43:38.113203 16797 logs.go:274] 0 containers: []
W1107 09:43:38.113215 16797 logs.go:276] No container was found matching "kube-apiserver"
I1107 09:43:38.113321 16797 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I1107 09:43:38.137595 16797 logs.go:274] 0 containers: []
W1107 09:43:38.137608 16797 logs.go:276] No container was found matching "etcd"
I1107 09:43:38.137691 16797 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I1107 09:43:38.160016 16797 logs.go:274] 0 containers: []
W1107 09:43:38.160029 16797 logs.go:276] No container was found matching "coredns"
I1107 09:43:38.160118 16797 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I1107 09:43:38.181846 16797 logs.go:274] 0 containers: []
W1107 09:43:38.181857 16797 logs.go:276] No container was found matching "kube-scheduler"
I1107 09:43:38.181938 16797 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I1107 09:43:38.202852 16797 logs.go:274] 0 containers: []
W1107 09:43:38.202864 16797 logs.go:276] No container was found matching "kube-proxy"
I1107 09:43:38.202968 16797 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I1107 09:43:38.225448 16797 logs.go:274] 0 containers: []
W1107 09:43:38.225459 16797 logs.go:276] No container was found matching "kubernetes-dashboard"
I1107 09:43:38.225541 16797 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I1107 09:43:38.250549 16797 logs.go:274] 0 containers: []
W1107 09:43:38.250561 16797 logs.go:276] No container was found matching "storage-provisioner"
I1107 09:43:38.250641 16797 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I1107 09:43:38.274705 16797 logs.go:274] 0 containers: []
W1107 09:43:38.274718 16797 logs.go:276] No container was found matching "kube-controller-manager"
I1107 09:43:38.274727 16797 logs.go:123] Gathering logs for Docker ...
I1107 09:43:38.274737 16797 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400"
I1107 09:43:38.291219 16797 logs.go:123] Gathering logs for container status ...
I1107 09:43:38.291233 16797 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1107 09:43:40.340238 16797 ssh_runner.go:235] Completed: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": (2.048932584s)
I1107 09:43:40.340366 16797 logs.go:123] Gathering logs for kubelet ...
I1107 09:43:40.340373 16797 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1107 09:43:40.378369 16797 logs.go:123] Gathering logs for dmesg ...
I1107 09:43:40.378383 16797 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1107 09:43:40.390656 16797 logs.go:123] Gathering logs for describe nodes ...
I1107 09:43:40.390668 16797 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1107 09:43:40.444860 16797 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
W1107 09:43:40.444884 16797 out.go:369] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W1107 09:43:40.444906 16797 out.go:239] *
*
W1107 09:43:40.445010 16797 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W1107 09:43:40.445029 16797 out.go:239] *
*
W1107 09:43:40.445676 16797 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1107 09:43:40.542433 16797 out.go:177]
W1107 09:43:40.602831 16797 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W1107 09:43:40.603010 16797 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W1107 09:43:40.603132 16797 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I1107 09:43:40.645300 16797 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p old-k8s-version-093929 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-093929
helpers_test.go:235: (dbg) docker inspect old-k8s-version-093929:
-- stdout --
[
{
"Id": "50811d3bbfa74e9a1e5b508cd8b2301e651635c5a570c0b553fd954fe5ece8dd",
"Created": "2022-11-07T17:39:36.809249754Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 258627,
"ExitCode": 0,
"Error": "",
"StartedAt": "2022-11-07T17:39:37.143637295Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:866c1fe4e3f2d2bfd7e546c12f77c7ef1d94d65a891923ff6772712a9f20df40",
"ResolvConfPath": "/var/lib/docker/containers/50811d3bbfa74e9a1e5b508cd8b2301e651635c5a570c0b553fd954fe5ece8dd/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/50811d3bbfa74e9a1e5b508cd8b2301e651635c5a570c0b553fd954fe5ece8dd/hostname",
"HostsPath": "/var/lib/docker/containers/50811d3bbfa74e9a1e5b508cd8b2301e651635c5a570c0b553fd954fe5ece8dd/hosts",
"LogPath": "/var/lib/docker/containers/50811d3bbfa74e9a1e5b508cd8b2301e651635c5a570c0b553fd954fe5ece8dd/50811d3bbfa74e9a1e5b508cd8b2301e651635c5a570c0b553fd954fe5ece8dd-json.log",
"Name": "/old-k8s-version-093929",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-093929:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-093929",
"PortBindings": {
"22/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"2376/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"32443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"5000/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"8443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"ConsoleSize": [
0,
0
],
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": null,
"BlkioDeviceWriteBps": null,
"BlkioDeviceReadIOps": null,
"BlkioDeviceWriteIOps": null,
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"KernelMemory": 0,
"KernelMemoryTCP": 0,
"MemoryReservation": 0,
"MemorySwap": 2306867200,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": null,
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/39a041573ad3eca7ab697263fe10ea171795f26b07a4716ba8ee670c2bcbcaad-init/diff:/var/lib/docker/overlay2/8ef76795356079208b1acef7376be67a28d951b743a50dd56a60b0d456568ae9/diff:/var/lib/docker/overlay2/f9288d2baad2a30057af35c115d2ebfb4650d5d1d798a60a2334facced392980/diff:/var/lib/docker/overlay2/270f6ca71b47e51691c54d669e6e8e86c321939c053498289406eab5aa0462f5/diff:/var/lib/docker/overlay2/ebe3fe002872a87a7cc54a77192a2ea1f0efb3730f887abec35652e72f152f46/diff:/var/lib/docker/overlay2/83c9d5ae9817ab2b318ad7ba44ade4fe9c22378e15e338b8fe94c5998fbac5c4/diff:/var/lib/docker/overlay2/6426b1d4e4f369bec5066b3c17c47f9c451787be596ba417de62155901d14061/diff:/var/lib/docker/overlay2/f409955dc1056669a5ee00fa64ecfa9733f3de1a92beefeeca73cba51d930189/diff:/var/lib/docker/overlay2/3ecb7ca97b99ba70c03450a3d6d4a4452c7e9e348eec3cf89e6e8ee51aba6a8b/diff:/var/lib/docker/overlay2/9dd8fffded9665b1b7a326cb2bb3e29e3b716cdba6544940490326ddcbfe2bda/diff:/var/lib/docker/overlay2/b43aed
d977d94230f77efb53c193c1a02895ea314fcdece500155052dfeb6b29/diff:/var/lib/docker/overlay2/ba3bd8f651e3503bd8eadf3ce01b8930edaf7eb6af4044593c756be0f3c5d03a/diff:/var/lib/docker/overlay2/359c64a8e323929352da8612c231ccf0f6be76af37c8a208a9ee98c3bce5e2a1/diff:/var/lib/docker/overlay2/868ec2aea7bce1a74dcdf6c7a708b34838e8c08e795aad6e5b974d1ab15b719c/diff:/var/lib/docker/overlay2/0438a0192165f11b19940586b456c07bfa31d015147b9d008aafaacc09fbc40c/diff:/var/lib/docker/overlay2/80a13b6491a8f9f1c0f6848a375575c20f50d592cb34f21491050776a56fca61/diff:/var/lib/docker/overlay2/dd29a4d45bcf60d3684330374a82b3f3bde4245c5d49661ffdd516cd0c0af260/diff:/var/lib/docker/overlay2/ef8c6936e45d238f2880da0d94945cb610fba8a9e38cdfb3ae6674a82a8f0480/diff:/var/lib/docker/overlay2/9934f45b2cecf953b6f56ee634f63c3dd99c8c358b74fee64fdc62cef64f7723/diff:/var/lib/docker/overlay2/f5ccdcf1811b84ddfcc2efdc07e5feefa2803c1fe476b6653b0a6af55c2e684f/diff:/var/lib/docker/overlay2/2b3b062a0d083aedf009b6c8dde21debe0396b301936ec1950364a1d0ef86b6d/diff:/var/lib/d
ocker/overlay2/db91c57bd6754e3dbdc6c234df413d494606d408e284454bf7ab30cd23f9e840/diff:/var/lib/docker/overlay2/6538f86ce38383e3a133480b44c25afa8b31a61935d6f87270e2cc139e424425/diff:/var/lib/docker/overlay2/80972648e2aa65675fe7f3de22feae57951c0092d5f963f2430650b071940bba/diff:/var/lib/docker/overlay2/19dc0f28f2a85362d2b586f65ab00efa8a97868656af9dc5911259dd3ca649ac/diff:/var/lib/docker/overlay2/99eff050eadab512f36f80d63e8b57d9aa45ef607d723d7ac3f20ece8310a758/diff:/var/lib/docker/overlay2/d6309ab08fa5212992e2b5125645ad32bce2940b50c5e8a5b72e7c7531eb80b4/diff:/var/lib/docker/overlay2/c4d3d6d4212753e50a5f68577281382a30773fb33ca98730aebdfd86d48f612c/diff:/var/lib/docker/overlay2/4292068e16912b59305479ae020d9aa923d57157c4a28dd11e69102be9c1541a/diff:/var/lib/docker/overlay2/2274c567eadc1a99c8173258b3794df0df44fd1abac0aaae2100133ad15b3f30/diff:/var/lib/docker/overlay2/e3bb447cc7563c5af39c4076a93bb7b33bd1a7c6c5ccef7fea2a6a99deddf9f3/diff:/var/lib/docker/overlay2/4329b8a4d7648d8e3bb46a144b9939a5026fa69e5ac188a778cf6ede21a
9627e/diff:/var/lib/docker/overlay2/b600639ff99f881a9eb993fd36e2faf1c0f88a869675ab9d8ec116efc2642784/diff:/var/lib/docker/overlay2/da083fbec4f2fa2681bbaaaa559fdcc46ec2a520e7b9ced39197e805a661fda3/diff:/var/lib/docker/overlay2/63848d00284d16d750a7e746c8be62f8c15819bc2fcb72297788f3c9647257e6/diff:/var/lib/docker/overlay2/3fd667008c6a5c1c5828bb4e003fc21c477a31c4d59b5b675a3886d8a7cb782d/diff:/var/lib/docker/overlay2/6b125cd950aed912fcc597ce8a96bbb5af3dbba111d6eb683ea981387e02e99d/diff:/var/lib/docker/overlay2/b4c672faa14a55ba585c6063024785d7913afc546dd6d04975591d2e13d7b52f/diff:/var/lib/docker/overlay2/c2c0287a05145a26d3313d4e33799ea96103a20115734a66a3c2af8fe728b170/diff:/var/lib/docker/overlay2/dba7b9788bd657997c8cee3b3ef21f9bc4ade7b5a0da25526255047311da571d/diff:/var/lib/docker/overlay2/1f3ae87b3ce804fde9f857de6cb225d5afa00aa39260d197d77f67e840e2d285/diff:/var/lib/docker/overlay2/603b72832425bade21ef2d76583dbe61a46ff7fbe7277673cbc6cd52cf7613dd/diff:/var/lib/docker/overlay2/a47793b1e0564c094c05134af06d2d46a6bcb7
6089b3836b831863ef51c21684/diff",
"MergedDir": "/var/lib/docker/overlay2/39a041573ad3eca7ab697263fe10ea171795f26b07a4716ba8ee670c2bcbcaad/merged",
"UpperDir": "/var/lib/docker/overlay2/39a041573ad3eca7ab697263fe10ea171795f26b07a4716ba8ee670c2bcbcaad/diff",
"WorkDir": "/var/lib/docker/overlay2/39a041573ad3eca7ab697263fe10ea171795f26b07a4716ba8ee670c2bcbcaad/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-093929",
"Source": "/var/lib/docker/volumes/old-k8s-version-093929/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-093929",
"Domainname": "",
"User": "root",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase:v0.0.36@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456",
"Volumes": null,
"WorkingDir": "",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-093929",
"name.minikube.sigs.k8s.io": "old-k8s-version-093929",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "df36e65f1c697018769e2cb073b4d1ab9327d2cbebd6626fc0b46fa243b9ed92",
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"Ports": {
"22/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "53729"
}
],
"2376/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "53730"
}
],
"32443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "53731"
}
],
"5000/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "53732"
}
],
"8443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "53733"
}
]
},
"SandboxKey": "/var/run/docker/netns/df36e65f1c69",
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-093929": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": [
"50811d3bbfa7",
"old-k8s-version-093929"
],
"NetworkID": "85b1c6253454469ed38e54ce96d4baef11c9b5b3afd90032e806121a14971f03",
"EndpointID": "38533a1a1835e26950d13a17e03943cf6a91601ddc3f8e93c9594d62c6d8df36",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"MacAddress": "02:42:c0:a8:4c:02",
"DriverOpts": null
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-093929 -n old-k8s-version-093929
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-093929 -n old-k8s-version-093929: exit status 6 (396.631422ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E1107 09:43:41.183997 17561 status.go:415] kubeconfig endpoint: extract IP: "old-k8s-version-093929" does not appear in /Users/jenkins/minikube-integration/15310-2115/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-093929" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (251.96s)