=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-darwin-amd64 start -p old-k8s-version-110019 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0
=== CONT TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-110019 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0: exit status 109 (4m8.85991218s)
-- stdout --
* [old-k8s-version-110019] minikube v1.28.0 on Darwin 13.0
- MINIKUBE_LOCATION=15331
- KUBECONFIG=/Users/jenkins/minikube-integration/15331-22028/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/15331-22028/.minikube
* Using the docker driver based on user configuration
* Using Docker Desktop driver with root privileges
* Starting control plane node old-k8s-version-110019 in cluster old-k8s-version-110019
* Pulling base image ...
* Creating docker container (CPUs=2, Memory=2200MB) ...
* Preparing Kubernetes v1.16.0 on Docker 20.10.20 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I1109 11:00:19.789768 36410 out.go:296] Setting OutFile to fd 1 ...
I1109 11:00:19.789945 36410 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1109 11:00:19.789950 36410 out.go:309] Setting ErrFile to fd 2...
I1109 11:00:19.789954 36410 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1109 11:00:19.790063 36410 root.go:334] Updating PATH: /Users/jenkins/minikube-integration/15331-22028/.minikube/bin
I1109 11:00:19.790664 36410 out.go:303] Setting JSON to false
I1109 11:00:19.809565 36410 start.go:116] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":14394,"bootTime":1668006025,"procs":391,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.0","kernelVersion":"22.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
W1109 11:00:19.809660 36410 start.go:124] gopshost.Virtualization returned error: not implemented yet
I1109 11:00:19.832225 36410 out.go:177] * [old-k8s-version-110019] minikube v1.28.0 on Darwin 13.0
I1109 11:00:19.853978 36410 notify.go:220] Checking for updates...
I1109 11:00:19.875664 36410 out.go:177] - MINIKUBE_LOCATION=15331
I1109 11:00:19.897670 36410 out.go:177] - KUBECONFIG=/Users/jenkins/minikube-integration/15331-22028/kubeconfig
I1109 11:00:19.920945 36410 out.go:177] - MINIKUBE_BIN=out/minikube-darwin-amd64
I1109 11:00:19.942893 36410 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1109 11:00:19.963975 36410 out.go:177] - MINIKUBE_HOME=/Users/jenkins/minikube-integration/15331-22028/.minikube
I1109 11:00:19.986738 36410 config.go:180] Loaded profile config "kubenet-104027": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.25.3
I1109 11:00:19.986860 36410 driver.go:365] Setting default libvirt URI to qemu:///system
I1109 11:00:20.050733 36410 docker.go:137] docker version: linux-20.10.20
I1109 11:00:20.050900 36410 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1109 11:00:20.190738 36410 info.go:266] docker info: {ID:DDH7:AERQ:YR2O:D5QA:GJP7:5WGB:4FTA:645H:2EO7:4YBT:LF5P:55H2 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:62 OomKillDisable:false NGoroutines:53 SystemTime:2022-11-09 19:00:20.10356782 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.15.49-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServe
rAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6231719936 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.20 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:9cd3357b7fd7218e4aec3eae239db1f68a5a6ec6 Expected:9cd3357b7fd7218e4aec3eae239db1f68a5a6ec6} RuncCommit:{ID:v1.1.4-0-g5fd4c4d Expected:v1.1.4-0-g5fd4c4d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default
name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.9.1] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.12.1] map[Name:dev Path:/usr/local/lib/docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.0.3] map[Name:extension Path:/usr/local/lib/docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.13] map[Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/loc
al/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.21.0]] Warnings:<nil>}}
I1109 11:00:20.212501 36410 out.go:177] * Using the docker driver based on user configuration
I1109 11:00:20.234207 36410 start.go:282] selected driver: docker
I1109 11:00:20.234244 36410 start.go:808] validating driver "docker" against <nil>
I1109 11:00:20.234332 36410 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1109 11:00:20.238204 36410 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1109 11:00:20.379819 36410 info.go:266] docker info: {ID:DDH7:AERQ:YR2O:D5QA:GJP7:5WGB:4FTA:645H:2EO7:4YBT:LF5P:55H2 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:62 OomKillDisable:false NGoroutines:53 SystemTime:2022-11-09 19:00:20.291850887 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.15.49-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6231719936 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.20 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:9cd3357b7fd7218e4aec3eae239db1f68a5a6ec6 Expected:9cd3357b7fd7218e4aec3eae239db1f68a5a6ec6} RuncCommit:{ID:v1.1.4-0-g5fd4c4d Expected:v1.1.4-0-g5fd4c4d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defaul
t name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.9.1] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.12.1] map[Name:dev Path:/usr/local/lib/docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.0.3] map[Name:extension Path:/usr/local/lib/docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.13] map[Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/lo
cal/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.21.0]] Warnings:<nil>}}
I1109 11:00:20.379940 36410 start_flags.go:303] no existing cluster config was found, will generate one from the flags
I1109 11:00:20.380100 36410 start_flags.go:901] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1109 11:00:20.401850 36410 out.go:177] * Using Docker Desktop driver with root privileges
I1109 11:00:20.423502 36410 cni.go:95] Creating CNI manager for ""
I1109 11:00:20.423554 36410 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I1109 11:00:20.423573 36410 start_flags.go:317] config:
{Name:old-k8s-version-110019 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.36@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-110019 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocke
t: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet}
I1109 11:00:20.445509 36410 out.go:177] * Starting control plane node old-k8s-version-110019 in cluster old-k8s-version-110019
I1109 11:00:20.466761 36410 cache.go:120] Beginning downloading kic base image for docker with docker
I1109 11:00:20.488285 36410 out.go:177] * Pulling base image ...
I1109 11:00:20.530965 36410 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I1109 11:00:20.530973 36410 image.go:76] Checking for gcr.io/k8s-minikube/kicbase:v0.0.36@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 in local docker daemon
I1109 11:00:20.531056 36410 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/15331-22028/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4
I1109 11:00:20.531083 36410 cache.go:57] Caching tarball of preloaded images
I1109 11:00:20.531873 36410 preload.go:174] Found /Users/jenkins/minikube-integration/15331-22028/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I1109 11:00:20.532038 36410 cache.go:60] Finished verifying existence of preloaded tar for v1.16.0 on docker
I1109 11:00:20.532565 36410 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/config.json ...
I1109 11:00:20.532668 36410 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/config.json: {Name:mk4d65ea59bac74e82d3c1d222a08384b16c273c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1109 11:00:20.588645 36410 image.go:80] Found gcr.io/k8s-minikube/kicbase:v0.0.36@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 in local docker daemon, skipping pull
I1109 11:00:20.588667 36410 cache.go:142] gcr.io/k8s-minikube/kicbase:v0.0.36@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 exists in daemon, skipping load
I1109 11:00:20.588676 36410 cache.go:208] Successfully downloaded all kic artifacts
I1109 11:00:20.588740 36410 start.go:364] acquiring machines lock for old-k8s-version-110019: {Name:mk76b064b5c16d3f79b919264a63d8292ad54339 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1109 11:00:20.588892 36410 start.go:368] acquired machines lock for "old-k8s-version-110019" in 139.567µs
I1109 11:00:20.588929 36410 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-110019 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.36@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-110019 Namespace:default APIServerName:minikubeCA APIServe
rNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fals
e CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I1109 11:00:20.588998 36410 start.go:125] createHost starting for "" (driver="docker")
I1109 11:00:20.632444 36410 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I1109 11:00:20.632855 36410 start.go:159] libmachine.API.Create for "old-k8s-version-110019" (driver="docker")
I1109 11:00:20.632904 36410 client.go:168] LocalClient.Create starting
I1109 11:00:20.633080 36410 main.go:134] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/15331-22028/.minikube/certs/ca.pem
I1109 11:00:20.633175 36410 main.go:134] libmachine: Decoding PEM data...
I1109 11:00:20.633201 36410 main.go:134] libmachine: Parsing certificate...
I1109 11:00:20.633293 36410 main.go:134] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/15331-22028/.minikube/certs/cert.pem
I1109 11:00:20.633363 36410 main.go:134] libmachine: Decoding PEM data...
I1109 11:00:20.633384 36410 main.go:134] libmachine: Parsing certificate...
I1109 11:00:20.634190 36410 cli_runner.go:164] Run: docker network inspect old-k8s-version-110019 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W1109 11:00:20.689214 36410 cli_runner.go:211] docker network inspect old-k8s-version-110019 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I1109 11:00:20.689325 36410 network_create.go:272] running [docker network inspect old-k8s-version-110019] to gather additional debugging logs...
I1109 11:00:20.689349 36410 cli_runner.go:164] Run: docker network inspect old-k8s-version-110019
W1109 11:00:20.743157 36410 cli_runner.go:211] docker network inspect old-k8s-version-110019 returned with exit code 1
I1109 11:00:20.743187 36410 network_create.go:275] error running [docker network inspect old-k8s-version-110019]: docker network inspect old-k8s-version-110019: exit status 1
stdout:
[]
stderr:
Error: No such network: old-k8s-version-110019
I1109 11:00:20.743203 36410 network_create.go:277] output of [docker network inspect old-k8s-version-110019]: -- stdout --
[]
-- /stdout --
** stderr **
Error: No such network: old-k8s-version-110019
** /stderr **
I1109 11:00:20.743311 36410 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1109 11:00:20.798754 36410 network.go:295] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc000d920e0] misses:0}
I1109 11:00:20.798796 36410 network.go:241] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I1109 11:00:20.798810 36410 network_create.go:115] attempt to create docker network old-k8s-version-110019 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I1109 11:00:20.798928 36410 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-110019 old-k8s-version-110019
W1109 11:00:20.853176 36410 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-110019 old-k8s-version-110019 returned with exit code 1
W1109 11:00:20.853219 36410 network_create.go:107] failed to create docker network old-k8s-version-110019 192.168.49.0/24, will retry: subnet is taken
I1109 11:00:20.853479 36410 network.go:286] skipping subnet 192.168.49.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000d920e0] amended:false}} dirty:map[] misses:0}
I1109 11:00:20.853497 36410 network.go:244] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I1109 11:00:20.853705 36410 network.go:295] reserving subnet 192.168.58.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000d920e0] amended:true}} dirty:map[192.168.49.0:0xc000d920e0 192.168.58.0:0xc000ac2b50] misses:0}
I1109 11:00:20.853718 36410 network.go:241] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I1109 11:00:20.853726 36410 network_create.go:115] attempt to create docker network old-k8s-version-110019 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ...
I1109 11:00:20.853810 36410 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-110019 old-k8s-version-110019
W1109 11:00:20.907590 36410 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-110019 old-k8s-version-110019 returned with exit code 1
W1109 11:00:20.907629 36410 network_create.go:107] failed to create docker network old-k8s-version-110019 192.168.58.0/24, will retry: subnet is taken
I1109 11:00:20.907877 36410 network.go:286] skipping subnet 192.168.58.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000d920e0] amended:true}} dirty:map[192.168.49.0:0xc000d920e0 192.168.58.0:0xc000ac2b50] misses:1}
I1109 11:00:20.907895 36410 network.go:244] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I1109 11:00:20.908095 36410 network.go:295] reserving subnet 192.168.67.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000d920e0] amended:true}} dirty:map[192.168.49.0:0xc000d920e0 192.168.58.0:0xc000ac2b50 192.168.67.0:0xc000d92118] misses:1}
I1109 11:00:20.908106 36410 network.go:241] using free private subnet 192.168.67.0/24: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I1109 11:00:20.908112 36410 network_create.go:115] attempt to create docker network old-k8s-version-110019 192.168.67.0/24 with gateway 192.168.67.1 and MTU of 1500 ...
I1109 11:00:20.908203 36410 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-110019 old-k8s-version-110019
I1109 11:00:20.995096 36410 network_create.go:99] docker network old-k8s-version-110019 192.168.67.0/24 created
I1109 11:00:20.995142 36410 kic.go:106] calculated static IP "192.168.67.2" for the "old-k8s-version-110019" container
I1109 11:00:20.995277 36410 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I1109 11:00:21.051732 36410 cli_runner.go:164] Run: docker volume create old-k8s-version-110019 --label name.minikube.sigs.k8s.io=old-k8s-version-110019 --label created_by.minikube.sigs.k8s.io=true
I1109 11:00:21.107380 36410 oci.go:103] Successfully created a docker volume old-k8s-version-110019
I1109 11:00:21.107510 36410 cli_runner.go:164] Run: docker run --rm --name old-k8s-version-110019-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-110019 --entrypoint /usr/bin/test -v old-k8s-version-110019:/var gcr.io/k8s-minikube/kicbase:v0.0.36@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 -d /var/lib
I1109 11:00:21.543603 36410 oci.go:107] Successfully prepared a docker volume old-k8s-version-110019
I1109 11:00:21.543642 36410 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I1109 11:00:21.543657 36410 kic.go:179] Starting extracting preloaded images to volume ...
I1109 11:00:21.543791 36410 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/15331-22028/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-110019:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.36@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 -I lz4 -xf /preloaded.tar -C /extractDir
I1109 11:00:25.561690 36410 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/15331-22028/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-110019:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.36@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 -I lz4 -xf /preloaded.tar -C /extractDir: (4.017888244s)
I1109 11:00:25.561709 36410 kic.go:188] duration metric: took 4.018088 seconds to extract preloaded images to volume
I1109 11:00:25.561834 36410 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I1109 11:00:25.702022 36410 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname old-k8s-version-110019 --name old-k8s-version-110019 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-110019 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=old-k8s-version-110019 --network old-k8s-version-110019 --ip 192.168.67.2 --volume old-k8s-version-110019:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=8443 --publish=22 --publish=2376 --publish=5000 --publish=32443 gcr.io/k8s-minikube/kicbase:v0.0.36@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456
I1109 11:00:26.053921 36410 cli_runner.go:164] Run: docker container inspect old-k8s-version-110019 --format={{.State.Running}}
I1109 11:00:26.112654 36410 cli_runner.go:164] Run: docker container inspect old-k8s-version-110019 --format={{.State.Status}}
I1109 11:00:26.173742 36410 cli_runner.go:164] Run: docker exec old-k8s-version-110019 stat /var/lib/dpkg/alternatives/iptables
I1109 11:00:26.286100 36410 oci.go:144] the created container "old-k8s-version-110019" has a running status.
I1109 11:00:26.286594 36410 kic.go:210] Creating ssh key for kic: /Users/jenkins/minikube-integration/15331-22028/.minikube/machines/old-k8s-version-110019/id_rsa...
I1109 11:00:26.380051 36410 kic_runner.go:191] docker (temp): /Users/jenkins/minikube-integration/15331-22028/.minikube/machines/old-k8s-version-110019/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I1109 11:00:26.485054 36410 cli_runner.go:164] Run: docker container inspect old-k8s-version-110019 --format={{.State.Status}}
I1109 11:00:26.543883 36410 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I1109 11:00:26.543901 36410 kic_runner.go:114] Args: [docker exec --privileged old-k8s-version-110019 chown docker:docker /home/docker/.ssh/authorized_keys]
I1109 11:00:26.661696 36410 cli_runner.go:164] Run: docker container inspect old-k8s-version-110019 --format={{.State.Status}}
I1109 11:00:26.719009 36410 machine.go:88] provisioning docker machine ...
I1109 11:00:26.719047 36410 ubuntu.go:169] provisioning hostname "old-k8s-version-110019"
I1109 11:00:26.719164 36410 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-110019
I1109 11:00:26.775869 36410 main.go:134] libmachine: Using SSH client type: native
I1109 11:00:26.776058 36410 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13e6d00] 0x13e9e80 <nil> [] 0s} 127.0.0.1 64998 <nil> <nil>}
I1109 11:00:26.776074 36410 main.go:134] libmachine: About to run SSH command:
sudo hostname old-k8s-version-110019 && echo "old-k8s-version-110019" | sudo tee /etc/hostname
I1109 11:00:26.900105 36410 main.go:134] libmachine: SSH cmd err, output: <nil>: old-k8s-version-110019
I1109 11:00:26.900233 36410 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-110019
I1109 11:00:26.957668 36410 main.go:134] libmachine: Using SSH client type: native
I1109 11:00:26.957843 36410 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13e6d00] 0x13e9e80 <nil> [] 0s} 127.0.0.1 64998 <nil> <nil>}
I1109 11:00:26.957858 36410 main.go:134] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-110019' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-110019/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-110019' | sudo tee -a /etc/hosts;
fi
fi
I1109 11:00:27.073472 36410 main.go:134] libmachine: SSH cmd err, output: <nil>:
I1109 11:00:27.073492 36410 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/15331-22028/.minikube CaCertPath:/Users/jenkins/minikube-integration/15331-22028/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/15331-22028/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/15331-22028/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/15331-22028/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/15331-22028/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/15331-22028/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/15331-22028/.minikube}
I1109 11:00:27.073512 36410 ubuntu.go:177] setting up certificates
I1109 11:00:27.073519 36410 provision.go:83] configureAuth start
I1109 11:00:27.073616 36410 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-110019
I1109 11:00:27.130664 36410 provision.go:138] copyHostCerts
I1109 11:00:27.130758 36410 exec_runner.go:144] found /Users/jenkins/minikube-integration/15331-22028/.minikube/cert.pem, removing ...
I1109 11:00:27.130766 36410 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15331-22028/.minikube/cert.pem
I1109 11:00:27.130891 36410 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15331-22028/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/15331-22028/.minikube/cert.pem (1123 bytes)
I1109 11:00:27.131126 36410 exec_runner.go:144] found /Users/jenkins/minikube-integration/15331-22028/.minikube/key.pem, removing ...
I1109 11:00:27.131133 36410 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15331-22028/.minikube/key.pem
I1109 11:00:27.131201 36410 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15331-22028/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/15331-22028/.minikube/key.pem (1675 bytes)
I1109 11:00:27.131358 36410 exec_runner.go:144] found /Users/jenkins/minikube-integration/15331-22028/.minikube/ca.pem, removing ...
I1109 11:00:27.131366 36410 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15331-22028/.minikube/ca.pem
I1109 11:00:27.131436 36410 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15331-22028/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/15331-22028/.minikube/ca.pem (1082 bytes)
I1109 11:00:27.131567 36410 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/15331-22028/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/15331-22028/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/15331-22028/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-110019 san=[192.168.67.2 127.0.0.1 localhost 127.0.0.1 minikube old-k8s-version-110019]
I1109 11:00:27.246800 36410 provision.go:172] copyRemoteCerts
I1109 11:00:27.246878 36410 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1109 11:00:27.246940 36410 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-110019
I1109 11:00:27.303298 36410 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:64998 SSHKeyPath:/Users/jenkins/minikube-integration/15331-22028/.minikube/machines/old-k8s-version-110019/id_rsa Username:docker}
I1109 11:00:27.389428 36410 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15331-22028/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I1109 11:00:27.407161 36410 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15331-22028/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
I1109 11:00:27.424121 36410 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15331-22028/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I1109 11:00:27.441244 36410 provision.go:86] duration metric: configureAuth took 367.714258ms
I1109 11:00:27.441256 36410 ubuntu.go:193] setting minikube options for container-runtime
I1109 11:00:27.441412 36410 config.go:180] Loaded profile config "old-k8s-version-110019": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
I1109 11:00:27.441489 36410 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-110019
I1109 11:00:27.498636 36410 main.go:134] libmachine: Using SSH client type: native
I1109 11:00:27.498809 36410 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13e6d00] 0x13e9e80 <nil> [] 0s} 127.0.0.1 64998 <nil> <nil>}
I1109 11:00:27.498825 36410 main.go:134] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I1109 11:00:27.616474 36410 main.go:134] libmachine: SSH cmd err, output: <nil>: overlay
I1109 11:00:27.616487 36410 ubuntu.go:71] root file system type: overlay
I1109 11:00:27.616610 36410 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I1109 11:00:27.616704 36410 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-110019
I1109 11:00:27.674021 36410 main.go:134] libmachine: Using SSH client type: native
I1109 11:00:27.674181 36410 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13e6d00] 0x13e9e80 <nil> [] 0s} 127.0.0.1 64998 <nil> <nil>}
I1109 11:00:27.674230 36410 main.go:134] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I1109 11:00:27.801503 36410 main.go:134] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I1109 11:00:27.801626 36410 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-110019
I1109 11:00:27.859782 36410 main.go:134] libmachine: Using SSH client type: native
I1109 11:00:27.859948 36410 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13e6d00] 0x13e9e80 <nil> [] 0s} 127.0.0.1 64998 <nil> <nil>}
I1109 11:00:27.859962 36410 main.go:134] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I1109 11:00:28.461618 36410 main.go:134] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2022-10-18 18:18:12.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2022-11-09 19:00:27.808058757 +0000
@@ -1,30 +1,32 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
Wants=network-online.target
-Requires=docker.socket containerd.service
+Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutSec=0
-RestartSec=2
-Restart=always
-
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
+Restart=on-failure
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
@@ -32,16 +34,16 @@
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I1109 11:00:28.461638 36410 machine.go:91] provisioned docker machine in 1.742628395s
I1109 11:00:28.461645 36410 client.go:171] LocalClient.Create took 7.828806908s
I1109 11:00:28.461663 36410 start.go:167] duration metric: libmachine.API.Create for "old-k8s-version-110019" took 7.828886706s
I1109 11:00:28.461673 36410 start.go:300] post-start starting for "old-k8s-version-110019" (driver="docker")
I1109 11:00:28.461677 36410 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1109 11:00:28.461754 36410 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1109 11:00:28.461824 36410 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-110019
I1109 11:00:28.522074 36410 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:64998 SSHKeyPath:/Users/jenkins/minikube-integration/15331-22028/.minikube/machines/old-k8s-version-110019/id_rsa Username:docker}
I1109 11:00:28.610827 36410 ssh_runner.go:195] Run: cat /etc/os-release
I1109 11:00:28.614416 36410 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I1109 11:00:28.614433 36410 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1109 11:00:28.614440 36410 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I1109 11:00:28.614445 36410 info.go:137] Remote host: Ubuntu 20.04.5 LTS
I1109 11:00:28.614455 36410 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15331-22028/.minikube/addons for local assets ...
I1109 11:00:28.614551 36410 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15331-22028/.minikube/files for local assets ...
I1109 11:00:28.614733 36410 filesync.go:149] local asset: /Users/jenkins/minikube-integration/15331-22028/.minikube/files/etc/ssl/certs/228682.pem -> 228682.pem in /etc/ssl/certs
I1109 11:00:28.614944 36410 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1109 11:00:28.622174 36410 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15331-22028/.minikube/files/etc/ssl/certs/228682.pem --> /etc/ssl/certs/228682.pem (1708 bytes)
I1109 11:00:28.641958 36410 start.go:303] post-start completed in 180.276841ms
I1109 11:00:28.642520 36410 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-110019
I1109 11:00:28.701871 36410 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/config.json ...
I1109 11:00:28.702338 36410 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1109 11:00:28.702403 36410 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-110019
I1109 11:00:28.759551 36410 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:64998 SSHKeyPath:/Users/jenkins/minikube-integration/15331-22028/.minikube/machines/old-k8s-version-110019/id_rsa Username:docker}
I1109 11:00:28.844772 36410 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1109 11:00:28.849005 36410 start.go:128] duration metric: createHost completed in 8.260066193s
I1109 11:00:28.849024 36410 start.go:83] releasing machines lock for "old-k8s-version-110019", held for 8.260198544s
I1109 11:00:28.849135 36410 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-110019
I1109 11:00:28.905951 36410 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
I1109 11:00:28.905986 36410 ssh_runner.go:195] Run: systemctl --version
I1109 11:00:28.906046 36410 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-110019
I1109 11:00:28.906054 36410 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-110019
I1109 11:00:28.970699 36410 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:64998 SSHKeyPath:/Users/jenkins/minikube-integration/15331-22028/.minikube/machines/old-k8s-version-110019/id_rsa Username:docker}
I1109 11:00:28.970806 36410 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:64998 SSHKeyPath:/Users/jenkins/minikube-integration/15331-22028/.minikube/machines/old-k8s-version-110019/id_rsa Username:docker}
I1109 11:00:29.054576 36410 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I1109 11:00:29.302725 36410 cruntime.go:273] skipping containerd shutdown because we are bound to it
I1109 11:00:29.302793 36410 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1109 11:00:29.313417 36410 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
image-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I1109 11:00:29.327787 36410 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I1109 11:00:29.398158 36410 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I1109 11:00:29.475103 36410 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1109 11:00:29.552580 36410 ssh_runner.go:195] Run: sudo systemctl restart docker
I1109 11:00:29.781601 36410 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I1109 11:00:29.817569 36410 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I1109 11:00:29.900063 36410 out.go:204] * Preparing Kubernetes v1.16.0 on Docker 20.10.20 ...
I1109 11:00:29.900279 36410 cli_runner.go:164] Run: docker exec -t old-k8s-version-110019 dig +short host.docker.internal
I1109 11:00:30.167736 36410 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2
I1109 11:00:30.167846 36410 ssh_runner.go:195] Run: grep 192.168.65.2 host.minikube.internal$ /etc/hosts
I1109 11:00:30.172184 36410 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1109 11:00:30.182167 36410 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-110019
I1109 11:00:30.240750 36410 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I1109 11:00:30.240856 36410 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I1109 11:00:30.266504 36410 docker.go:613] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I1109 11:00:30.266525 36410 docker.go:543] Images already preloaded, skipping extraction
I1109 11:00:30.266612 36410 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I1109 11:00:30.291041 36410 docker.go:613] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I1109 11:00:30.291059 36410 cache_images.go:84] Images are preloaded, skipping loading
I1109 11:00:30.291156 36410 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I1109 11:00:30.362433 36410 cni.go:95] Creating CNI manager for ""
I1109 11:00:30.362448 36410 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I1109 11:00:30.362463 36410 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I1109 11:00:30.362510 36410 kubeadm.go:156] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.67.2 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-110019 NodeName:old-k8s-version-110019 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.67.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.67.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false}
I1109 11:00:30.362609 36410 kubeadm.go:161] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.67.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-110019"
kubeletExtraArgs:
node-ip: 192.168.67.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.67.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-110019
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.67.2:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1109 11:00:30.362684 36410 kubeadm.go:962] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-110019 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.67.2
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-110019 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I1109 11:00:30.362760 36410 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I1109 11:00:30.371813 36410 binaries.go:44] Found k8s binaries, skipping transfer
I1109 11:00:30.371889 36410 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1109 11:00:30.379595 36410 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (348 bytes)
I1109 11:00:30.395650 36410 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1109 11:00:30.410734 36410 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I1109 11:00:30.424624 36410 ssh_runner.go:195] Run: grep 192.168.67.2 control-plane.minikube.internal$ /etc/hosts
I1109 11:00:30.428756 36410 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.67.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1109 11:00:30.440197 36410 certs.go:54] Setting up /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019 for IP: 192.168.67.2
I1109 11:00:30.440339 36410 certs.go:182] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/15331-22028/.minikube/ca.key
I1109 11:00:30.440413 36410 certs.go:182] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/15331-22028/.minikube/proxy-client-ca.key
I1109 11:00:30.440472 36410 certs.go:302] generating minikube-user signed cert: /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/client.key
I1109 11:00:30.440498 36410 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/client.crt with IP's: []
I1109 11:00:30.705147 36410 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/client.crt ...
I1109 11:00:30.705167 36410 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/client.crt: {Name:mk6371bb2e27e57c32f2d270508013ce6c6ee368 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1109 11:00:30.719919 36410 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/client.key ...
I1109 11:00:30.719969 36410 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/client.key: {Name:mk4e7947bf778084497182a882a303b2d23178f9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1109 11:00:30.758037 36410 certs.go:302] generating minikube signed cert: /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/apiserver.key.c7fa3a9e
I1109 11:00:30.758104 36410 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/apiserver.crt.c7fa3a9e with IP's: [192.168.67.2 10.96.0.1 127.0.0.1 10.0.0.1]
I1109 11:00:30.906458 36410 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/apiserver.crt.c7fa3a9e ...
I1109 11:00:30.906470 36410 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/apiserver.crt.c7fa3a9e: {Name:mk9a32a67871f8ad1974a164b2423c6aeec75d30 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1109 11:00:30.923569 36410 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/apiserver.key.c7fa3a9e ...
I1109 11:00:30.923598 36410 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/apiserver.key.c7fa3a9e: {Name:mk75032cfe1d394653b8cee626c1f97c42cb21bd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1109 11:00:30.924153 36410 certs.go:320] copying /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/apiserver.crt.c7fa3a9e -> /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/apiserver.crt
I1109 11:00:30.924467 36410 certs.go:324] copying /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/apiserver.key.c7fa3a9e -> /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/apiserver.key
I1109 11:00:30.924794 36410 certs.go:302] generating aggregator signed cert: /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/proxy-client.key
I1109 11:00:30.924857 36410 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/proxy-client.crt with IP's: []
I1109 11:00:31.107424 36410 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/proxy-client.crt ...
I1109 11:00:31.107442 36410 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/proxy-client.crt: {Name:mk16590090115f79bc6becbf30a8a45dd1ba3411 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1109 11:00:31.107821 36410 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/proxy-client.key ...
I1109 11:00:31.107831 36410 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/proxy-client.key: {Name:mk4f0c1f0c08231469bb59db7735f78a0f361ba4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1109 11:00:31.108321 36410 certs.go:388] found cert: /Users/jenkins/minikube-integration/15331-22028/.minikube/certs/Users/jenkins/minikube-integration/15331-22028/.minikube/certs/22868.pem (1338 bytes)
W1109 11:00:31.108383 36410 certs.go:384] ignoring /Users/jenkins/minikube-integration/15331-22028/.minikube/certs/Users/jenkins/minikube-integration/15331-22028/.minikube/certs/22868_empty.pem, impossibly tiny 0 bytes
I1109 11:00:31.108400 36410 certs.go:388] found cert: /Users/jenkins/minikube-integration/15331-22028/.minikube/certs/Users/jenkins/minikube-integration/15331-22028/.minikube/certs/ca-key.pem (1675 bytes)
I1109 11:00:31.108447 36410 certs.go:388] found cert: /Users/jenkins/minikube-integration/15331-22028/.minikube/certs/Users/jenkins/minikube-integration/15331-22028/.minikube/certs/ca.pem (1082 bytes)
I1109 11:00:31.108491 36410 certs.go:388] found cert: /Users/jenkins/minikube-integration/15331-22028/.minikube/certs/Users/jenkins/minikube-integration/15331-22028/.minikube/certs/cert.pem (1123 bytes)
I1109 11:00:31.108530 36410 certs.go:388] found cert: /Users/jenkins/minikube-integration/15331-22028/.minikube/certs/Users/jenkins/minikube-integration/15331-22028/.minikube/certs/key.pem (1675 bytes)
I1109 11:00:31.108629 36410 certs.go:388] found cert: /Users/jenkins/minikube-integration/15331-22028/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/15331-22028/.minikube/files/etc/ssl/certs/228682.pem (1708 bytes)
I1109 11:00:31.109780 36410 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I1109 11:00:31.131270 36410 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1109 11:00:31.148325 36410 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1109 11:00:31.165325 36410 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15331-22028/.minikube/profiles/old-k8s-version-110019/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1109 11:00:31.182645 36410 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15331-22028/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1109 11:00:31.202980 36410 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15331-22028/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I1109 11:00:31.220294 36410 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15331-22028/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1109 11:00:31.238664 36410 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15331-22028/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I1109 11:00:31.257106 36410 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15331-22028/.minikube/certs/22868.pem --> /usr/share/ca-certificates/22868.pem (1338 bytes)
I1109 11:00:31.276195 36410 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15331-22028/.minikube/files/etc/ssl/certs/228682.pem --> /usr/share/ca-certificates/228682.pem (1708 bytes)
I1109 11:00:31.293542 36410 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15331-22028/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1109 11:00:31.310426 36410 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1109 11:00:31.323354 36410 ssh_runner.go:195] Run: openssl version
I1109 11:00:31.340348 36410 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/22868.pem && ln -fs /usr/share/ca-certificates/22868.pem /etc/ssl/certs/22868.pem"
I1109 11:00:31.348559 36410 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/22868.pem
I1109 11:00:31.352419 36410 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Nov 9 18:08 /usr/share/ca-certificates/22868.pem
I1109 11:00:31.352468 36410 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/22868.pem
I1109 11:00:31.357865 36410 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/22868.pem /etc/ssl/certs/51391683.0"
I1109 11:00:31.365728 36410 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/228682.pem && ln -fs /usr/share/ca-certificates/228682.pem /etc/ssl/certs/228682.pem"
I1109 11:00:31.373475 36410 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/228682.pem
I1109 11:00:31.378601 36410 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Nov 9 18:08 /usr/share/ca-certificates/228682.pem
I1109 11:00:31.378645 36410 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/228682.pem
I1109 11:00:31.383892 36410 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/228682.pem /etc/ssl/certs/3ec20f2e.0"
I1109 11:00:31.392073 36410 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1109 11:00:31.400096 36410 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1109 11:00:31.405343 36410 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Nov 9 18:04 /usr/share/ca-certificates/minikubeCA.pem
I1109 11:00:31.405410 36410 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1109 11:00:31.411950 36410 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1109 11:00:31.419450 36410 kubeadm.go:396] StartCluster: {Name:old-k8s-version-110019 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.36@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-110019 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs
:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQe
muFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet}
I1109 11:00:31.419575 36410 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I1109 11:00:31.441674 36410 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1109 11:00:31.449556 36410 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1109 11:00:31.456748 36410 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I1109 11:00:31.456811 36410 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1109 11:00:31.463874 36410 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1109 11:00:31.463904 36410 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I1109 11:00:31.511245 36410 kubeadm.go:317] [init] Using Kubernetes version: v1.16.0
I1109 11:00:31.511402 36410 kubeadm.go:317] [preflight] Running pre-flight checks
I1109 11:00:31.820041 36410 kubeadm.go:317] [preflight] Pulling images required for setting up a Kubernetes cluster
I1109 11:00:31.820152 36410 kubeadm.go:317] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1109 11:00:31.820266 36410 kubeadm.go:317] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I1109 11:00:32.046395 36410 kubeadm.go:317] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1109 11:00:32.048484 36410 kubeadm.go:317] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1109 11:00:32.055786 36410 kubeadm.go:317] [kubelet-start] Activating the kubelet service
I1109 11:00:32.128817 36410 kubeadm.go:317] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1109 11:00:32.170550 36410 out.go:204] - Generating certificates and keys ...
I1109 11:00:32.170643 36410 kubeadm.go:317] [certs] Using existing ca certificate authority
I1109 11:00:32.170704 36410 kubeadm.go:317] [certs] Using existing apiserver certificate and key on disk
I1109 11:00:32.222440 36410 kubeadm.go:317] [certs] Generating "apiserver-kubelet-client" certificate and key
I1109 11:00:32.284862 36410 kubeadm.go:317] [certs] Generating "front-proxy-ca" certificate and key
I1109 11:00:32.444382 36410 kubeadm.go:317] [certs] Generating "front-proxy-client" certificate and key
I1109 11:00:32.606261 36410 kubeadm.go:317] [certs] Generating "etcd/ca" certificate and key
I1109 11:00:32.914389 36410 kubeadm.go:317] [certs] Generating "etcd/server" certificate and key
I1109 11:00:32.914511 36410 kubeadm.go:317] [certs] etcd/server serving cert is signed for DNS names [old-k8s-version-110019 localhost] and IPs [192.168.67.2 127.0.0.1 ::1]
I1109 11:00:33.122458 36410 kubeadm.go:317] [certs] Generating "etcd/peer" certificate and key
I1109 11:00:33.122623 36410 kubeadm.go:317] [certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-110019 localhost] and IPs [192.168.67.2 127.0.0.1 ::1]
I1109 11:00:33.218723 36410 kubeadm.go:317] [certs] Generating "etcd/healthcheck-client" certificate and key
I1109 11:00:33.384220 36410 kubeadm.go:317] [certs] Generating "apiserver-etcd-client" certificate and key
I1109 11:00:33.552094 36410 kubeadm.go:317] [certs] Generating "sa" key and public key
I1109 11:00:33.552152 36410 kubeadm.go:317] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1109 11:00:33.752238 36410 kubeadm.go:317] [kubeconfig] Writing "admin.conf" kubeconfig file
I1109 11:00:33.992471 36410 kubeadm.go:317] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1109 11:00:34.120109 36410 kubeadm.go:317] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1109 11:00:34.341620 36410 kubeadm.go:317] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1109 11:00:34.342220 36410 kubeadm.go:317] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1109 11:00:34.365694 36410 out.go:204] - Booting up control plane ...
I1109 11:00:34.365829 36410 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1109 11:00:34.365947 36410 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1109 11:00:34.366074 36410 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1109 11:00:34.366141 36410 kubeadm.go:317] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1109 11:00:34.366282 36410 kubeadm.go:317] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I1109 11:01:14.323706 36410 kubeadm.go:317] [kubelet-check] Initial timeout of 40s passed.
I1109 11:01:14.324585 36410 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1109 11:01:14.324811 36410 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1109 11:01:19.322901 36410 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1109 11:01:19.323153 36410 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1109 11:01:29.316612 36410 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1109 11:01:29.316897 36410 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1109 11:01:49.303835 36410 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1109 11:01:49.304100 36410 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1109 11:02:29.276086 36410 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1109 11:02:29.276284 36410 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1109 11:02:29.276299 36410 kubeadm.go:317]
I1109 11:02:29.276336 36410 kubeadm.go:317] Unfortunately, an error has occurred:
I1109 11:02:29.276379 36410 kubeadm.go:317] timed out waiting for the condition
I1109 11:02:29.276385 36410 kubeadm.go:317]
I1109 11:02:29.276419 36410 kubeadm.go:317] This error is likely caused by:
I1109 11:02:29.276448 36410 kubeadm.go:317] - The kubelet is not running
I1109 11:02:29.276574 36410 kubeadm.go:317] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I1109 11:02:29.276591 36410 kubeadm.go:317]
I1109 11:02:29.276685 36410 kubeadm.go:317] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I1109 11:02:29.276719 36410 kubeadm.go:317] - 'systemctl status kubelet'
I1109 11:02:29.276748 36410 kubeadm.go:317] - 'journalctl -xeu kubelet'
I1109 11:02:29.276753 36410 kubeadm.go:317]
I1109 11:02:29.276867 36410 kubeadm.go:317] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I1109 11:02:29.276996 36410 kubeadm.go:317] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I1109 11:02:29.277089 36410 kubeadm.go:317] Here is one example how you may list all Kubernetes containers running in docker:
I1109 11:02:29.277138 36410 kubeadm.go:317] - 'docker ps -a | grep kube | grep -v pause'
I1109 11:02:29.277229 36410 kubeadm.go:317] Once you have found the failing container, you can inspect its logs with:
I1109 11:02:29.277279 36410 kubeadm.go:317] - 'docker logs CONTAINERID'
I1109 11:02:29.280163 36410 kubeadm.go:317] [WARNING Swap]: running with swap on is not supported. Please disable swap
I1109 11:02:29.280280 36410 kubeadm.go:317] [WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
I1109 11:02:29.280360 36410 kubeadm.go:317] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1109 11:02:29.280419 36410 kubeadm.go:317] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I1109 11:02:29.280470 36410 kubeadm.go:317] To see the stack trace of this error execute with --v=5 or higher
W1109 11:02:29.280627 36410 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-110019 localhost] and IPs [192.168.67.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-110019 localhost] and IPs [192.168.67.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-110019 localhost] and IPs [192.168.67.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-110019 localhost] and IPs [192.168.67.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I1109 11:02:29.280655 36410 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"
I1109 11:02:29.695646 36410 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1109 11:02:29.705475 36410 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I1109 11:02:29.705545 36410 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1109 11:02:29.712921 36410 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1109 11:02:29.712939 36410 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I1109 11:02:29.759738 36410 kubeadm.go:317] [init] Using Kubernetes version: v1.16.0
I1109 11:02:29.759795 36410 kubeadm.go:317] [preflight] Running pre-flight checks
I1109 11:02:30.048319 36410 kubeadm.go:317] [preflight] Pulling images required for setting up a Kubernetes cluster
I1109 11:02:30.048406 36410 kubeadm.go:317] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1109 11:02:30.048490 36410 kubeadm.go:317] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I1109 11:02:30.270662 36410 kubeadm.go:317] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1109 11:02:30.271559 36410 kubeadm.go:317] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1109 11:02:30.278002 36410 kubeadm.go:317] [kubelet-start] Activating the kubelet service
I1109 11:02:30.338569 36410 kubeadm.go:317] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1109 11:02:30.360056 36410 out.go:204] - Generating certificates and keys ...
I1109 11:02:30.360148 36410 kubeadm.go:317] [certs] Using existing ca certificate authority
I1109 11:02:30.360234 36410 kubeadm.go:317] [certs] Using existing apiserver certificate and key on disk
I1109 11:02:30.360333 36410 kubeadm.go:317] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I1109 11:02:30.360407 36410 kubeadm.go:317] [certs] Using existing front-proxy-ca certificate authority
I1109 11:02:30.360461 36410 kubeadm.go:317] [certs] Using existing front-proxy-client certificate and key on disk
I1109 11:02:30.360507 36410 kubeadm.go:317] [certs] Using existing etcd/ca certificate authority
I1109 11:02:30.360566 36410 kubeadm.go:317] [certs] Using existing etcd/server certificate and key on disk
I1109 11:02:30.360611 36410 kubeadm.go:317] [certs] Using existing etcd/peer certificate and key on disk
I1109 11:02:30.360674 36410 kubeadm.go:317] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I1109 11:02:30.360741 36410 kubeadm.go:317] [certs] Using existing apiserver-etcd-client certificate and key on disk
I1109 11:02:30.360803 36410 kubeadm.go:317] [certs] Using the existing "sa" key
I1109 11:02:30.360853 36410 kubeadm.go:317] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1109 11:02:30.542709 36410 kubeadm.go:317] [kubeconfig] Writing "admin.conf" kubeconfig file
I1109 11:02:30.650636 36410 kubeadm.go:317] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1109 11:02:30.750737 36410 kubeadm.go:317] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1109 11:02:31.080172 36410 kubeadm.go:317] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1109 11:02:31.080645 36410 kubeadm.go:317] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1109 11:02:31.102088 36410 out.go:204] - Booting up control plane ...
I1109 11:02:31.102274 36410 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1109 11:02:31.102420 36410 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1109 11:02:31.102562 36410 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1109 11:02:31.102748 36410 kubeadm.go:317] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1109 11:02:31.102976 36410 kubeadm.go:317] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I1109 11:03:11.060440 36410 kubeadm.go:317] [kubelet-check] Initial timeout of 40s passed.
I1109 11:03:11.061368 36410 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1109 11:03:11.061578 36410 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1109 11:03:16.059004 36410 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1109 11:03:16.059220 36410 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1109 11:03:26.052940 36410 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1109 11:03:26.053202 36410 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1109 11:03:46.040522 36410 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1109 11:03:46.040759 36410 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1109 11:04:26.013675 36410 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1109 11:04:26.013905 36410 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1109 11:04:26.013919 36410 kubeadm.go:317]
I1109 11:04:26.013966 36410 kubeadm.go:317] Unfortunately, an error has occurred:
I1109 11:04:26.014013 36410 kubeadm.go:317] timed out waiting for the condition
I1109 11:04:26.014021 36410 kubeadm.go:317]
I1109 11:04:26.014055 36410 kubeadm.go:317] This error is likely caused by:
I1109 11:04:26.014087 36410 kubeadm.go:317] - The kubelet is not running
I1109 11:04:26.014219 36410 kubeadm.go:317] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I1109 11:04:26.014237 36410 kubeadm.go:317]
I1109 11:04:26.014352 36410 kubeadm.go:317] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I1109 11:04:26.014388 36410 kubeadm.go:317] - 'systemctl status kubelet'
I1109 11:04:26.014435 36410 kubeadm.go:317] - 'journalctl -xeu kubelet'
I1109 11:04:26.014452 36410 kubeadm.go:317]
I1109 11:04:26.014582 36410 kubeadm.go:317] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I1109 11:04:26.014696 36410 kubeadm.go:317] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I1109 11:04:26.014805 36410 kubeadm.go:317] Here is one example how you may list all Kubernetes containers running in docker:
I1109 11:04:26.014861 36410 kubeadm.go:317] - 'docker ps -a | grep kube | grep -v pause'
I1109 11:04:26.014937 36410 kubeadm.go:317] Once you have found the failing container, you can inspect its logs with:
I1109 11:04:26.014969 36410 kubeadm.go:317] - 'docker logs CONTAINERID'
I1109 11:04:26.017489 36410 kubeadm.go:317] [WARNING Swap]: running with swap on is not supported. Please disable swap
I1109 11:04:26.017601 36410 kubeadm.go:317] [WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
I1109 11:04:26.017687 36410 kubeadm.go:317] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1109 11:04:26.017753 36410 kubeadm.go:317] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I1109 11:04:26.017819 36410 kubeadm.go:317] To see the stack trace of this error execute with --v=5 or higher
I1109 11:04:26.017872 36410 kubeadm.go:398] StartCluster complete in 3m54.6005799s
I1109 11:04:26.017971 36410 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I1109 11:04:26.040099 36410 logs.go:274] 0 containers: []
W1109 11:04:26.040111 36410 logs.go:276] No container was found matching "kube-apiserver"
I1109 11:04:26.040196 36410 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I1109 11:04:26.061764 36410 logs.go:274] 0 containers: []
W1109 11:04:26.061775 36410 logs.go:276] No container was found matching "etcd"
I1109 11:04:26.061856 36410 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I1109 11:04:26.083359 36410 logs.go:274] 0 containers: []
W1109 11:04:26.083371 36410 logs.go:276] No container was found matching "coredns"
I1109 11:04:26.083456 36410 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I1109 11:04:26.106807 36410 logs.go:274] 0 containers: []
W1109 11:04:26.106818 36410 logs.go:276] No container was found matching "kube-scheduler"
I1109 11:04:26.106904 36410 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I1109 11:04:26.128896 36410 logs.go:274] 0 containers: []
W1109 11:04:26.128908 36410 logs.go:276] No container was found matching "kube-proxy"
I1109 11:04:26.128988 36410 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I1109 11:04:26.152056 36410 logs.go:274] 0 containers: []
W1109 11:04:26.152066 36410 logs.go:276] No container was found matching "kubernetes-dashboard"
I1109 11:04:26.152150 36410 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I1109 11:04:26.174432 36410 logs.go:274] 0 containers: []
W1109 11:04:26.174458 36410 logs.go:276] No container was found matching "storage-provisioner"
I1109 11:04:26.174545 36410 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I1109 11:04:26.196120 36410 logs.go:274] 0 containers: []
W1109 11:04:26.196133 36410 logs.go:276] No container was found matching "kube-controller-manager"
I1109 11:04:26.196139 36410 logs.go:123] Gathering logs for kubelet ...
I1109 11:04:26.196146 36410 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1109 11:04:26.235846 36410 logs.go:123] Gathering logs for dmesg ...
I1109 11:04:26.235869 36410 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1109 11:04:26.252698 36410 logs.go:123] Gathering logs for describe nodes ...
I1109 11:04:26.252716 36410 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1109 11:04:26.315213 36410 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1109 11:04:26.315225 36410 logs.go:123] Gathering logs for Docker ...
I1109 11:04:26.315231 36410 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400"
I1109 11:04:26.332623 36410 logs.go:123] Gathering logs for container status ...
I1109 11:04:26.332636 36410 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1109 11:04:28.380428 36410 ssh_runner.go:235] Completed: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": (2.047799415s)
W1109 11:04:28.380541 36410 out.go:369] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W1109 11:04:28.380556 36410 out.go:239] *
*
W1109 11:04:28.380675 36410 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W1109 11:04:28.380690 36410 out.go:239] *
*
W1109 11:04:28.381393 36410 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1109 11:04:28.446940 36410 out.go:177]
W1109 11:04:28.489061 36410 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W1109 11:04:28.489151 36410 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W1109 11:04:28.489204 36410 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I1109 11:04:28.548932 36410 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p old-k8s-version-110019 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-110019
helpers_test.go:235: (dbg) docker inspect old-k8s-version-110019:
-- stdout --
[
{
"Id": "179e62f50506851342bc4b05c87d0504aae01b76a29a4d4cfea86e9a42803961",
"Created": "2022-11-09T19:00:25.764137036Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 261436,
"ExitCode": 0,
"Error": "",
"StartedAt": "2022-11-09T19:00:26.053200554Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:866c1fe4e3f2d2bfd7e546c12f77c7ef1d94d65a891923ff6772712a9f20df40",
"ResolvConfPath": "/var/lib/docker/containers/179e62f50506851342bc4b05c87d0504aae01b76a29a4d4cfea86e9a42803961/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/179e62f50506851342bc4b05c87d0504aae01b76a29a4d4cfea86e9a42803961/hostname",
"HostsPath": "/var/lib/docker/containers/179e62f50506851342bc4b05c87d0504aae01b76a29a4d4cfea86e9a42803961/hosts",
"LogPath": "/var/lib/docker/containers/179e62f50506851342bc4b05c87d0504aae01b76a29a4d4cfea86e9a42803961/179e62f50506851342bc4b05c87d0504aae01b76a29a4d4cfea86e9a42803961-json.log",
"Name": "/old-k8s-version-110019",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-110019:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-110019",
"PortBindings": {
"22/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"2376/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"32443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"5000/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"8443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"ConsoleSize": [
0,
0
],
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": null,
"BlkioDeviceWriteBps": null,
"BlkioDeviceReadIOps": null,
"BlkioDeviceWriteIOps": null,
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"KernelMemory": 0,
"KernelMemoryTCP": 0,
"MemoryReservation": 0,
"MemorySwap": 2306867200,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": null,
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/6175df1d28c3e25a0e5c63a5d7570f40eb9f7f886fa3164897a59ab06ccc7cd7-init/diff:/var/lib/docker/overlay2/8c1487330bae95024fb04d0a8169f7cc81fd1ba3c27821870f7ac7c3f14eba21/diff:/var/lib/docker/overlay2/bcaf2c5b25be7a7acfb5b663242cc7456d579ea111b07e556bc197c7bfe8eceb/diff:/var/lib/docker/overlay2/0638d8210ce7d8ac0e4379a16e33ec4ba3dad0040bc7b1e6eee9a3ce3b1bab29/diff:/var/lib/docker/overlay2/82d04ede67e6bea7f3cfd2fd8cdf0af23333441d1a311f6c55109e45255a64ad/diff:/var/lib/docker/overlay2/00bbdacd39c41ffbc754eaba2d71640e0fb4097eb9097b8c2a5999bb5a8d4954/diff:/var/lib/docker/overlay2/dcea734b558e644021b8ede0f23c4e46a58e4c344becb334c465fd62b5d48e24/diff:/var/lib/docker/overlay2/ac3602d3dd4e947c3a4676ef8c632089eb73ee68aba964a7d95271ee18eb97f2/diff:/var/lib/docker/overlay2/ac2acc0194de08599857f1b8448ae7b4683ed77f947900bfd694cf26f6c54ffc/diff:/var/lib/docker/overlay2/fdbfaed38c23fa0bd5c54d311629017408fe01fee83151dd3f3d638a7617f4e4/diff:/var/lib/docker/overlay2/d025fd
583df9cfe294d4d46082700b7f5c621b93a796ba7f8f971ddaa60fd83a/diff:/var/lib/docker/overlay2/f4c2a2db4696fc9f1bd6e98e05d393517d2daaeb90f35ae457c61d742e4cc236/diff:/var/lib/docker/overlay2/5ca3c90c302636922d6701cd2547bba3ccd398ec5ade10e04dccd4fe6104a487/diff:/var/lib/docker/overlay2/a5a65589498adaf58375923e30a95f690962a85ecbf6af317b41821b327542b2/diff:/var/lib/docker/overlay2/ff71186ee131d2e64c9cb2be6b53d85bf84ea4a195c417de669d42fe5e10eecd/diff:/var/lib/docker/overlay2/493a221169b45236aaee4b88113fdb3c67c8fbb99e614b4a728d47a8448a3f3f/diff:/var/lib/docker/overlay2/4bafd70e2ae935045921b84746858ec62889e360ddf11495e2a15831b74efc0a/diff:/var/lib/docker/overlay2/90fd6faa0cf3969fb696847bf51d309918860f0cc4599a708e4932647f26c73e/diff:/var/lib/docker/overlay2/ea92881c6586b95c867a9734394d9d100f56f7cbe0812c11395e47b6035c4508/diff:/var/lib/docker/overlay2/ecab8d41ffba5fecbe6e01377fa7b74a9a81ceea0b6ce37ad2373c1bbf89f44a/diff:/var/lib/docker/overlay2/0a01bb2689fa7bca8ea3322bf7e0b9d33392f902c096d5e452da6755180c4a06/diff:/var/lib/d
ocker/overlay2/ab470b7aab8ddccf634d27d72ad09bcf355c2bd4439dcdf67f345220671e4238/diff:/var/lib/docker/overlay2/e7aae4cf5fe266e78947648cb680b6e10a1e6f6527df18d86605a770111ddaa5/diff:/var/lib/docker/overlay2/6dd4c667173ad3322ca465531a62d549cfe66fbb40165818a4e3923e37895eee/diff:/var/lib/docker/overlay2/6053a29c5dc20476b02a6b6d0dafc1d7a81702c6680392177192d709341eabd0/diff:/var/lib/docker/overlay2/80d8ec07feaf3a90ae374a6503523b083045c37de15abf3c2f12d0a21bea84c4/diff:/var/lib/docker/overlay2/55ad8679d9710c334bac8daf6e3b0f9a8fcafc62f44b8f2612bb054ff91aac64/diff:/var/lib/docker/overlay2/64743b589f654fa1e35b0e7be5ff94a3bebfa17c8f1c9811e0d42cdade3f57e7/diff:/var/lib/docker/overlay2/3722e4a69202d28b84adf462e6aa9f065e8079b1c00f372b68d56c9b2c44e658/diff:/var/lib/docker/overlay2/d1ceccb867521773a63007a600d64b8537e1cb227e2d9a6f9df5525e8315b3ef/diff:/var/lib/docker/overlay2/5de0b7762a7bcd971dba6ab8b5ec3a1163b2eb72c904b17e6b0b10dac2ed8cc6/diff:/var/lib/docker/overlay2/36f2255b89964a0e12e3175634bd5c1dfabf520e5a894e260323e26c3a3
83e8c/diff:/var/lib/docker/overlay2/58ca82e7923ce16120ce2bdcabd5d071ca9618a7139cac111d5d271fcb44d6b6/diff:/var/lib/docker/overlay2/c6b28d136c7e3834c9977a2115a7c798e71334d33a76997b156f96642e187677/diff:/var/lib/docker/overlay2/8a75a817735ea5c25b9b75502ba91bba33b5160dab28a17f2f44fa68bd8dcc3f/diff:/var/lib/docker/overlay2/4513fa1cc1e8023f3c0a924e36218c37dfe3595aec46e4d2d96d6c165774b8a3/diff:/var/lib/docker/overlay2/3d3be6ad927b487673f3c43210c9ea9a1acfa4d46cbcb724fce27baf9158b507/diff:/var/lib/docker/overlay2/b8e22ec10062469f680485d2f5f73afce0218c32b25e56188c00547a8152d0c7/diff:/var/lib/docker/overlay2/cb1cb5efbfa387d8fc791f28bdad103d39664ae58a6e372eddc5588db5779427/diff:/var/lib/docker/overlay2/c796de90ee7673fa4d316d056c320ee04f0b6ba574aaa33e4073e3a7200c11a6/diff:/var/lib/docker/overlay2/73c2de759693b5ffd934f7354e3db91ba89c6a5a9c24621fd7c27411bc335c5a/diff:/var/lib/docker/overlay2/46e9fe39b8edeecbe0b31037d24c2994ac3848fbb3af5ed3c47ca2fc1ad0d301/diff:/var/lib/docker/overlay2/febe0fa15a70685bf242a86e91427efdb9b7ec
302a48a7004f89cc569145c7a1/diff",
"MergedDir": "/var/lib/docker/overlay2/6175df1d28c3e25a0e5c63a5d7570f40eb9f7f886fa3164897a59ab06ccc7cd7/merged",
"UpperDir": "/var/lib/docker/overlay2/6175df1d28c3e25a0e5c63a5d7570f40eb9f7f886fa3164897a59ab06ccc7cd7/diff",
"WorkDir": "/var/lib/docker/overlay2/6175df1d28c3e25a0e5c63a5d7570f40eb9f7f886fa3164897a59ab06ccc7cd7/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-110019",
"Source": "/var/lib/docker/volumes/old-k8s-version-110019/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-110019",
"Domainname": "",
"User": "root",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase:v0.0.36@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456",
"Volumes": null,
"WorkingDir": "",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-110019",
"name.minikube.sigs.k8s.io": "old-k8s-version-110019",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "44494f97785315f2d1fdc6bb319dc28d787c45133affaa204ff4f7752507390b",
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"Ports": {
"22/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "64998"
}
],
"2376/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "64999"
}
],
"32443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "65000"
}
],
"5000/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "65001"
}
],
"8443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "65002"
}
]
},
"SandboxKey": "/var/run/docker/netns/44494f977853",
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-110019": {
"IPAMConfig": {
"IPv4Address": "192.168.67.2"
},
"Links": null,
"Aliases": [
"179e62f50506",
"old-k8s-version-110019"
],
"NetworkID": "70a1b44058ab5d3fa2f8c48ca78ea76e689efbb2630885d7458319462051756b",
"EndpointID": "0b18270530563710af60960f244d7aa6644373128ea0b53fb06c325870e567a9",
"Gateway": "192.168.67.1",
"IPAddress": "192.168.67.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"MacAddress": "02:42:c0:a8:43:02",
"DriverOpts": null
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-110019 -n old-k8s-version-110019
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-110019 -n old-k8s-version-110019: exit status 6 (427.385524ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E1109 11:04:29.103120 37051 status.go:415] kubeconfig endpoint: extract IP: "old-k8s-version-110019" does not appear in /Users/jenkins/minikube-integration/15331-22028/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-110019" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (249.38s)