=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-darwin-amd64 start -p old-k8s-version-163757 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0
E1101 16:37:59.480528 3413 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/cilium-161859/client.crt: no such file or directory
=== CONT TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-163757 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0: exit status 109 (4m9.345213805s)
-- stdout --
* [old-k8s-version-163757] minikube v1.27.1 on Darwin 13.0
- MINIKUBE_LOCATION=15232
- KUBECONFIG=/Users/jenkins/minikube-integration/15232-2108/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/15232-2108/.minikube
* Using the docker driver based on user configuration
* Using Docker Desktop driver with root privileges
* Starting control plane node old-k8s-version-163757 in cluster old-k8s-version-163757
* Pulling base image ...
* Creating docker container (CPUs=2, Memory=2200MB) ...
* Preparing Kubernetes v1.16.0 on Docker 20.10.20 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I1101 16:37:57.976926 16937 out.go:296] Setting OutFile to fd 1 ...
I1101 16:37:57.977112 16937 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1101 16:37:57.977117 16937 out.go:309] Setting ErrFile to fd 2...
I1101 16:37:57.977122 16937 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1101 16:37:57.977232 16937 root.go:334] Updating PATH: /Users/jenkins/minikube-integration/15232-2108/.minikube/bin
I1101 16:37:57.977808 16937 out.go:303] Setting JSON to false
I1101 16:37:57.996343 16937 start.go:116] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":4052,"bootTime":1667341825,"procs":388,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.0","kernelVersion":"22.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
W1101 16:37:57.996430 16937 start.go:124] gopshost.Virtualization returned error: not implemented yet
I1101 16:37:58.018206 16937 out.go:177] * [old-k8s-version-163757] minikube v1.27.1 on Darwin 13.0
I1101 16:37:58.059873 16937 notify.go:220] Checking for updates...
I1101 16:37:58.081188 16937 out.go:177] - MINIKUBE_LOCATION=15232
I1101 16:37:58.102952 16937 out.go:177] - KUBECONFIG=/Users/jenkins/minikube-integration/15232-2108/kubeconfig
I1101 16:37:58.124151 16937 out.go:177] - MINIKUBE_BIN=out/minikube-darwin-amd64
I1101 16:37:58.146281 16937 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1101 16:37:58.168045 16937 out.go:177] - MINIKUBE_HOME=/Users/jenkins/minikube-integration/15232-2108/.minikube
I1101 16:37:58.189571 16937 config.go:180] Loaded profile config "kubenet-161858": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.25.3
I1101 16:37:58.189683 16937 driver.go:365] Setting default libvirt URI to qemu:///system
I1101 16:37:58.254717 16937 docker.go:137] docker version: linux-20.10.20
I1101 16:37:58.254864 16937 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1101 16:37:58.402287 16937 info.go:266] docker info: {ID:HPSG:A4AE:7PJH:NBWO:ONHL:GSQ4:6VVP:PETP:L7TN:PZXT:AQQ7:NM5P Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:62 OomKillDisable:false NGoroutines:52 SystemTime:2022-11-01 23:37:58.311826699 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.15.49-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6231724032 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.20 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:9cd3357b7fd7218e4aec3eae239db1f68a5a6ec6 Expected:9cd3357b7fd7218e4aec3eae239db1f68a5a6ec6} RuncCommit:{ID:v1.1.4-0-g5fd4c4d Expected:v1.1.4-0-g5fd4c4d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defaul
t name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.9.1] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.12.1] map[Name:dev Path:/usr/local/lib/docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.0.3] map[Name:extension Path:/usr/local/lib/docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.13] map[Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/lo
cal/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.21.0]] Warnings:<nil>}}
I1101 16:37:58.424191 16937 out.go:177] * Using the docker driver based on user configuration
I1101 16:37:58.445820 16937 start.go:282] selected driver: docker
I1101 16:37:58.445839 16937 start.go:808] validating driver "docker" against <nil>
I1101 16:37:58.445856 16937 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1101 16:37:58.448436 16937 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1101 16:37:58.595011 16937 info.go:266] docker info: {ID:HPSG:A4AE:7PJH:NBWO:ONHL:GSQ4:6VVP:PETP:L7TN:PZXT:AQQ7:NM5P Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:62 OomKillDisable:false NGoroutines:52 SystemTime:2022-11-01 23:37:58.505547458 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.15.49-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6231724032 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.20 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:9cd3357b7fd7218e4aec3eae239db1f68a5a6ec6 Expected:9cd3357b7fd7218e4aec3eae239db1f68a5a6ec6} RuncCommit:{ID:v1.1.4-0-g5fd4c4d Expected:v1.1.4-0-g5fd4c4d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defaul
t name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.9.1] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.12.1] map[Name:dev Path:/usr/local/lib/docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.0.3] map[Name:extension Path:/usr/local/lib/docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.13] map[Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/lo
cal/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.21.0]] Warnings:<nil>}}
I1101 16:37:58.595139 16937 start_flags.go:303] no existing cluster config was found, will generate one from the flags
I1101 16:37:58.595280 16937 start_flags.go:888] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1101 16:37:58.616939 16937 out.go:177] * Using Docker Desktop driver with root privileges
I1101 16:37:58.638905 16937 cni.go:95] Creating CNI manager for ""
I1101 16:37:58.638936 16937 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I1101 16:37:58.638972 16937 start_flags.go:317] config:
{Name:old-k8s-version-163757 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.35-1666722858-15219@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-163757 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet}
I1101 16:37:58.660897 16937 out.go:177] * Starting control plane node old-k8s-version-163757 in cluster old-k8s-version-163757
I1101 16:37:58.703997 16937 cache.go:120] Beginning downloading kic base image for docker with docker
I1101 16:37:58.725776 16937 out.go:177] * Pulling base image ...
I1101 16:37:58.767746 16937 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I1101 16:37:58.767807 16937 image.go:76] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.35-1666722858-15219@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 in local docker daemon
I1101 16:37:58.767844 16937 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/15232-2108/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4
I1101 16:37:58.767863 16937 cache.go:57] Caching tarball of preloaded images
I1101 16:37:58.768106 16937 preload.go:174] Found /Users/jenkins/minikube-integration/15232-2108/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I1101 16:37:58.768119 16937 cache.go:60] Finished verifying existence of preloaded tar for v1.16.0 on docker
I1101 16:37:58.768836 16937 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/config.json ...
I1101 16:37:58.768931 16937 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/config.json: {Name:mk3d3fd5753d2c1ea746c85af49f9696100b930b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1101 16:37:58.825426 16937 image.go:80] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.35-1666722858-15219@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 in local docker daemon, skipping pull
I1101 16:37:58.825464 16937 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.35-1666722858-15219@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 exists in daemon, skipping load
I1101 16:37:58.825474 16937 cache.go:208] Successfully downloaded all kic artifacts
I1101 16:37:58.825543 16937 start.go:364] acquiring machines lock for old-k8s-version-163757: {Name:mk05bab20388c402631f99670934058a4ed5d425 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1101 16:37:58.825718 16937 start.go:368] acquired machines lock for "old-k8s-version-163757" in 162.819µs
I1101 16:37:58.825761 16937 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-163757 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.35-1666722858-15219@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-163757 Namespace:default APIServer
Name:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:f
alse DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I1101 16:37:58.825844 16937 start.go:125] createHost starting for "" (driver="docker")
I1101 16:37:58.869338 16937 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I1101 16:37:58.869761 16937 start.go:159] libmachine.API.Create for "old-k8s-version-163757" (driver="docker")
I1101 16:37:58.869821 16937 client.go:168] LocalClient.Create starting
I1101 16:37:58.870058 16937 main.go:134] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/15232-2108/.minikube/certs/ca.pem
I1101 16:37:58.870196 16937 main.go:134] libmachine: Decoding PEM data...
I1101 16:37:58.870243 16937 main.go:134] libmachine: Parsing certificate...
I1101 16:37:58.870379 16937 main.go:134] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/15232-2108/.minikube/certs/cert.pem
I1101 16:37:58.870465 16937 main.go:134] libmachine: Decoding PEM data...
I1101 16:37:58.870488 16937 main.go:134] libmachine: Parsing certificate...
I1101 16:37:58.871208 16937 cli_runner.go:164] Run: docker network inspect old-k8s-version-163757 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W1101 16:37:58.927682 16937 cli_runner.go:211] docker network inspect old-k8s-version-163757 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I1101 16:37:58.927799 16937 network_create.go:272] running [docker network inspect old-k8s-version-163757] to gather additional debugging logs...
I1101 16:37:58.927823 16937 cli_runner.go:164] Run: docker network inspect old-k8s-version-163757
W1101 16:37:58.986541 16937 cli_runner.go:211] docker network inspect old-k8s-version-163757 returned with exit code 1
I1101 16:37:58.986568 16937 network_create.go:275] error running [docker network inspect old-k8s-version-163757]: docker network inspect old-k8s-version-163757: exit status 1
stdout:
[]
stderr:
Error: No such network: old-k8s-version-163757
I1101 16:37:58.986580 16937 network_create.go:277] output of [docker network inspect old-k8s-version-163757]: -- stdout --
[]
-- /stdout --
** stderr **
Error: No such network: old-k8s-version-163757
** /stderr **
I1101 16:37:58.986680 16937 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1101 16:37:59.044339 16937 network.go:295] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc000558538] misses:0}
I1101 16:37:59.044377 16937 network.go:241] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I1101 16:37:59.044390 16937 network_create.go:115] attempt to create docker network old-k8s-version-163757 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I1101 16:37:59.044479 16937 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-163757 old-k8s-version-163757
W1101 16:37:59.102441 16937 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-163757 old-k8s-version-163757 returned with exit code 1
W1101 16:37:59.102479 16937 network_create.go:107] failed to create docker network old-k8s-version-163757 192.168.49.0/24, will retry: subnet is taken
I1101 16:37:59.102743 16937 network.go:286] skipping subnet 192.168.49.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000558538] amended:false}} dirty:map[] misses:0}
I1101 16:37:59.102761 16937 network.go:244] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I1101 16:37:59.102983 16937 network.go:295] reserving subnet 192.168.58.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000558538] amended:true}} dirty:map[192.168.49.0:0xc000558538 192.168.58.0:0xc00013d0e0] misses:0}
I1101 16:37:59.102997 16937 network.go:241] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I1101 16:37:59.103016 16937 network_create.go:115] attempt to create docker network old-k8s-version-163757 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ...
I1101 16:37:59.103111 16937 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-163757 old-k8s-version-163757
W1101 16:37:59.159727 16937 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-163757 old-k8s-version-163757 returned with exit code 1
W1101 16:37:59.159766 16937 network_create.go:107] failed to create docker network old-k8s-version-163757 192.168.58.0/24, will retry: subnet is taken
I1101 16:37:59.160030 16937 network.go:286] skipping subnet 192.168.58.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000558538] amended:true}} dirty:map[192.168.49.0:0xc000558538 192.168.58.0:0xc00013d0e0] misses:1}
I1101 16:37:59.160047 16937 network.go:244] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I1101 16:37:59.160255 16937 network.go:295] reserving subnet 192.168.67.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000558538] amended:true}} dirty:map[192.168.49.0:0xc000558538 192.168.58.0:0xc00013d0e0 192.168.67.0:0xc000012ca8] misses:1}
I1101 16:37:59.160271 16937 network.go:241] using free private subnet 192.168.67.0/24: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I1101 16:37:59.160278 16937 network_create.go:115] attempt to create docker network old-k8s-version-163757 192.168.67.0/24 with gateway 192.168.67.1 and MTU of 1500 ...
I1101 16:37:59.160367 16937 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-163757 old-k8s-version-163757
W1101 16:37:59.217609 16937 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-163757 old-k8s-version-163757 returned with exit code 1
W1101 16:37:59.217647 16937 network_create.go:107] failed to create docker network old-k8s-version-163757 192.168.67.0/24, will retry: subnet is taken
I1101 16:37:59.217885 16937 network.go:286] skipping subnet 192.168.67.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000558538] amended:true}} dirty:map[192.168.49.0:0xc000558538 192.168.58.0:0xc00013d0e0 192.168.67.0:0xc000012ca8] misses:2}
I1101 16:37:59.217903 16937 network.go:244] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I1101 16:37:59.218113 16937 network.go:295] reserving subnet 192.168.76.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000558538] amended:true}} dirty:map[192.168.49.0:0xc000558538 192.168.58.0:0xc00013d0e0 192.168.67.0:0xc000012ca8 192.168.76.0:0xc000012ce0] misses:2}
I1101 16:37:59.218126 16937 network.go:241] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I1101 16:37:59.218133 16937 network_create.go:115] attempt to create docker network old-k8s-version-163757 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I1101 16:37:59.218210 16937 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-163757 old-k8s-version-163757
I1101 16:37:59.308171 16937 network_create.go:99] docker network old-k8s-version-163757 192.168.76.0/24 created
I1101 16:37:59.308210 16937 kic.go:106] calculated static IP "192.168.76.2" for the "old-k8s-version-163757" container
I1101 16:37:59.308361 16937 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I1101 16:37:59.368149 16937 cli_runner.go:164] Run: docker volume create old-k8s-version-163757 --label name.minikube.sigs.k8s.io=old-k8s-version-163757 --label created_by.minikube.sigs.k8s.io=true
I1101 16:37:59.427869 16937 oci.go:103] Successfully created a docker volume old-k8s-version-163757
I1101 16:37:59.427988 16937 cli_runner.go:164] Run: docker run --rm --name old-k8s-version-163757-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-163757 --entrypoint /usr/bin/test -v old-k8s-version-163757:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.35-1666722858-15219@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 -d /var/lib
I1101 16:37:59.886487 16937 oci.go:107] Successfully prepared a docker volume old-k8s-version-163757
I1101 16:37:59.886538 16937 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I1101 16:37:59.886555 16937 kic.go:179] Starting extracting preloaded images to volume ...
I1101 16:37:59.886662 16937 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/15232-2108/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-163757:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.35-1666722858-15219@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 -I lz4 -xf /preloaded.tar -C /extractDir
I1101 16:38:04.038556 16937 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/15232-2108/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-163757:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.35-1666722858-15219@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 -I lz4 -xf /preloaded.tar -C /extractDir: (4.151870346s)
I1101 16:38:04.038577 16937 kic.go:188] duration metric: took 4.152052 seconds to extract preloaded images to volume
I1101 16:38:04.038690 16937 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I1101 16:38:04.187301 16937 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname old-k8s-version-163757 --name old-k8s-version-163757 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-163757 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=old-k8s-version-163757 --network old-k8s-version-163757 --ip 192.168.76.2 --volume old-k8s-version-163757:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=8443 --publish=22 --publish=2376 --publish=5000 --publish=32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.35-1666722858-15219@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456
I1101 16:38:04.553084 16937 cli_runner.go:164] Run: docker container inspect old-k8s-version-163757 --format={{.State.Running}}
I1101 16:38:04.615559 16937 cli_runner.go:164] Run: docker container inspect old-k8s-version-163757 --format={{.State.Status}}
I1101 16:38:04.682209 16937 cli_runner.go:164] Run: docker exec old-k8s-version-163757 stat /var/lib/dpkg/alternatives/iptables
I1101 16:38:04.794582 16937 oci.go:144] the created container "old-k8s-version-163757" has a running status.
I1101 16:38:04.794627 16937 kic.go:210] Creating ssh key for kic: /Users/jenkins/minikube-integration/15232-2108/.minikube/machines/old-k8s-version-163757/id_rsa...
I1101 16:38:05.014578 16937 kic_runner.go:191] docker (temp): /Users/jenkins/minikube-integration/15232-2108/.minikube/machines/old-k8s-version-163757/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I1101 16:38:05.118115 16937 cli_runner.go:164] Run: docker container inspect old-k8s-version-163757 --format={{.State.Status}}
I1101 16:38:05.181364 16937 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I1101 16:38:05.181382 16937 kic_runner.go:114] Args: [docker exec --privileged old-k8s-version-163757 chown docker:docker /home/docker/.ssh/authorized_keys]
I1101 16:38:05.291282 16937 cli_runner.go:164] Run: docker container inspect old-k8s-version-163757 --format={{.State.Status}}
I1101 16:38:05.351546 16937 machine.go:88] provisioning docker machine ...
I1101 16:38:05.351594 16937 ubuntu.go:169] provisioning hostname "old-k8s-version-163757"
I1101 16:38:05.351723 16937 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-163757
I1101 16:38:05.412973 16937 main.go:134] libmachine: Using SSH client type: native
I1101 16:38:05.413162 16937 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13e6c00] 0x13e9d80 <nil> [] 0s} 127.0.0.1 53802 <nil> <nil>}
I1101 16:38:05.413179 16937 main.go:134] libmachine: About to run SSH command:
sudo hostname old-k8s-version-163757 && echo "old-k8s-version-163757" | sudo tee /etc/hostname
I1101 16:38:05.537523 16937 main.go:134] libmachine: SSH cmd err, output: <nil>: old-k8s-version-163757
I1101 16:38:05.537669 16937 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-163757
I1101 16:38:05.596849 16937 main.go:134] libmachine: Using SSH client type: native
I1101 16:38:05.597014 16937 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13e6c00] 0x13e9d80 <nil> [] 0s} 127.0.0.1 53802 <nil> <nil>}
I1101 16:38:05.597028 16937 main.go:134] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-163757' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-163757/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-163757' | sudo tee -a /etc/hosts;
fi
fi
I1101 16:38:05.718444 16937 main.go:134] libmachine: SSH cmd err, output: <nil>:
I1101 16:38:05.718461 16937 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/15232-2108/.minikube CaCertPath:/Users/jenkins/minikube-integration/15232-2108/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/15232-2108/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/15232-2108/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/15232-2108/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/15232-2108/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/15232-2108/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/15232-2108/.minikube}
I1101 16:38:05.718477 16937 ubuntu.go:177] setting up certificates
I1101 16:38:05.718485 16937 provision.go:83] configureAuth start
I1101 16:38:05.718573 16937 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-163757
I1101 16:38:05.778632 16937 provision.go:138] copyHostCerts
I1101 16:38:05.778734 16937 exec_runner.go:144] found /Users/jenkins/minikube-integration/15232-2108/.minikube/cert.pem, removing ...
I1101 16:38:05.778743 16937 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15232-2108/.minikube/cert.pem
I1101 16:38:05.778868 16937 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15232-2108/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/15232-2108/.minikube/cert.pem (1123 bytes)
I1101 16:38:05.779063 16937 exec_runner.go:144] found /Users/jenkins/minikube-integration/15232-2108/.minikube/key.pem, removing ...
I1101 16:38:05.779069 16937 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15232-2108/.minikube/key.pem
I1101 16:38:05.779138 16937 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15232-2108/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/15232-2108/.minikube/key.pem (1675 bytes)
I1101 16:38:05.779301 16937 exec_runner.go:144] found /Users/jenkins/minikube-integration/15232-2108/.minikube/ca.pem, removing ...
I1101 16:38:05.779307 16937 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15232-2108/.minikube/ca.pem
I1101 16:38:05.779371 16937 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15232-2108/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/15232-2108/.minikube/ca.pem (1082 bytes)
I1101 16:38:05.779488 16937 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/15232-2108/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/15232-2108/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/15232-2108/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-163757 san=[192.168.76.2 127.0.0.1 localhost 127.0.0.1 minikube old-k8s-version-163757]
I1101 16:38:05.824747 16937 provision.go:172] copyRemoteCerts
I1101 16:38:05.824809 16937 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1101 16:38:05.824870 16937 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-163757
I1101 16:38:05.885972 16937 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53802 SSHKeyPath:/Users/jenkins/minikube-integration/15232-2108/.minikube/machines/old-k8s-version-163757/id_rsa Username:docker}
I1101 16:38:05.973483 16937 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15232-2108/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I1101 16:38:05.992101 16937 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15232-2108/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
I1101 16:38:06.011057 16937 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15232-2108/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1101 16:38:06.030301 16937 provision.go:86] duration metric: configureAuth took 311.804136ms
I1101 16:38:06.030315 16937 ubuntu.go:193] setting minikube options for container-runtime
I1101 16:38:06.030462 16937 config.go:180] Loaded profile config "old-k8s-version-163757": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
I1101 16:38:06.030544 16937 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-163757
I1101 16:38:06.091125 16937 main.go:134] libmachine: Using SSH client type: native
I1101 16:38:06.091292 16937 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13e6c00] 0x13e9d80 <nil> [] 0s} 127.0.0.1 53802 <nil> <nil>}
I1101 16:38:06.091307 16937 main.go:134] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I1101 16:38:06.209112 16937 main.go:134] libmachine: SSH cmd err, output: <nil>: overlay
I1101 16:38:06.209129 16937 ubuntu.go:71] root file system type: overlay
I1101 16:38:06.209279 16937 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I1101 16:38:06.209379 16937 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-163757
I1101 16:38:06.269885 16937 main.go:134] libmachine: Using SSH client type: native
I1101 16:38:06.270053 16937 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13e6c00] 0x13e9d80 <nil> [] 0s} 127.0.0.1 53802 <nil> <nil>}
I1101 16:38:06.270103 16937 main.go:134] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I1101 16:38:06.398471 16937 main.go:134] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I1101 16:38:06.398587 16937 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-163757
I1101 16:38:06.458586 16937 main.go:134] libmachine: Using SSH client type: native
I1101 16:38:06.458756 16937 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13e6c00] 0x13e9d80 <nil> [] 0s} 127.0.0.1 53802 <nil> <nil>}
I1101 16:38:06.458769 16937 main.go:134] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I1101 16:38:07.091244 16937 main.go:134] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2022-10-18 18:18:12.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2022-11-01 23:38:06.406907963 +0000
@@ -1,30 +1,32 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
Wants=network-online.target
-Requires=docker.socket containerd.service
+Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutSec=0
-RestartSec=2
-Restart=always
-
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
+Restart=on-failure
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
@@ -32,16 +34,16 @@
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I1101 16:38:07.091284 16937 machine.go:91] provisioned docker machine in 1.739727618s
I1101 16:38:07.091291 16937 client.go:171] LocalClient.Create took 8.221525248s
I1101 16:38:07.091328 16937 start.go:167] duration metric: libmachine.API.Create for "old-k8s-version-163757" took 8.221632076s
I1101 16:38:07.091337 16937 start.go:300] post-start starting for "old-k8s-version-163757" (driver="docker")
I1101 16:38:07.091342 16937 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1101 16:38:07.091427 16937 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1101 16:38:07.091503 16937 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-163757
I1101 16:38:07.152354 16937 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53802 SSHKeyPath:/Users/jenkins/minikube-integration/15232-2108/.minikube/machines/old-k8s-version-163757/id_rsa Username:docker}
I1101 16:38:07.239570 16937 ssh_runner.go:195] Run: cat /etc/os-release
I1101 16:38:07.243124 16937 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I1101 16:38:07.243138 16937 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1101 16:38:07.243169 16937 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I1101 16:38:07.243189 16937 info.go:137] Remote host: Ubuntu 20.04.5 LTS
I1101 16:38:07.243201 16937 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15232-2108/.minikube/addons for local assets ...
I1101 16:38:07.243303 16937 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15232-2108/.minikube/files for local assets ...
I1101 16:38:07.243518 16937 filesync.go:149] local asset: /Users/jenkins/minikube-integration/15232-2108/.minikube/files/etc/ssl/certs/34132.pem -> 34132.pem in /etc/ssl/certs
I1101 16:38:07.243723 16937 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1101 16:38:07.251190 16937 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15232-2108/.minikube/files/etc/ssl/certs/34132.pem --> /etc/ssl/certs/34132.pem (1708 bytes)
I1101 16:38:07.268429 16937 start.go:303] post-start completed in 177.083144ms
I1101 16:38:07.269007 16937 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-163757
I1101 16:38:07.329141 16937 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/config.json ...
I1101 16:38:07.329570 16937 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1101 16:38:07.329653 16937 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-163757
I1101 16:38:07.389818 16937 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53802 SSHKeyPath:/Users/jenkins/minikube-integration/15232-2108/.minikube/machines/old-k8s-version-163757/id_rsa Username:docker}
I1101 16:38:07.473434 16937 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1101 16:38:07.477779 16937 start.go:128] duration metric: createHost completed in 8.651987943s
I1101 16:38:07.477796 16937 start.go:83] releasing machines lock for "old-k8s-version-163757", held for 8.65213336s
I1101 16:38:07.477904 16937 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-163757
I1101 16:38:07.537871 16937 ssh_runner.go:195] Run: systemctl --version
I1101 16:38:07.537871 16937 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
I1101 16:38:07.537944 16937 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-163757
I1101 16:38:07.537972 16937 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-163757
I1101 16:38:07.602370 16937 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53802 SSHKeyPath:/Users/jenkins/minikube-integration/15232-2108/.minikube/machines/old-k8s-version-163757/id_rsa Username:docker}
I1101 16:38:07.603185 16937 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53802 SSHKeyPath:/Users/jenkins/minikube-integration/15232-2108/.minikube/machines/old-k8s-version-163757/id_rsa Username:docker}
I1101 16:38:07.685572 16937 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I1101 16:38:07.940716 16937 cruntime.go:273] skipping containerd shutdown because we are bound to it
I1101 16:38:07.940803 16937 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1101 16:38:07.951507 16937 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
image-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I1101 16:38:07.964553 16937 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I1101 16:38:08.039131 16937 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I1101 16:38:08.114478 16937 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1101 16:38:08.189292 16937 ssh_runner.go:195] Run: sudo systemctl restart docker
I1101 16:38:08.389977 16937 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I1101 16:38:08.419040 16937 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I1101 16:38:08.492037 16937 out.go:204] * Preparing Kubernetes v1.16.0 on Docker 20.10.20 ...
I1101 16:38:08.492243 16937 cli_runner.go:164] Run: docker exec -t old-k8s-version-163757 dig +short host.docker.internal
I1101 16:38:08.611278 16937 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2
I1101 16:38:08.611400 16937 ssh_runner.go:195] Run: grep 192.168.65.2 host.minikube.internal$ /etc/hosts
I1101 16:38:08.615672 16937 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1101 16:38:08.625871 16937 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-163757
I1101 16:38:08.685936 16937 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I1101 16:38:08.686034 16937 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I1101 16:38:08.710280 16937 docker.go:613] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I1101 16:38:08.710299 16937 docker.go:543] Images already preloaded, skipping extraction
I1101 16:38:08.710391 16937 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I1101 16:38:08.733131 16937 docker.go:613] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I1101 16:38:08.733151 16937 cache_images.go:84] Images are preloaded, skipping loading
I1101 16:38:08.733263 16937 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I1101 16:38:08.805811 16937 cni.go:95] Creating CNI manager for ""
I1101 16:38:08.805825 16937 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I1101 16:38:08.805842 16937 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I1101 16:38:08.805859 16937 kubeadm.go:156] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-163757 NodeName:old-k8s-version-163757 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false}
I1101 16:38:08.805973 16937 kubeadm.go:161] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-163757"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-163757
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.76.2:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1101 16:38:08.806049 16937 kubeadm.go:962] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-163757 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-163757 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I1101 16:38:08.806126 16937 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I1101 16:38:08.814148 16937 binaries.go:44] Found k8s binaries, skipping transfer
I1101 16:38:08.814214 16937 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1101 16:38:08.821204 16937 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (348 bytes)
I1101 16:38:08.834704 16937 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1101 16:38:08.847331 16937 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I1101 16:38:08.861286 16937 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I1101 16:38:08.865366 16937 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1101 16:38:08.874948 16937 certs.go:54] Setting up /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757 for IP: 192.168.76.2
I1101 16:38:08.875102 16937 certs.go:182] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/15232-2108/.minikube/ca.key
I1101 16:38:08.875226 16937 certs.go:182] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/15232-2108/.minikube/proxy-client-ca.key
I1101 16:38:08.875285 16937 certs.go:302] generating minikube-user signed cert: /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/client.key
I1101 16:38:08.875306 16937 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/client.crt with IP's: []
I1101 16:38:09.116879 16937 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/client.crt ...
I1101 16:38:09.116902 16937 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/client.crt: {Name:mk1f98a48470c980bf9d87204f7412432d54a873 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1101 16:38:09.117292 16937 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/client.key ...
I1101 16:38:09.117301 16937 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/client.key: {Name:mk788ef114a70483dd1e1d995f429f97161614e8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1101 16:38:09.117549 16937 certs.go:302] generating minikube signed cert: /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/apiserver.key.31bdca25
I1101 16:38:09.117592 16937 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/apiserver.crt.31bdca25 with IP's: [192.168.76.2 10.96.0.1 127.0.0.1 10.0.0.1]
I1101 16:38:09.410590 16937 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/apiserver.crt.31bdca25 ...
I1101 16:38:09.410607 16937 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/apiserver.crt.31bdca25: {Name:mk3be343810d4e3a0f7bf1b19912d31132169903 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1101 16:38:09.410902 16937 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/apiserver.key.31bdca25 ...
I1101 16:38:09.410910 16937 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/apiserver.key.31bdca25: {Name:mk20cd7b0097912c832eac09b9c543f06f73f696 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1101 16:38:09.411096 16937 certs.go:320] copying /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/apiserver.crt.31bdca25 -> /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/apiserver.crt
I1101 16:38:09.411267 16937 certs.go:324] copying /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/apiserver.key.31bdca25 -> /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/apiserver.key
I1101 16:38:09.411452 16937 certs.go:302] generating aggregator signed cert: /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/proxy-client.key
I1101 16:38:09.411471 16937 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/proxy-client.crt with IP's: []
I1101 16:38:09.536754 16937 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/proxy-client.crt ...
I1101 16:38:09.536774 16937 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/proxy-client.crt: {Name:mkf8afe1b9a1b7fe0005801176329eeeda97ea5e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1101 16:38:09.537074 16937 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/proxy-client.key ...
I1101 16:38:09.537083 16937 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/proxy-client.key: {Name:mk48a662e23171d72d31658eb7281fa0f0b5bb0c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1101 16:38:09.537566 16937 certs.go:388] found cert: /Users/jenkins/minikube-integration/15232-2108/.minikube/certs/Users/jenkins/minikube-integration/15232-2108/.minikube/certs/3413.pem (1338 bytes)
W1101 16:38:09.537619 16937 certs.go:384] ignoring /Users/jenkins/minikube-integration/15232-2108/.minikube/certs/Users/jenkins/minikube-integration/15232-2108/.minikube/certs/3413_empty.pem, impossibly tiny 0 bytes
I1101 16:38:09.537634 16937 certs.go:388] found cert: /Users/jenkins/minikube-integration/15232-2108/.minikube/certs/Users/jenkins/minikube-integration/15232-2108/.minikube/certs/ca-key.pem (1679 bytes)
I1101 16:38:09.537670 16937 certs.go:388] found cert: /Users/jenkins/minikube-integration/15232-2108/.minikube/certs/Users/jenkins/minikube-integration/15232-2108/.minikube/certs/ca.pem (1082 bytes)
I1101 16:38:09.537706 16937 certs.go:388] found cert: /Users/jenkins/minikube-integration/15232-2108/.minikube/certs/Users/jenkins/minikube-integration/15232-2108/.minikube/certs/cert.pem (1123 bytes)
I1101 16:38:09.537741 16937 certs.go:388] found cert: /Users/jenkins/minikube-integration/15232-2108/.minikube/certs/Users/jenkins/minikube-integration/15232-2108/.minikube/certs/key.pem (1675 bytes)
I1101 16:38:09.537813 16937 certs.go:388] found cert: /Users/jenkins/minikube-integration/15232-2108/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/15232-2108/.minikube/files/etc/ssl/certs/34132.pem (1708 bytes)
I1101 16:38:09.538304 16937 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I1101 16:38:09.557194 16937 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I1101 16:38:09.575501 16937 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1101 16:38:09.592434 16937 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15232-2108/.minikube/profiles/old-k8s-version-163757/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I1101 16:38:09.610238 16937 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15232-2108/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1101 16:38:09.627758 16937 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15232-2108/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I1101 16:38:09.645430 16937 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15232-2108/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1101 16:38:09.663265 16937 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15232-2108/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1101 16:38:09.679869 16937 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15232-2108/.minikube/files/etc/ssl/certs/34132.pem --> /usr/share/ca-certificates/34132.pem (1708 bytes)
I1101 16:38:09.697783 16937 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15232-2108/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1101 16:38:09.714736 16937 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15232-2108/.minikube/certs/3413.pem --> /usr/share/ca-certificates/3413.pem (1338 bytes)
I1101 16:38:09.732183 16937 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1101 16:38:09.745130 16937 ssh_runner.go:195] Run: openssl version
I1101 16:38:09.750762 16937 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/34132.pem && ln -fs /usr/share/ca-certificates/34132.pem /etc/ssl/certs/34132.pem"
I1101 16:38:09.758694 16937 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/34132.pem
I1101 16:38:09.762864 16937 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Nov 1 22:49 /usr/share/ca-certificates/34132.pem
I1101 16:38:09.762915 16937 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/34132.pem
I1101 16:38:09.768554 16937 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/34132.pem /etc/ssl/certs/3ec20f2e.0"
I1101 16:38:09.777424 16937 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1101 16:38:09.785447 16937 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1101 16:38:09.789684 16937 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Nov 1 22:45 /usr/share/ca-certificates/minikubeCA.pem
I1101 16:38:09.789765 16937 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1101 16:38:09.795412 16937 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1101 16:38:09.803446 16937 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3413.pem && ln -fs /usr/share/ca-certificates/3413.pem /etc/ssl/certs/3413.pem"
I1101 16:38:09.811372 16937 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3413.pem
I1101 16:38:09.815390 16937 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Nov 1 22:49 /usr/share/ca-certificates/3413.pem
I1101 16:38:09.815439 16937 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3413.pem
I1101 16:38:09.820979 16937 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/3413.pem /etc/ssl/certs/51391683.0"
I1101 16:38:09.829001 16937 kubeadm.go:396] StartCluster: {Name:old-k8s-version-163757 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.35-1666722858-15219@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-163757 Namespace:default APIServerName:minikubeCA APISer
verNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disab
leMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet}
I1101 16:38:09.829212 16937 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I1101 16:38:09.852443 16937 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1101 16:38:09.860096 16937 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1101 16:38:09.867693 16937 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I1101 16:38:09.867751 16937 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1101 16:38:09.875883 16937 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1101 16:38:09.875919 16937 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I1101 16:38:09.924340 16937 kubeadm.go:317] [init] Using Kubernetes version: v1.16.0
I1101 16:38:09.924394 16937 kubeadm.go:317] [preflight] Running pre-flight checks
I1101 16:38:10.236730 16937 kubeadm.go:317] [preflight] Pulling images required for setting up a Kubernetes cluster
I1101 16:38:10.236867 16937 kubeadm.go:317] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1101 16:38:10.236990 16937 kubeadm.go:317] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I1101 16:38:10.460609 16937 kubeadm.go:317] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1101 16:38:10.461598 16937 kubeadm.go:317] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1101 16:38:10.467814 16937 kubeadm.go:317] [kubelet-start] Activating the kubelet service
I1101 16:38:10.542515 16937 kubeadm.go:317] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1101 16:38:10.566868 16937 out.go:204] - Generating certificates and keys ...
I1101 16:38:10.566956 16937 kubeadm.go:317] [certs] Using existing ca certificate authority
I1101 16:38:10.567019 16937 kubeadm.go:317] [certs] Using existing apiserver certificate and key on disk
I1101 16:38:10.896116 16937 kubeadm.go:317] [certs] Generating "apiserver-kubelet-client" certificate and key
I1101 16:38:10.981873 16937 kubeadm.go:317] [certs] Generating "front-proxy-ca" certificate and key
I1101 16:38:11.121171 16937 kubeadm.go:317] [certs] Generating "front-proxy-client" certificate and key
I1101 16:38:11.316657 16937 kubeadm.go:317] [certs] Generating "etcd/ca" certificate and key
I1101 16:38:11.381628 16937 kubeadm.go:317] [certs] Generating "etcd/server" certificate and key
I1101 16:38:11.381824 16937 kubeadm.go:317] [certs] etcd/server serving cert is signed for DNS names [old-k8s-version-163757 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I1101 16:38:11.775151 16937 kubeadm.go:317] [certs] Generating "etcd/peer" certificate and key
I1101 16:38:11.775275 16937 kubeadm.go:317] [certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-163757 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I1101 16:38:12.048296 16937 kubeadm.go:317] [certs] Generating "etcd/healthcheck-client" certificate and key
I1101 16:38:12.257459 16937 kubeadm.go:317] [certs] Generating "apiserver-etcd-client" certificate and key
I1101 16:38:12.521259 16937 kubeadm.go:317] [certs] Generating "sa" key and public key
I1101 16:38:12.521346 16937 kubeadm.go:317] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1101 16:38:12.648842 16937 kubeadm.go:317] [kubeconfig] Writing "admin.conf" kubeconfig file
I1101 16:38:12.747312 16937 kubeadm.go:317] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1101 16:38:13.014501 16937 kubeadm.go:317] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1101 16:38:13.124845 16937 kubeadm.go:317] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1101 16:38:13.125274 16937 kubeadm.go:317] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1101 16:38:13.146896 16937 out.go:204] - Booting up control plane ...
I1101 16:38:13.147042 16937 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1101 16:38:13.147213 16937 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1101 16:38:13.147333 16937 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1101 16:38:13.147482 16937 kubeadm.go:317] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1101 16:38:13.147699 16937 kubeadm.go:317] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I1101 16:38:53.106280 16937 kubeadm.go:317] [kubelet-check] Initial timeout of 40s passed.
I1101 16:38:53.107098 16937 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1101 16:38:53.107335 16937 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1101 16:38:58.104982 16937 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1101 16:38:58.105188 16937 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1101 16:39:08.098159 16937 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1101 16:39:08.098311 16937 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1101 16:39:28.084427 16937 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1101 16:39:28.084598 16937 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1101 16:40:08.078674 16937 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1101 16:40:08.078877 16937 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1101 16:40:08.078889 16937 kubeadm.go:317]
I1101 16:40:08.078929 16937 kubeadm.go:317] Unfortunately, an error has occurred:
I1101 16:40:08.078964 16937 kubeadm.go:317] timed out waiting for the condition
I1101 16:40:08.078977 16937 kubeadm.go:317]
I1101 16:40:08.079037 16937 kubeadm.go:317] This error is likely caused by:
I1101 16:40:08.079090 16937 kubeadm.go:317] - The kubelet is not running
I1101 16:40:08.079205 16937 kubeadm.go:317] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I1101 16:40:08.079215 16937 kubeadm.go:317]
I1101 16:40:08.079292 16937 kubeadm.go:317] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I1101 16:40:08.079313 16937 kubeadm.go:317] - 'systemctl status kubelet'
I1101 16:40:08.079355 16937 kubeadm.go:317] - 'journalctl -xeu kubelet'
I1101 16:40:08.079365 16937 kubeadm.go:317]
I1101 16:40:08.079454 16937 kubeadm.go:317] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I1101 16:40:08.079527 16937 kubeadm.go:317] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I1101 16:40:08.079587 16937 kubeadm.go:317] Here is one example how you may list all Kubernetes containers running in docker:
I1101 16:40:08.079625 16937 kubeadm.go:317] - 'docker ps -a | grep kube | grep -v pause'
I1101 16:40:08.079693 16937 kubeadm.go:317] Once you have found the failing container, you can inspect its logs with:
I1101 16:40:08.079716 16937 kubeadm.go:317] - 'docker logs CONTAINERID'
I1101 16:40:08.082212 16937 kubeadm.go:317] [WARNING Swap]: running with swap on is not supported. Please disable swap
I1101 16:40:08.082335 16937 kubeadm.go:317] [WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
I1101 16:40:08.082408 16937 kubeadm.go:317] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1101 16:40:08.082466 16937 kubeadm.go:317] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I1101 16:40:08.082523 16937 kubeadm.go:317] To see the stack trace of this error execute with --v=5 or higher
W1101 16:40:08.082667 16937 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-163757 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-163757 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-163757 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-163757 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I1101 16:40:08.082694 16937 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"
I1101 16:40:08.505619 16937 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1101 16:40:08.515496 16937 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I1101 16:40:08.515561 16937 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1101 16:40:08.522946 16937 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1101 16:40:08.522968 16937 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I1101 16:40:08.570656 16937 kubeadm.go:317] [init] Using Kubernetes version: v1.16.0
I1101 16:40:08.570693 16937 kubeadm.go:317] [preflight] Running pre-flight checks
I1101 16:40:08.863455 16937 kubeadm.go:317] [preflight] Pulling images required for setting up a Kubernetes cluster
I1101 16:40:08.863541 16937 kubeadm.go:317] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1101 16:40:08.863630 16937 kubeadm.go:317] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I1101 16:40:09.098016 16937 kubeadm.go:317] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1101 16:40:09.099110 16937 kubeadm.go:317] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1101 16:40:09.106038 16937 kubeadm.go:317] [kubelet-start] Activating the kubelet service
I1101 16:40:09.186501 16937 kubeadm.go:317] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1101 16:40:09.208281 16937 out.go:204] - Generating certificates and keys ...
I1101 16:40:09.208406 16937 kubeadm.go:317] [certs] Using existing ca certificate authority
I1101 16:40:09.208492 16937 kubeadm.go:317] [certs] Using existing apiserver certificate and key on disk
I1101 16:40:09.208612 16937 kubeadm.go:317] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I1101 16:40:09.208688 16937 kubeadm.go:317] [certs] Using existing front-proxy-ca certificate authority
I1101 16:40:09.208748 16937 kubeadm.go:317] [certs] Using existing front-proxy-client certificate and key on disk
I1101 16:40:09.208805 16937 kubeadm.go:317] [certs] Using existing etcd/ca certificate authority
I1101 16:40:09.208867 16937 kubeadm.go:317] [certs] Using existing etcd/server certificate and key on disk
I1101 16:40:09.208940 16937 kubeadm.go:317] [certs] Using existing etcd/peer certificate and key on disk
I1101 16:40:09.209034 16937 kubeadm.go:317] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I1101 16:40:09.209094 16937 kubeadm.go:317] [certs] Using existing apiserver-etcd-client certificate and key on disk
I1101 16:40:09.209135 16937 kubeadm.go:317] [certs] Using the existing "sa" key
I1101 16:40:09.209177 16937 kubeadm.go:317] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1101 16:40:09.355622 16937 kubeadm.go:317] [kubeconfig] Writing "admin.conf" kubeconfig file
I1101 16:40:09.534369 16937 kubeadm.go:317] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1101 16:40:09.672695 16937 kubeadm.go:317] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1101 16:40:09.744276 16937 kubeadm.go:317] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1101 16:40:09.745413 16937 kubeadm.go:317] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1101 16:40:09.767220 16937 out.go:204] - Booting up control plane ...
I1101 16:40:09.767398 16937 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1101 16:40:09.767546 16937 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1101 16:40:09.767656 16937 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1101 16:40:09.767786 16937 kubeadm.go:317] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1101 16:40:09.768059 16937 kubeadm.go:317] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I1101 16:40:49.734406 16937 kubeadm.go:317] [kubelet-check] Initial timeout of 40s passed.
I1101 16:40:49.735123 16937 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1101 16:40:49.735332 16937 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1101 16:40:54.732546 16937 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1101 16:40:54.732707 16937 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1101 16:41:04.727305 16937 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1101 16:41:04.727498 16937 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1101 16:41:24.714027 16937 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1101 16:41:24.714226 16937 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1101 16:42:04.686646 16937 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1101 16:42:04.686855 16937 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I1101 16:42:04.686870 16937 kubeadm.go:317]
I1101 16:42:04.686905 16937 kubeadm.go:317] Unfortunately, an error has occurred:
I1101 16:42:04.686943 16937 kubeadm.go:317] timed out waiting for the condition
I1101 16:42:04.686948 16937 kubeadm.go:317]
I1101 16:42:04.687012 16937 kubeadm.go:317] This error is likely caused by:
I1101 16:42:04.687067 16937 kubeadm.go:317] - The kubelet is not running
I1101 16:42:04.687209 16937 kubeadm.go:317] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I1101 16:42:04.687223 16937 kubeadm.go:317]
I1101 16:42:04.687325 16937 kubeadm.go:317] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I1101 16:42:04.687368 16937 kubeadm.go:317] - 'systemctl status kubelet'
I1101 16:42:04.687407 16937 kubeadm.go:317] - 'journalctl -xeu kubelet'
I1101 16:42:04.687415 16937 kubeadm.go:317]
I1101 16:42:04.687529 16937 kubeadm.go:317] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I1101 16:42:04.687635 16937 kubeadm.go:317] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I1101 16:42:04.687741 16937 kubeadm.go:317] Here is one example how you may list all Kubernetes containers running in docker:
I1101 16:42:04.687795 16937 kubeadm.go:317] - 'docker ps -a | grep kube | grep -v pause'
I1101 16:42:04.687885 16937 kubeadm.go:317] Once you have found the failing container, you can inspect its logs with:
I1101 16:42:04.687922 16937 kubeadm.go:317] - 'docker logs CONTAINERID'
I1101 16:42:04.690203 16937 kubeadm.go:317] [WARNING Swap]: running with swap on is not supported. Please disable swap
I1101 16:42:04.690306 16937 kubeadm.go:317] [WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
I1101 16:42:04.690384 16937 kubeadm.go:317] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1101 16:42:04.690443 16937 kubeadm.go:317] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I1101 16:42:04.690508 16937 kubeadm.go:317] To see the stack trace of this error execute with --v=5 or higher
I1101 16:42:04.690531 16937 kubeadm.go:398] StartCluster complete in 3m54.833975793s
I1101 16:42:04.690630 16937 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I1101 16:42:04.713586 16937 logs.go:274] 0 containers: []
W1101 16:42:04.713597 16937 logs.go:276] No container was found matching "kube-apiserver"
I1101 16:42:04.713680 16937 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I1101 16:42:04.738878 16937 logs.go:274] 0 containers: []
W1101 16:42:04.738888 16937 logs.go:276] No container was found matching "etcd"
I1101 16:42:04.738969 16937 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I1101 16:42:04.760938 16937 logs.go:274] 0 containers: []
W1101 16:42:04.760950 16937 logs.go:276] No container was found matching "coredns"
I1101 16:42:04.761032 16937 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I1101 16:42:04.783149 16937 logs.go:274] 0 containers: []
W1101 16:42:04.783162 16937 logs.go:276] No container was found matching "kube-scheduler"
I1101 16:42:04.783245 16937 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I1101 16:42:04.807546 16937 logs.go:274] 0 containers: []
W1101 16:42:04.807556 16937 logs.go:276] No container was found matching "kube-proxy"
I1101 16:42:04.807637 16937 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I1101 16:42:04.829796 16937 logs.go:274] 0 containers: []
W1101 16:42:04.829808 16937 logs.go:276] No container was found matching "kubernetes-dashboard"
I1101 16:42:04.829893 16937 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I1101 16:42:04.852418 16937 logs.go:274] 0 containers: []
W1101 16:42:04.852430 16937 logs.go:276] No container was found matching "storage-provisioner"
I1101 16:42:04.852514 16937 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I1101 16:42:04.874628 16937 logs.go:274] 0 containers: []
W1101 16:42:04.874647 16937 logs.go:276] No container was found matching "kube-controller-manager"
I1101 16:42:04.874655 16937 logs.go:123] Gathering logs for kubelet ...
I1101 16:42:04.874663 16937 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1101 16:42:04.914041 16937 logs.go:123] Gathering logs for dmesg ...
I1101 16:42:04.914055 16937 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1101 16:42:04.926338 16937 logs.go:123] Gathering logs for describe nodes ...
I1101 16:42:04.926358 16937 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1101 16:42:04.982014 16937 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1101 16:42:04.982025 16937 logs.go:123] Gathering logs for Docker ...
I1101 16:42:04.982034 16937 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400"
I1101 16:42:04.998001 16937 logs.go:123] Gathering logs for container status ...
I1101 16:42:04.998017 16937 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1101 16:42:07.046997 16937 ssh_runner.go:235] Completed: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": (2.048987649s)
W1101 16:42:07.047145 16937 out.go:369] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W1101 16:42:07.047161 16937 out.go:239] *
*
W1101 16:42:07.047275 16937 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W1101 16:42:07.047291 16937 out.go:239] *
*
W1101 16:42:07.047919 16937 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1101 16:42:07.143929 16937 out.go:177]
W1101 16:42:07.187900 16937 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.20. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W1101 16:42:07.188021 16937 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W1101 16:42:07.188145 16937 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I1101 16:42:07.230635 16937 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p old-k8s-version-163757 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-163757
helpers_test.go:235: (dbg) docker inspect old-k8s-version-163757:
-- stdout --
[
{
"Id": "68479d844c03b1c96d1bf8e75ccb64eb9421923cb4772b8e7887ab9b5e6a873e",
"Created": "2022-11-01T23:38:04.256272958Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 255022,
"ExitCode": 0,
"Error": "",
"StartedAt": "2022-11-01T23:38:04.553352Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:866c1fe4e3f2d2bfd7e546c12f77c7ef1d94d65a891923ff6772712a9f20df40",
"ResolvConfPath": "/var/lib/docker/containers/68479d844c03b1c96d1bf8e75ccb64eb9421923cb4772b8e7887ab9b5e6a873e/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/68479d844c03b1c96d1bf8e75ccb64eb9421923cb4772b8e7887ab9b5e6a873e/hostname",
"HostsPath": "/var/lib/docker/containers/68479d844c03b1c96d1bf8e75ccb64eb9421923cb4772b8e7887ab9b5e6a873e/hosts",
"LogPath": "/var/lib/docker/containers/68479d844c03b1c96d1bf8e75ccb64eb9421923cb4772b8e7887ab9b5e6a873e/68479d844c03b1c96d1bf8e75ccb64eb9421923cb4772b8e7887ab9b5e6a873e-json.log",
"Name": "/old-k8s-version-163757",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-163757:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-163757",
"PortBindings": {
"22/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"2376/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"32443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"5000/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"8443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"ConsoleSize": [
0,
0
],
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": null,
"BlkioDeviceWriteBps": null,
"BlkioDeviceReadIOps": null,
"BlkioDeviceWriteIOps": null,
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"KernelMemory": 0,
"KernelMemoryTCP": 0,
"MemoryReservation": 0,
"MemorySwap": 2306867200,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": null,
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/1f6a16dc08ba19e57a68847f0d61ac0a698154f4025d83160d63955526b87a4a-init/diff:/var/lib/docker/overlay2/397c781354d1ae8b5c71df69b26a9a2493cf01723d23317a9b36f56b62ab53f3/diff:/var/lib/docker/overlay2/fe3fd9f7a011255c997093c6f7e1cb70c20cab26db5f52ff8b83c33d58519532/diff:/var/lib/docker/overlay2/f7328bad1e482720081fe1f9d1ab2ee05c71a9060abf63daf63a25e84818f237/diff:/var/lib/docker/overlay2/ca039979ed22affed678394443deee5ed35f2eb49243537b4205433189b87b2c/diff:/var/lib/docker/overlay2/a2ee3e754036b8777f801c847988e78d9b0ef881e82ea7467cef35a1261b9e20/diff:/var/lib/docker/overlay2/3de609efaeca546b0261017a1b19a9fa9ff6c9272609346b897e8075687c3698/diff:/var/lib/docker/overlay2/9101d388c406c87b2d10dc219dc3225ea59bfbedfc167adbfdf7578ed74a528b/diff:/var/lib/docker/overlay2/ba2db849d29a96ccb7729ee8861cfb647a06ba046b1016e99e3c2ef9e7b92675/diff:/var/lib/docker/overlay2/bb7315b5e1884c47eaad6eddfa4e422b1b240ff1d1112deab5ff41e40a12970d/diff:/var/lib/docker/overlay2/25fd1b
7d003c93a7ef576bb052318e940d8e1c8a40db37179b03563a8a099490/diff:/var/lib/docker/overlay2/f22743b1afcc328f7d2c4740efeb1401d6c011f499d200dc16b11a352dfc07f7/diff:/var/lib/docker/overlay2/59ca3268b7b3862516f40c07f313c5cdbe659f949ce4bd6e4eedcfcdd80409b0/diff:/var/lib/docker/overlay2/ce66536b9c7b7d4d38eeb3b0f5842c927c181c4584e60fa25989b9de30ec5856/diff:/var/lib/docker/overlay2/f0bdec7810d2b53f48492f34d7889fdb7c86d692422978de474816cf3bf8e923/diff:/var/lib/docker/overlay2/b0f0a882b23b6635539c83a8a2837c52090aa306e12f64ed83edcd03596f0cde/diff:/var/lib/docker/overlay2/60180139b1a11a94ee6174e6512bad4a5e162470c686d6cc7c91d7c9fb1907a2/diff:/var/lib/docker/overlay2/f1a7c8c448077705a2b48dfccf2f6e599a8ef782efd7d171b349ad43a0cddcae/diff:/var/lib/docker/overlay2/d64e00c1407419f2261e34d0974453ad696f514f79d8ecdac1b8c3a2a117349c/diff:/var/lib/docker/overlay2/7af90e8306e3b3e8ed7d2d67099da7a7cbe0ed97a5b983c84548135857efc4d0/diff:/var/lib/docker/overlay2/85101cd67d726a8a42d8951a230b3acd76d4a62615c6ffe4aac1ebef17ab422d/diff:/var/lib/d
ocker/overlay2/09a5d9c2f9897ae114e76d4aed5af38d250d044b1d274f8dafa0cfd17789ea54/diff:/var/lib/docker/overlay2/a6b97f972b460567b473da6022dd8658db13cb06830fcb676e8c1ebc927e1d44/diff:/var/lib/docker/overlay2/b569cecedfd9b79ea9a49645099405472d529e224ffe4abed0921d9fbec171a7/diff:/var/lib/docker/overlay2/278ceb611708e5dc8e810eaeb6b08b283d298009965d14772f2b61f95355477a/diff:/var/lib/docker/overlay2/c6693259dde0f3190d9019d8aca0c27c980d5c31a40fff8274d2a57d8ef19f41/diff:/var/lib/docker/overlay2/4db1d3b0ba37b1bfa0f486b9c1b327686a1069e2e6cbfc2e279c1f597f7cd346/diff:/var/lib/docker/overlay2/50e4b8ce3599837ac51b108fd983aa9b876f47f3e7253cd0976be8df23c73a33/diff:/var/lib/docker/overlay2/ad2b5d101e83bca01ddb2257701208ceb46b4668f6d14e84ee171975bb6175db/diff:/var/lib/docker/overlay2/746a904e8c69bb992522394e576896d4e35d056023809a58fbac92d497d2968a/diff:/var/lib/docker/overlay2/03794e35d9fe845753f9bcb5648e7a7c1fcf7db9bcd82c7c3824c2142cb8a2b6/diff:/var/lib/docker/overlay2/75caadeb2dfb8cc524a4e0f9d7862ccf017f755a24e00453f5a85eb29a5
837de/diff:/var/lib/docker/overlay2/1a5ce4ae9316bb13d1739267bf6b30a17188ca9ac127663735bfac3d15e50abe/diff:/var/lib/docker/overlay2/fa61eaf7b77e6fa75456860b8b75e4779478979f9b4ad94cd62eadd22743421e/diff:/var/lib/docker/overlay2/9c1cd4fe6bd059e33f020198f5ff305dab3f4b102b14b5894c76cae7dc769b92/diff:/var/lib/docker/overlay2/46cf92e0e9cc79002bfb0f5c2e0ab28c771f260b3fea2cb434cd84d3a1ea7659/diff:/var/lib/docker/overlay2/b47be14a30a9c0339a3a49b552cad979169d6c9a909e7837759a155b4c74d128/diff:/var/lib/docker/overlay2/598716c3d9ddb5de953d6a462fc1af49f742bbe02fd1c01f7d548a9f93d3913d/diff:/var/lib/docker/overlay2/cd665df1518202898f79e694456b55b64d6095a28556be2dc545241df7633be7/diff:/var/lib/docker/overlay2/909b0f879f4ce91be83bada76dad0599c2839fa8a6534f976ee095ad44dce7c6/diff:/var/lib/docker/overlay2/fd78ebbf3c4baf9a9f0036cb0ed9a8908a05f2e78572d88fcb3f026cb000710b/diff:/var/lib/docker/overlay2/8a030c72fc8571d3240e0ab2d2aea23b84385f28f3ef2dd82b5be5b925dbca5b/diff:/var/lib/docker/overlay2/d87a4221a646268a958798509b8c3cb343463c
c8427ae96a424f653a0a4508c7/diff",
"MergedDir": "/var/lib/docker/overlay2/1f6a16dc08ba19e57a68847f0d61ac0a698154f4025d83160d63955526b87a4a/merged",
"UpperDir": "/var/lib/docker/overlay2/1f6a16dc08ba19e57a68847f0d61ac0a698154f4025d83160d63955526b87a4a/diff",
"WorkDir": "/var/lib/docker/overlay2/1f6a16dc08ba19e57a68847f0d61ac0a698154f4025d83160d63955526b87a4a/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-163757",
"Source": "/var/lib/docker/volumes/old-k8s-version-163757/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-163757",
"Domainname": "",
"User": "root",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.35-1666722858-15219@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456",
"Volumes": null,
"WorkingDir": "",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-163757",
"name.minikube.sigs.k8s.io": "old-k8s-version-163757",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "5472cb82da8929c3d0db0f9316dc08cbb041f5d539a2b6c73a38333e68096a2a",
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"Ports": {
"22/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "53802"
}
],
"2376/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "53803"
}
],
"32443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "53804"
}
],
"5000/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "53805"
}
],
"8443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "53806"
}
]
},
"SandboxKey": "/var/run/docker/netns/5472cb82da89",
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-163757": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": [
"68479d844c03",
"old-k8s-version-163757"
],
"NetworkID": "de11f6b0d4a3e9909764ae953f0f910d0d29438f96300416f12a7f896caa0f32",
"EndpointID": "fbf513e735e71ad7a57cbd013d561aabe79fef5c74eebf9784b22027f797ce5a",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"MacAddress": "02:42:c0:a8:4c:02",
"DriverOpts": null
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-163757 -n old-k8s-version-163757
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-163757 -n old-k8s-version-163757: exit status 6 (437.097901ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E1101 16:42:07.786798 17669 status.go:415] kubeconfig endpoint: extract IP: "old-k8s-version-163757" does not appear in /Users/jenkins/minikube-integration/15232-2108/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-163757" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (249.88s)