=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-darwin-amd64 start -p old-k8s-version-20220725131610-44543 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0
E0725 13:16:27.482632 44543 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/addons-20220725121918-44543/client.crt: no such file or directory
=== CONT TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-20220725131610-44543 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0: exit status 109 (4m9.423152584s)
-- stdout --
* [old-k8s-version-20220725131610-44543] minikube v1.26.0 on Darwin 12.4
- MINIKUBE_LOCATION=14555
- KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube
* Using the docker driver based on user configuration
* Using Docker Desktop driver with root privileges
* Starting control plane node old-k8s-version-20220725131610-44543 in cluster old-k8s-version-20220725131610-44543
* Pulling base image ...
* Creating docker container (CPUs=2, Memory=2200MB) ...
* Preparing Kubernetes v1.16.0 on Docker 20.10.17 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0725 13:16:10.818819 59354 out.go:296] Setting OutFile to fd 1 ...
I0725 13:16:10.819029 59354 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0725 13:16:10.819035 59354 out.go:309] Setting ErrFile to fd 2...
I0725 13:16:10.819039 59354 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0725 13:16:10.819148 59354 root.go:332] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/bin
I0725 13:16:10.819669 59354 out.go:303] Setting JSON to false
I0725 13:16:10.835202 59354 start.go:115] hostinfo: {"hostname":"MacOS-Agent-3.local","uptime":15342,"bootTime":1658764828,"procs":353,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"12.4","kernelVersion":"21.5.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}
W0725 13:16:10.835328 59354 start.go:123] gopshost.Virtualization returned error: not implemented yet
I0725 13:16:10.877549 59354 out.go:177] * [old-k8s-version-20220725131610-44543] minikube v1.26.0 on Darwin 12.4
I0725 13:16:10.898794 59354 notify.go:193] Checking for updates...
I0725 13:16:10.935556 59354 out.go:177] - MINIKUBE_LOCATION=14555
I0725 13:16:11.009530 59354 out.go:177] - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/kubeconfig
I0725 13:16:11.067497 59354 out.go:177] - MINIKUBE_BIN=out/minikube-darwin-amd64
I0725 13:16:11.141547 59354 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0725 13:16:11.199621 59354 out.go:177] - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube
I0725 13:16:11.237752 59354 config.go:178] Loaded profile config "kubenet-20220725125922-44543": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.24.2
I0725 13:16:11.237867 59354 driver.go:365] Setting default libvirt URI to qemu:///system
I0725 13:16:11.312147 59354 docker.go:137] docker version: linux-20.10.17
I0725 13:16:11.312315 59354 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0725 13:16:11.457763 59354 info.go:265] docker info: {ID:DEPZ:X5EQ:JUVI:7TAY:IXPP:M3QT:KGJK:NK3N:YSWM:HAHS:YLUF:RBE6 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:59 OomKillDisable:false NGoroutines:51 SystemTime:2022-07-25 20:16:11.387275843 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.104-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexSer
verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6232580096 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defau
lt name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.1] map[Name:extension Path:/usr/local/lib/docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.7] map[Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
I0725 13:16:11.518495 59354 out.go:177] * Using the docker driver based on user configuration
I0725 13:16:11.539823 59354 start.go:284] selected driver: docker
I0725 13:16:11.539860 59354 start.go:808] validating driver "docker" against <nil>
I0725 13:16:11.539896 59354 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0725 13:16:11.543434 59354 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0725 13:16:11.677930 59354 info.go:265] docker info: {ID:DEPZ:X5EQ:JUVI:7TAY:IXPP:M3QT:KGJK:NK3N:YSWM:HAHS:YLUF:RBE6 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:59 OomKillDisable:false NGoroutines:51 SystemTime:2022-07-25 20:16:11.611918441 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.104-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexSer
verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6232580096 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defau
lt name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.1] map[Name:extension Path:/usr/local/lib/docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.7] map[Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
I0725 13:16:11.678058 59354 start_flags.go:296] no existing cluster config was found, will generate one from the flags
I0725 13:16:11.678207 59354 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0725 13:16:11.699440 59354 out.go:177] * Using Docker Desktop driver with root privileges
I0725 13:16:11.720979 59354 cni.go:95] Creating CNI manager for ""
I0725 13:16:11.720999 59354 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I0725 13:16:11.721014 59354 start_flags.go:310] config:
{Name:old-k8s-version-20220725131610-44543 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220725131610-44543 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSD
omain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
I0725 13:16:11.742338 59354 out.go:177] * Starting control plane node old-k8s-version-20220725131610-44543 in cluster old-k8s-version-20220725131610-44543
I0725 13:16:11.784279 59354 cache.go:120] Beginning downloading kic base image for docker with docker
I0725 13:16:11.806037 59354 out.go:177] * Pulling base image ...
I0725 13:16:11.848044 59354 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0725 13:16:11.848095 59354 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 in local docker daemon
I0725 13:16:11.848121 59354 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4
I0725 13:16:11.848147 59354 cache.go:57] Caching tarball of preloaded images
I0725 13:16:11.848326 59354 preload.go:174] Found /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0725 13:16:11.848347 59354 cache.go:60] Finished verifying existence of preloaded tar for v1.16.0 on docker
I0725 13:16:11.849187 59354 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/config.json ...
I0725 13:16:11.849274 59354 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/config.json: {Name:mk5dd4ca22835796a5be7bf683c0fde449b0d077 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0725 13:16:11.912185 59354 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 in local docker daemon, skipping pull
I0725 13:16:11.912207 59354 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 exists in daemon, skipping load
I0725 13:16:11.912218 59354 cache.go:208] Successfully downloaded all kic artifacts
I0725 13:16:11.912264 59354 start.go:370] acquiring machines lock for old-k8s-version-20220725131610-44543: {Name:mka786150aa94c7510878ab5519b8cf30abe9378 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0725 13:16:11.912411 59354 start.go:374] acquired machines lock for "old-k8s-version-20220725131610-44543" in 136.14µs
I0725 13:16:11.912438 59354 start.go:92] Provisioning new machine with config: &{Name:old-k8s-version-20220725131610-44543 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220725131610-44543
Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMi
rror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0725 13:16:11.912542 59354 start.go:132] createHost starting for "" (driver="docker")
I0725 13:16:11.956229 59354 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0725 13:16:11.956503 59354 start.go:166] libmachine.API.Create for "old-k8s-version-20220725131610-44543" (driver="docker")
I0725 13:16:11.956539 59354 client.go:168] LocalClient.Create starting
I0725 13:16:11.956654 59354 main.go:134] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/ca.pem
I0725 13:16:11.956701 59354 main.go:134] libmachine: Decoding PEM data...
I0725 13:16:11.956721 59354 main.go:134] libmachine: Parsing certificate...
I0725 13:16:11.956811 59354 main.go:134] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/cert.pem
I0725 13:16:11.956853 59354 main.go:134] libmachine: Decoding PEM data...
I0725 13:16:11.956866 59354 main.go:134] libmachine: Parsing certificate...
I0725 13:16:11.957394 59354 cli_runner.go:164] Run: docker network inspect old-k8s-version-20220725131610-44543 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0725 13:16:12.020705 59354 cli_runner.go:211] docker network inspect old-k8s-version-20220725131610-44543 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0725 13:16:12.020804 59354 network_create.go:272] running [docker network inspect old-k8s-version-20220725131610-44543] to gather additional debugging logs...
I0725 13:16:12.020828 59354 cli_runner.go:164] Run: docker network inspect old-k8s-version-20220725131610-44543
W0725 13:16:12.083461 59354 cli_runner.go:211] docker network inspect old-k8s-version-20220725131610-44543 returned with exit code 1
I0725 13:16:12.083492 59354 network_create.go:275] error running [docker network inspect old-k8s-version-20220725131610-44543]: docker network inspect old-k8s-version-20220725131610-44543: exit status 1
stdout:
[]
stderr:
Error: No such network: old-k8s-version-20220725131610-44543
I0725 13:16:12.083507 59354 network_create.go:277] output of [docker network inspect old-k8s-version-20220725131610-44543]: -- stdout --
[]
-- /stdout --
** stderr **
Error: No such network: old-k8s-version-20220725131610-44543
** /stderr **
I0725 13:16:12.083744 59354 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0725 13:16:12.147083 59354 network.go:288] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc00000e938] misses:0}
I0725 13:16:12.147129 59354 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0725 13:16:12.147144 59354 network_create.go:115] attempt to create docker network old-k8s-version-20220725131610-44543 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0725 13:16:12.147210 59354 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220725131610-44543 old-k8s-version-20220725131610-44543
W0725 13:16:12.210310 59354 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220725131610-44543 old-k8s-version-20220725131610-44543 returned with exit code 1
W0725 13:16:12.210356 59354 network_create.go:107] failed to create docker network old-k8s-version-20220725131610-44543 192.168.49.0/24, will retry: subnet is taken
I0725 13:16:12.210606 59354 network.go:279] skipping subnet 192.168.49.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc00000e938] amended:false}} dirty:map[] misses:0}
I0725 13:16:12.210623 59354 network.go:238] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0725 13:16:12.210827 59354 network.go:288] reserving subnet 192.168.58.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc00000e938] amended:true}} dirty:map[192.168.49.0:0xc00000e938 192.168.58.0:0xc00000e970] misses:0}
I0725 13:16:12.210840 59354 network.go:235] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0725 13:16:12.210855 59354 network_create.go:115] attempt to create docker network old-k8s-version-20220725131610-44543 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ...
I0725 13:16:12.210915 59354 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220725131610-44543 old-k8s-version-20220725131610-44543
W0725 13:16:12.273068 59354 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220725131610-44543 old-k8s-version-20220725131610-44543 returned with exit code 1
W0725 13:16:12.273108 59354 network_create.go:107] failed to create docker network old-k8s-version-20220725131610-44543 192.168.58.0/24, will retry: subnet is taken
I0725 13:16:12.273378 59354 network.go:279] skipping subnet 192.168.58.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc00000e938] amended:true}} dirty:map[192.168.49.0:0xc00000e938 192.168.58.0:0xc00000e970] misses:1}
I0725 13:16:12.273396 59354 network.go:238] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0725 13:16:12.273604 59354 network.go:288] reserving subnet 192.168.67.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc00000e938] amended:true}} dirty:map[192.168.49.0:0xc00000e938 192.168.58.0:0xc00000e970 192.168.67.0:0xc000a16240] misses:1}
I0725 13:16:12.273617 59354 network.go:235] using free private subnet 192.168.67.0/24: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0725 13:16:12.273624 59354 network_create.go:115] attempt to create docker network old-k8s-version-20220725131610-44543 192.168.67.0/24 with gateway 192.168.67.1 and MTU of 1500 ...
I0725 13:16:12.273681 59354 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220725131610-44543 old-k8s-version-20220725131610-44543
I0725 13:16:12.369119 59354 network_create.go:99] docker network old-k8s-version-20220725131610-44543 192.168.67.0/24 created
I0725 13:16:12.369150 59354 kic.go:106] calculated static IP "192.168.67.2" for the "old-k8s-version-20220725131610-44543" container
I0725 13:16:12.369232 59354 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0725 13:16:12.435953 59354 cli_runner.go:164] Run: docker volume create old-k8s-version-20220725131610-44543 --label name.minikube.sigs.k8s.io=old-k8s-version-20220725131610-44543 --label created_by.minikube.sigs.k8s.io=true
I0725 13:16:12.499678 59354 oci.go:103] Successfully created a docker volume old-k8s-version-20220725131610-44543
I0725 13:16:12.499772 59354 cli_runner.go:164] Run: docker run --rm --name old-k8s-version-20220725131610-44543-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-20220725131610-44543 --entrypoint /usr/bin/test -v old-k8s-version-20220725131610-44543:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 -d /var/lib
I0725 13:16:12.972625 59354 oci.go:107] Successfully prepared a docker volume old-k8s-version-20220725131610-44543
I0725 13:16:12.972680 59354 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0725 13:16:12.972695 59354 kic.go:179] Starting extracting preloaded images to volume ...
I0725 13:16:12.972789 59354 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-20220725131610-44543:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 -I lz4 -xf /preloaded.tar -C /extractDir
I0725 13:16:17.034793 59354 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-20220725131610-44543:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 -I lz4 -xf /preloaded.tar -C /extractDir: (4.061843182s)
I0725 13:16:17.034814 59354 kic.go:188] duration metric: took 4.062039 seconds to extract preloaded images to volume
I0725 13:16:17.034916 59354 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0725 13:16:17.168186 59354 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname old-k8s-version-20220725131610-44543 --name old-k8s-version-20220725131610-44543 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-20220725131610-44543 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=old-k8s-version-20220725131610-44543 --network old-k8s-version-20220725131610-44543 --ip 192.168.67.2 --volume old-k8s-version-20220725131610-44543:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=8443 --publish=22 --publish=2376 --publish=5000 --publish=32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842
I0725 13:16:17.545162 59354 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220725131610-44543 --format={{.State.Running}}
I0725 13:16:17.619842 59354 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220725131610-44543 --format={{.State.Status}}
I0725 13:16:17.707610 59354 cli_runner.go:164] Run: docker exec old-k8s-version-20220725131610-44543 stat /var/lib/dpkg/alternatives/iptables
I0725 13:16:17.846679 59354 oci.go:144] the created container "old-k8s-version-20220725131610-44543" has a running status.
I0725 13:16:17.846714 59354 kic.go:210] Creating ssh key for kic: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/machines/old-k8s-version-20220725131610-44543/id_rsa...
I0725 13:16:17.918431 59354 kic_runner.go:191] docker (temp): /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/machines/old-k8s-version-20220725131610-44543/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0725 13:16:18.033474 59354 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220725131610-44543 --format={{.State.Status}}
I0725 13:16:18.103425 59354 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0725 13:16:18.103443 59354 kic_runner.go:114] Args: [docker exec --privileged old-k8s-version-20220725131610-44543 chown docker:docker /home/docker/.ssh/authorized_keys]
I0725 13:16:18.229368 59354 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220725131610-44543 --format={{.State.Status}}
I0725 13:16:18.299602 59354 machine.go:88] provisioning docker machine ...
I0725 13:16:18.299730 59354 ubuntu.go:169] provisioning hostname "old-k8s-version-20220725131610-44543"
I0725 13:16:18.299843 59354 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220725131610-44543
I0725 13:16:18.369714 59354 main.go:134] libmachine: Using SSH client type: native
I0725 13:16:18.369934 59354 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2e20] 0x13d5e80 <nil> [] 0s} 127.0.0.1 58398 <nil> <nil>}
I0725 13:16:18.369948 59354 main.go:134] libmachine: About to run SSH command:
sudo hostname old-k8s-version-20220725131610-44543 && echo "old-k8s-version-20220725131610-44543" | sudo tee /etc/hostname
I0725 13:16:18.496082 59354 main.go:134] libmachine: SSH cmd err, output: <nil>: old-k8s-version-20220725131610-44543
I0725 13:16:18.496163 59354 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220725131610-44543
I0725 13:16:18.569514 59354 main.go:134] libmachine: Using SSH client type: native
I0725 13:16:18.569670 59354 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2e20] 0x13d5e80 <nil> [] 0s} 127.0.0.1 58398 <nil> <nil>}
I0725 13:16:18.569688 59354 main.go:134] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-20220725131610-44543' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-20220725131610-44543/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-20220725131610-44543' | sudo tee -a /etc/hosts;
fi
fi
I0725 13:16:18.692426 59354 main.go:134] libmachine: SSH cmd err, output: <nil>:
I0725 13:16:18.692446 59354 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube CaCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/key.pem ServerCertRemotePath:/etc/doc
ker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube}
I0725 13:16:18.692486 59354 ubuntu.go:177] setting up certificates
I0725 13:16:18.692496 59354 provision.go:83] configureAuth start
I0725 13:16:18.692562 59354 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220725131610-44543
I0725 13:16:18.762777 59354 provision.go:138] copyHostCerts
I0725 13:16:18.762865 59354 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/ca.pem, removing ...
I0725 13:16:18.762875 59354 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/ca.pem
I0725 13:16:18.762972 59354 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/ca.pem (1082 bytes)
I0725 13:16:18.763164 59354 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/cert.pem, removing ...
I0725 13:16:18.763197 59354 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/cert.pem
I0725 13:16:18.763263 59354 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/cert.pem (1123 bytes)
I0725 13:16:18.763408 59354 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/key.pem, removing ...
I0725 13:16:18.763414 59354 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/key.pem
I0725 13:16:18.763467 59354 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/key.pem (1675 bytes)
I0725 13:16:18.763574 59354 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-20220725131610-44543 san=[192.168.67.2 127.0.0.1 localhost 127.0.0.1 minikube old-k8s-version-20220725131610-44543]
I0725 13:16:18.821561 59354 provision.go:172] copyRemoteCerts
I0725 13:16:18.821610 59354 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0725 13:16:18.821656 59354 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220725131610-44543
I0725 13:16:18.893189 59354 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:58398 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/machines/old-k8s-version-20220725131610-44543/id_rsa Username:docker}
I0725 13:16:18.979311 59354 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0725 13:16:18.999424 59354 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/machines/server.pem --> /etc/docker/server.pem (1281 bytes)
I0725 13:16:19.016818 59354 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0725 13:16:19.034825 59354 provision.go:86] duration metric: configureAuth took 342.30729ms
I0725 13:16:19.034842 59354 ubuntu.go:193] setting minikube options for container-runtime
I0725 13:16:19.034976 59354 config.go:178] Loaded profile config "old-k8s-version-20220725131610-44543": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
I0725 13:16:19.035029 59354 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220725131610-44543
I0725 13:16:19.105602 59354 main.go:134] libmachine: Using SSH client type: native
I0725 13:16:19.105742 59354 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2e20] 0x13d5e80 <nil> [] 0s} 127.0.0.1 58398 <nil> <nil>}
I0725 13:16:19.105756 59354 main.go:134] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0725 13:16:19.225612 59354 main.go:134] libmachine: SSH cmd err, output: <nil>: overlay
I0725 13:16:19.225632 59354 ubuntu.go:71] root file system type: overlay
I0725 13:16:19.225813 59354 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0725 13:16:19.225886 59354 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220725131610-44543
I0725 13:16:19.296002 59354 main.go:134] libmachine: Using SSH client type: native
I0725 13:16:19.296163 59354 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2e20] 0x13d5e80 <nil> [] 0s} 127.0.0.1 58398 <nil> <nil>}
I0725 13:16:19.296211 59354 main.go:134] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0725 13:16:19.425869 59354 main.go:134] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0725 13:16:19.425943 59354 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220725131610-44543
I0725 13:16:19.496615 59354 main.go:134] libmachine: Using SSH client type: native
I0725 13:16:19.496772 59354 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2e20] 0x13d5e80 <nil> [] 0s} 127.0.0.1 58398 <nil> <nil>}
I0725 13:16:19.496786 59354 main.go:134] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0725 13:16:20.096254 59354 main.go:134] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2022-06-06 23:01:03.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2022-07-25 20:16:19.439112633 +0000
@@ -1,30 +1,32 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
Wants=network-online.target
-Requires=docker.socket containerd.service
+Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutSec=0
-RestartSec=2
-Restart=always
-
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
+Restart=on-failure
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
@@ -32,16 +34,16 @@
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0725 13:16:20.096280 59354 machine.go:91] provisioned docker machine in 1.796546235s
I0725 13:16:20.096287 59354 client.go:171] LocalClient.Create took 8.139580327s
I0725 13:16:20.096302 59354 start.go:174] duration metric: libmachine.API.Create for "old-k8s-version-20220725131610-44543" took 8.139638135s
I0725 13:16:20.096312 59354 start.go:307] post-start starting for "old-k8s-version-20220725131610-44543" (driver="docker")
I0725 13:16:20.096317 59354 start.go:334] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0725 13:16:20.096384 59354 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0725 13:16:20.096433 59354 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220725131610-44543
I0725 13:16:20.170020 59354 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:58398 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/machines/old-k8s-version-20220725131610-44543/id_rsa Username:docker}
I0725 13:16:20.256257 59354 ssh_runner.go:195] Run: cat /etc/os-release
I0725 13:16:20.259856 59354 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0725 13:16:20.259874 59354 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0725 13:16:20.259881 59354 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0725 13:16:20.259887 59354 info.go:137] Remote host: Ubuntu 20.04.4 LTS
I0725 13:16:20.259896 59354 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/addons for local assets ...
I0725 13:16:20.260008 59354 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/files for local assets ...
I0725 13:16:20.260158 59354 filesync.go:149] local asset: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/files/etc/ssl/certs/445432.pem -> 445432.pem in /etc/ssl/certs
I0725 13:16:20.260310 59354 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0725 13:16:20.267295 59354 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/files/etc/ssl/certs/445432.pem --> /etc/ssl/certs/445432.pem (1708 bytes)
I0725 13:16:20.285830 59354 start.go:310] post-start completed in 189.50552ms
I0725 13:16:20.286359 59354 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220725131610-44543
I0725 13:16:20.356448 59354 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/config.json ...
I0725 13:16:20.356866 59354 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0725 13:16:20.356912 59354 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220725131610-44543
I0725 13:16:20.426850 59354 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:58398 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/machines/old-k8s-version-20220725131610-44543/id_rsa Username:docker}
I0725 13:16:20.509175 59354 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0725 13:16:20.513936 59354 start.go:135] duration metric: createHost completed in 8.601214073s
I0725 13:16:20.513951 59354 start.go:82] releasing machines lock for "old-k8s-version-20220725131610-44543", held for 8.601361457s
I0725 13:16:20.514040 59354 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220725131610-44543
I0725 13:16:20.584384 59354 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
I0725 13:16:20.584386 59354 ssh_runner.go:195] Run: systemctl --version
I0725 13:16:20.584461 59354 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220725131610-44543
I0725 13:16:20.584491 59354 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220725131610-44543
I0725 13:16:20.662571 59354 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:58398 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/machines/old-k8s-version-20220725131610-44543/id_rsa Username:docker}
I0725 13:16:20.664645 59354 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:58398 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/machines/old-k8s-version-20220725131610-44543/id_rsa Username:docker}
I0725 13:16:20.876936 59354 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0725 13:16:20.886914 59354 cruntime.go:273] skipping containerd shutdown because we are bound to it
I0725 13:16:20.886979 59354 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0725 13:16:20.895823 59354 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
image-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0725 13:16:20.908853 59354 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0725 13:16:20.982597 59354 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0725 13:16:21.056079 59354 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0725 13:16:21.129557 59354 ssh_runner.go:195] Run: sudo systemctl restart docker
I0725 13:16:21.322769 59354 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0725 13:16:21.357268 59354 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0725 13:16:21.417798 59354 out.go:204] * Preparing Kubernetes v1.16.0 on Docker 20.10.17 ...
I0725 13:16:21.417911 59354 cli_runner.go:164] Run: docker exec -t old-k8s-version-20220725131610-44543 dig +short host.docker.internal
I0725 13:16:21.548017 59354 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2
I0725 13:16:21.548113 59354 ssh_runner.go:195] Run: grep 192.168.65.2 host.minikube.internal$ /etc/hosts
I0725 13:16:21.552218 59354 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0725 13:16:21.561546 59354 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-20220725131610-44543
I0725 13:16:21.633922 59354 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0725 13:16:21.633992 59354 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0725 13:16:21.662633 59354 docker.go:611] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0725 13:16:21.662651 59354 docker.go:542] Images already preloaded, skipping extraction
I0725 13:16:21.662716 59354 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0725 13:16:21.693049 59354 docker.go:611] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0725 13:16:21.693067 59354 cache_images.go:84] Images are preloaded, skipping loading
I0725 13:16:21.693136 59354 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0725 13:16:21.765549 59354 cni.go:95] Creating CNI manager for ""
I0725 13:16:21.765561 59354 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I0725 13:16:21.765575 59354 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0725 13:16:21.765592 59354 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.67.2 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-20220725131610-44543 NodeName:old-k8s-version-20220725131610-44543 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.67.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.67.2 CgroupDriver:systemd Clien
tCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
I0725 13:16:21.765697 59354 kubeadm.go:162] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.67.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-20220725131610-44543"
kubeletExtraArgs:
node-ip: 192.168.67.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.67.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-20220725131610-44543
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.67.2:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0725 13:16:21.765770 59354 kubeadm.go:961] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-20220725131610-44543 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.67.2
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220725131610-44543 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0725 13:16:21.765828 59354 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0725 13:16:21.773382 59354 binaries.go:44] Found k8s binaries, skipping transfer
I0725 13:16:21.773451 59354 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0725 13:16:21.783746 59354 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (362 bytes)
I0725 13:16:21.796778 59354 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0725 13:16:21.809701 59354 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2148 bytes)
I0725 13:16:21.822419 59354 ssh_runner.go:195] Run: grep 192.168.67.2 control-plane.minikube.internal$ /etc/hosts
I0725 13:16:21.826080 59354 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.67.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0725 13:16:21.835312 59354 certs.go:54] Setting up /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543 for IP: 192.168.67.2
I0725 13:16:21.835417 59354 certs.go:182] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/ca.key
I0725 13:16:21.835466 59354 certs.go:182] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/proxy-client-ca.key
I0725 13:16:21.835506 59354 certs.go:302] generating minikube-user signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/client.key
I0725 13:16:21.835518 59354 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/client.crt with IP's: []
I0725 13:16:21.996349 59354 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/client.crt ...
I0725 13:16:21.996369 59354 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/client.crt: {Name:mk347defbaabab765ff15869c58230699290eb25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0725 13:16:21.996697 59354 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/client.key ...
I0725 13:16:21.996707 59354 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/client.key: {Name:mkb395df645cc095773da1b287b1c21a4552d7fc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0725 13:16:21.996896 59354 certs.go:302] generating minikube signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/apiserver.key.c7fa3a9e
I0725 13:16:21.996911 59354 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/apiserver.crt.c7fa3a9e with IP's: [192.168.67.2 10.96.0.1 127.0.0.1 10.0.0.1]
I0725 13:16:22.097815 59354 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/apiserver.crt.c7fa3a9e ...
I0725 13:16:22.097827 59354 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/apiserver.crt.c7fa3a9e: {Name:mkf21576f3efdeaf6b64beff9be386ebf9fbee4e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0725 13:16:22.098097 59354 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/apiserver.key.c7fa3a9e ...
I0725 13:16:22.098104 59354 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/apiserver.key.c7fa3a9e: {Name:mk713893cc97f79ee1bc5563cf471153e23bc938 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0725 13:16:22.098303 59354 certs.go:320] copying /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/apiserver.crt.c7fa3a9e -> /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/apiserver.crt
I0725 13:16:22.098452 59354 certs.go:324] copying /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/apiserver.key.c7fa3a9e -> /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/apiserver.key
I0725 13:16:22.098597 59354 certs.go:302] generating aggregator signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/proxy-client.key
I0725 13:16:22.098610 59354 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/proxy-client.crt with IP's: []
I0725 13:16:22.272427 59354 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/proxy-client.crt ...
I0725 13:16:22.272442 59354 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/proxy-client.crt: {Name:mk688b3af8b2ab195d9d01194633b7d169d08d43 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0725 13:16:22.272716 59354 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/proxy-client.key ...
I0725 13:16:22.272724 59354 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/proxy-client.key: {Name:mk2429eeb2f3d99144be9c53cc2a73dbca848e00 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0725 13:16:22.273097 59354 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/44543.pem (1338 bytes)
W0725 13:16:22.273138 59354 certs.go:384] ignoring /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/44543_empty.pem, impossibly tiny 0 bytes
I0725 13:16:22.273148 59354 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/ca-key.pem (1679 bytes)
I0725 13:16:22.273179 59354 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/ca.pem (1082 bytes)
I0725 13:16:22.273209 59354 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/cert.pem (1123 bytes)
I0725 13:16:22.273237 59354 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/key.pem (1675 bytes)
I0725 13:16:22.273299 59354 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/files/etc/ssl/certs/445432.pem (1708 bytes)
I0725 13:16:22.273751 59354 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0725 13:16:22.291090 59354 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0725 13:16:22.307742 59354 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0725 13:16:22.324438 59354 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/profiles/old-k8s-version-20220725131610-44543/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0725 13:16:22.341430 59354 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0725 13:16:22.357886 59354 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0725 13:16:22.374853 59354 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0725 13:16:22.391582 59354 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0725 13:16:22.408992 59354 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/certs/44543.pem --> /usr/share/ca-certificates/44543.pem (1338 bytes)
I0725 13:16:22.425960 59354 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/files/etc/ssl/certs/445432.pem --> /usr/share/ca-certificates/445432.pem (1708 bytes)
I0725 13:16:22.443026 59354 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0725 13:16:22.459576 59354 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0725 13:16:22.472806 59354 ssh_runner.go:195] Run: openssl version
I0725 13:16:22.478127 59354 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/44543.pem && ln -fs /usr/share/ca-certificates/44543.pem /etc/ssl/certs/44543.pem"
I0725 13:16:22.488024 59354 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/44543.pem
I0725 13:16:22.491976 59354 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jul 25 19:24 /usr/share/ca-certificates/44543.pem
I0725 13:16:22.492030 59354 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/44543.pem
I0725 13:16:22.497517 59354 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/44543.pem /etc/ssl/certs/51391683.0"
I0725 13:16:22.506305 59354 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/445432.pem && ln -fs /usr/share/ca-certificates/445432.pem /etc/ssl/certs/445432.pem"
I0725 13:16:22.515504 59354 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/445432.pem
I0725 13:16:22.519342 59354 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jul 25 19:24 /usr/share/ca-certificates/445432.pem
I0725 13:16:22.519390 59354 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/445432.pem
I0725 13:16:22.524978 59354 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/445432.pem /etc/ssl/certs/3ec20f2e.0"
I0725 13:16:22.532651 59354 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0725 13:16:22.540339 59354 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0725 13:16:22.544256 59354 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jul 25 19:19 /usr/share/ca-certificates/minikubeCA.pem
I0725 13:16:22.544315 59354 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0725 13:16:22.549466 59354 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0725 13:16:22.557063 59354 kubeadm.go:395] StartCluster: {Name:old-k8s-version-20220725131610-44543 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220725131610-44543 Namespace:default API
ServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disa
bleOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
I0725 13:16:22.557154 59354 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0725 13:16:22.588471 59354 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0725 13:16:22.595996 59354 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0725 13:16:22.603095 59354 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I0725 13:16:22.603145 59354 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0725 13:16:22.610377 59354 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0725 13:16:22.610395 59354 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0725 13:16:23.370683 59354 out.go:204] - Generating certificates and keys ...
I0725 13:16:25.465734 59354 out.go:204] - Booting up control plane ...
W0725 13:18:20.393115 59354 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-20220725131610-44543 localhost] and IPs [192.168.67.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-20220725131610-44543 localhost] and IPs [192.168.67.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-20220725131610-44543 localhost] and IPs [192.168.67.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-20220725131610-44543 localhost] and IPs [192.168.67.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0725 13:18:20.393149 59354 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"
I0725 13:18:20.813591 59354 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0725 13:18:20.823227 59354 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I0725 13:18:20.843772 59354 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0725 13:18:20.852711 59354 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0725 13:18:20.852740 59354 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0725 13:18:21.594523 59354 out.go:204] - Generating certificates and keys ...
I0725 13:18:22.621226 59354 out.go:204] - Booting up control plane ...
I0725 13:20:17.560862 59354 kubeadm.go:397] StartCluster complete in 3m54.97595343s
I0725 13:20:17.560936 59354 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0725 13:20:17.589631 59354 logs.go:274] 0 containers: []
W0725 13:20:17.589643 59354 logs.go:276] No container was found matching "kube-apiserver"
I0725 13:20:17.589702 59354 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0725 13:20:17.618139 59354 logs.go:274] 0 containers: []
W0725 13:20:17.618154 59354 logs.go:276] No container was found matching "etcd"
I0725 13:20:17.618211 59354 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0725 13:20:17.647445 59354 logs.go:274] 0 containers: []
W0725 13:20:17.647457 59354 logs.go:276] No container was found matching "coredns"
I0725 13:20:17.647510 59354 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0725 13:20:17.675695 59354 logs.go:274] 0 containers: []
W0725 13:20:17.675709 59354 logs.go:276] No container was found matching "kube-scheduler"
I0725 13:20:17.675767 59354 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0725 13:20:17.704369 59354 logs.go:274] 0 containers: []
W0725 13:20:17.704382 59354 logs.go:276] No container was found matching "kube-proxy"
I0725 13:20:17.704436 59354 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0725 13:20:17.736593 59354 logs.go:274] 0 containers: []
W0725 13:20:17.736605 59354 logs.go:276] No container was found matching "kubernetes-dashboard"
I0725 13:20:17.736666 59354 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0725 13:20:17.767457 59354 logs.go:274] 0 containers: []
W0725 13:20:17.767470 59354 logs.go:276] No container was found matching "storage-provisioner"
I0725 13:20:17.767530 59354 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0725 13:20:17.796619 59354 logs.go:274] 0 containers: []
W0725 13:20:17.796632 59354 logs.go:276] No container was found matching "kube-controller-manager"
I0725 13:20:17.796639 59354 logs.go:123] Gathering logs for kubelet ...
I0725 13:20:17.796646 59354 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0725 13:20:17.836946 59354 logs.go:123] Gathering logs for dmesg ...
I0725 13:20:17.836960 59354 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0725 13:20:17.848210 59354 logs.go:123] Gathering logs for describe nodes ...
I0725 13:20:17.848224 59354 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0725 13:20:17.905820 59354 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0725 13:20:17.905831 59354 logs.go:123] Gathering logs for Docker ...
I0725 13:20:17.905838 59354 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400"
I0725 13:20:17.921877 59354 logs.go:123] Gathering logs for container status ...
I0725 13:20:17.921890 59354 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0725 13:20:19.975556 59354 ssh_runner.go:235] Completed: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": (2.053584622s)
W0725 13:20:19.975689 59354 out.go:369] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0725 13:20:19.975704 59354 out.go:239] *
*
W0725 13:20:19.975818 59354 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0725 13:20:19.975832 59354 out.go:239] *
*
W0725 13:20:19.976335 59354 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0725 13:20:20.040175 59354 out.go:177]
W0725 13:20:20.082556 59354 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0725 13:20:20.082723 59354 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0725 13:20:20.082877 59354 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0725 13:20:20.146355 59354 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p old-k8s-version-20220725131610-44543 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-20220725131610-44543
helpers_test.go:235: (dbg) docker inspect old-k8s-version-20220725131610-44543:
-- stdout --
[
{
"Id": "6935d4927a39f4ec4845798aff773e95bc8ae838958e9958b965359cf4e99f8c",
"Created": "2022-07-25T20:16:17.246440867Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 230890,
"ExitCode": 0,
"Error": "",
"StartedAt": "2022-07-25T20:16:17.551184518Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:443d84da239e4e701685e1614ef94cd6b60d0f0b15265a51d4f657992a9c59d8",
"ResolvConfPath": "/var/lib/docker/containers/6935d4927a39f4ec4845798aff773e95bc8ae838958e9958b965359cf4e99f8c/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/6935d4927a39f4ec4845798aff773e95bc8ae838958e9958b965359cf4e99f8c/hostname",
"HostsPath": "/var/lib/docker/containers/6935d4927a39f4ec4845798aff773e95bc8ae838958e9958b965359cf4e99f8c/hosts",
"LogPath": "/var/lib/docker/containers/6935d4927a39f4ec4845798aff773e95bc8ae838958e9958b965359cf4e99f8c/6935d4927a39f4ec4845798aff773e95bc8ae838958e9958b965359cf4e99f8c-json.log",
"Name": "/old-k8s-version-20220725131610-44543",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-20220725131610-44543:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-20220725131610-44543",
"PortBindings": {
"22/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"2376/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"32443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"5000/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"8443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"ConsoleSize": [
0,
0
],
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": null,
"BlkioDeviceWriteBps": null,
"BlkioDeviceReadIOps": null,
"BlkioDeviceWriteIOps": null,
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"KernelMemory": 0,
"KernelMemoryTCP": 0,
"MemoryReservation": 0,
"MemorySwap": 2306867200,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": null,
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/f15eeb93498eb9b562fa0404f6a7af49ce3b2ca697ba1b4c09698c8f0f5924f2-init/diff:/var/lib/docker/overlay2/d54b85ebfe416686b2558e2807bd5eef62d8c3964c35bbc22b4965093a7c57f4/diff:/var/lib/docker/overlay2/5cb3ff6e7921802d23fd6cba2490df2c36857ad3d97eedcf6e537d1527a37f60/diff:/var/lib/docker/overlay2/e9074b1b2294cc5a00d3237646a71c4d30d89748eadbae26dd532d6a475c9851/diff:/var/lib/docker/overlay2/df8929c4859ecf2c8807040b0174a3f0dfa8da01532ea961cd7f4f2f0ccfbfc2/diff:/var/lib/docker/overlay2/177329168f9a1043ce94a2b7b32958779e8f685e85abf8e4c335d03d23295b26/diff:/var/lib/docker/overlay2/9eef19133d2d5e0111523234481658c1f73d7552db59842ad9ca687debda8fb3/diff:/var/lib/docker/overlay2/5c3a4cdf915d1e65e3003feefb9b9e649b432658e093e04971d5cb79e610dba9/diff:/var/lib/docker/overlay2/d1aeff9fecf983db994270b4acf2a2310c790c64d42c58d436aec3238f88b36c/diff:/var/lib/docker/overlay2/580dc19745fb3c1352983857ac5a555954893045702e7867e651e15a2d6d8732/diff:/var/lib/docker/overlay2/6c77b3
2028ad3ef74c2faf89b5080529c0391907ee9c1d7bbc00c25a5340238b/diff:/var/lib/docker/overlay2/e9e20374d05015c7a4f19eb8e14e663122cd2aef66d761bedfdef138551230b8/diff:/var/lib/docker/overlay2/cd6d64933d189089a7aaf08d7c7db50b89cc981d03b8272e4fdedb65495c3e4c/diff:/var/lib/docker/overlay2/768244a14ae888bb2a08747182035c24bd2a6a7a67f1ddae7b4e60efccb01339/diff:/var/lib/docker/overlay2/f90a95060678580a1a90ee9a563996249f7606bffcd06b680ef15234b56ab4a6/diff:/var/lib/docker/overlay2/49310159b9be5ac9bfa1dca18d816535ceb12e228963adafcf71f9d7d52d95ec/diff:/var/lib/docker/overlay2/cef5c40c08cddf01fe5ea252f4a28586c0bd1296ddc38fc37fc7e34af83c3c30/diff:/var/lib/docker/overlay2/b31bdcb9b1a69c5230400a4e1f5650c1cc8f9e27e673ff43708f9a450106733e/diff:/var/lib/docker/overlay2/899516301b3ffc21aee7cb9984f97d944fe5af0f2cd0bc5a5895bf187e4bff72/diff:/var/lib/docker/overlay2/f1bd0d2fc2ce458c0b6364dde56610c3d26bf8dc2cca2ae4e34a46f173f44595/diff:/var/lib/docker/overlay2/9f0da14f9c19d5a719554996b34f3ef80a0378921181aaf89ca41339ccc5bee3/diff:/var/lib/d
ocker/overlay2/4d6e8c40f7c65cbcfa827b62273eb37d2a0bb0407ee161b80523f11c157a52d4/diff:/var/lib/docker/overlay2/434355bebe182fb5c97b07ad8cf7a59b5474f8bc71379ff4f9690ffe31837e63/diff:/var/lib/docker/overlay2/128fb199261eb4fea9e79111861223ddb0d84438454cb7c0b9a61cc73d0796c3/diff:/var/lib/docker/overlay2/11c9cb7e5f15ac43115cb739da1135a53e08dc94ee1da27441e1d6c79eb73e62/diff:/var/lib/docker/overlay2/5e6bf225209b025da3db5a2d8862c3a0ee64417fa809d026e010644fc6619b48/diff:/var/lib/docker/overlay2/265a2d12f86abb8a607a06ec6f225186dfe622f7e23cbbf146a2ceffc7bc9bdc/diff:/var/lib/docker/overlay2/e9140b8aea381db0faf833cd2d12ff40267febe63f7c6bc2fa27384dbadf89bc/diff:/var/lib/docker/overlay2/07d7d0ab38cb08c95279e0706a65a6a4aeff8b5e72d559f8bc3dfcc0895654d6/diff:/var/lib/docker/overlay2/3a3d8346fb066863283ad39cf7f43615d7a1e99dc12aa7e8892d85d1c550bc63/diff:/var/lib/docker/overlay2/e5317b212815c832ebd2451ddd6e1f6922f350c5c1651ccfef7c5a8f34b7c1e3/diff:/var/lib/docker/overlay2/3bd7d98f0f0bf7ad2e29344a6ab4ca3211616e390da35077e76565c2074
df852/diff:/var/lib/docker/overlay2/ff63d2045cce1bb51b201079bba9d2b2a666b7331699b9407801b2fc00792bb3/diff:/var/lib/docker/overlay2/545bdf3f77f20e3db68875eda0a8829facb605119a630956ab79323688a3562a/diff:/var/lib/docker/overlay2/8f9b40124ec5ada59184358938542e028ca1e234ef1f6bce1816becf6ec8354e/diff:/var/lib/docker/overlay2/71b919cd2ece4207294cb577adab54fdba87cd9f7fdca1a53d6f376f87f11151/diff:/var/lib/docker/overlay2/b2d4a34fe28bd395d9b4ba0120173fc9df90c36a8a60a309ec088eca8930768c/diff:/var/lib/docker/overlay2/e986f180cbc34391c1ea6665283859b4c3c3061156ea1ff7196ffd869741e591/diff:/var/lib/docker/overlay2/cb98df203d42ea558f11fe84300b687cb65e6f3401b377a4466c9c8ef276ec59/diff:/var/lib/docker/overlay2/6371f9c0528fb1fb4a17bfcf3a34877fdd6d43dca1b5f06aff998d43d2010c46/diff:/var/lib/docker/overlay2/79ceef8e89c4094715c05bafb8c1427d09fb4a99f71f1a6186299303af352c98/diff:/var/lib/docker/overlay2/e034e76eeaff4e68d5158ffe54b55d122124ad82998be242fa08bec3010a0e64/diff",
"MergedDir": "/var/lib/docker/overlay2/f15eeb93498eb9b562fa0404f6a7af49ce3b2ca697ba1b4c09698c8f0f5924f2/merged",
"UpperDir": "/var/lib/docker/overlay2/f15eeb93498eb9b562fa0404f6a7af49ce3b2ca697ba1b4c09698c8f0f5924f2/diff",
"WorkDir": "/var/lib/docker/overlay2/f15eeb93498eb9b562fa0404f6a7af49ce3b2ca697ba1b4c09698c8f0f5924f2/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-20220725131610-44543",
"Source": "/var/lib/docker/volumes/old-k8s-version-20220725131610-44543/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-20220725131610-44543",
"Domainname": "",
"User": "root",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842",
"Volumes": null,
"WorkingDir": "",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-20220725131610-44543",
"name.minikube.sigs.k8s.io": "old-k8s-version-20220725131610-44543",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "12379afd279980558be4a929c4d984061b0c32714de70eee2ad7f4ba5fd48183",
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"Ports": {
"22/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "58398"
}
],
"2376/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "58399"
}
],
"32443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "58400"
}
],
"5000/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "58401"
}
],
"8443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "58397"
}
]
},
"SandboxKey": "/var/run/docker/netns/12379afd2799",
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-20220725131610-44543": {
"IPAMConfig": {
"IPv4Address": "192.168.67.2"
},
"Links": null,
"Aliases": [
"6935d4927a39",
"old-k8s-version-20220725131610-44543"
],
"NetworkID": "c2f2901f9a0d93fa66499c6332491a576318c2a7c67d4d75046d6eea022d9aab",
"EndpointID": "4f78a7ab90e916cef937892224931fa1acc2f254ce858898e285125ccdeb75fc",
"Gateway": "192.168.67.1",
"IPAddress": "192.168.67.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"MacAddress": "02:42:c0:a8:43:02",
"DriverOpts": null
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-20220725131610-44543 -n old-k8s-version-20220725131610-44543
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-20220725131610-44543 -n old-k8s-version-20220725131610-44543: exit status 6 (448.797533ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0725 13:20:20.818763 60023 status.go:413] kubeconfig endpoint: extract IP: "old-k8s-version-20220725131610-44543" does not appear in /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-43375-0a167c9e2958e27b8ab0e3c17b04ac7cefde8636/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-20220725131610-44543" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (250.04s)