=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-darwin-amd64 start -p old-k8s-version-20220725164610-14919 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0
E0725 16:46:10.636193 14919 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/addons-20220725155351-14919/client.crt: no such file or directory
=== CONT TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-20220725164610-14919 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0: exit status 109 (4m9.392840184s)
-- stdout --
* [old-k8s-version-20220725164610-14919] minikube v1.26.0 on Darwin 12.5
- MINIKUBE_LOCATION=14555
- KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube
* Using the docker driver based on user configuration
* Using Docker Desktop driver with root privileges
* Starting control plane node old-k8s-version-20220725164610-14919 in cluster old-k8s-version-20220725164610-14919
* Pulling base image ...
* Creating docker container (CPUs=2, Memory=2200MB) ...
* Preparing Kubernetes v1.16.0 on Docker 20.10.17 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0725 16:46:10.458578 29782 out.go:296] Setting OutFile to fd 1 ...
I0725 16:46:10.458756 29782 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0725 16:46:10.458762 29782 out.go:309] Setting ErrFile to fd 2...
I0725 16:46:10.458765 29782 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0725 16:46:10.458878 29782 root.go:332] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/bin
I0725 16:46:10.459414 29782 out.go:303] Setting JSON to false
I0725 16:46:10.474380 29782 start.go:115] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":9693,"bootTime":1658783077,"procs":358,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"12.5","kernelVersion":"21.6.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
W0725 16:46:10.474474 29782 start.go:123] gopshost.Virtualization returned error: not implemented yet
I0725 16:46:10.496794 29782 out.go:177] * [old-k8s-version-20220725164610-14919] minikube v1.26.0 on Darwin 12.5
I0725 16:46:10.518443 29782 notify.go:193] Checking for updates...
I0725 16:46:10.539450 29782 out.go:177] - MINIKUBE_LOCATION=14555
I0725 16:46:10.561742 29782 out.go:177] - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/kubeconfig
I0725 16:46:10.583883 29782 out.go:177] - MINIKUBE_BIN=out/minikube-darwin-amd64
I0725 16:46:10.605494 29782 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0725 16:46:10.626841 29782 out.go:177] - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube
I0725 16:46:10.649600 29782 config.go:178] Loaded profile config "kubenet-20220725163045-14919": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.24.3
I0725 16:46:10.649691 29782 driver.go:365] Setting default libvirt URI to qemu:///system
I0725 16:46:10.719775 29782 docker.go:137] docker version: linux-20.10.17
I0725 16:46:10.719903 29782 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0725 16:46:10.860350 29782 info.go:265] docker info: {ID:ZBPM:TZ5A:N35E:7TT4:6J7K:XQ3N:UILG:GFPO:R7RK:6D5U:VYM6:SSGI Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:59 OomKillDisable:false NGoroutines:51 SystemTime:2022-07-25 23:46:10.788841674 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.104-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexSer
verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6232580096 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defau
lt name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.1] map[Name:extension Path:/usr/local/lib/docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.7] map[Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
I0725 16:46:10.882432 29782 out.go:177] * Using the docker driver based on user configuration
I0725 16:46:10.910394 29782 start.go:284] selected driver: docker
I0725 16:46:10.910412 29782 start.go:808] validating driver "docker" against <nil>
I0725 16:46:10.910427 29782 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0725 16:46:10.912497 29782 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0725 16:46:11.046681 29782 info.go:265] docker info: {ID:ZBPM:TZ5A:N35E:7TT4:6J7K:XQ3N:UILG:GFPO:R7RK:6D5U:VYM6:SSGI Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:59 OomKillDisable:false NGoroutines:51 SystemTime:2022-07-25 23:46:10.973048849 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.104-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexSer
verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6232580096 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defau
lt name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.1] map[Name:extension Path:/usr/local/lib/docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.7] map[Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
I0725 16:46:11.046950 29782 start_flags.go:296] no existing cluster config was found, will generate one from the flags
I0725 16:46:11.047418 29782 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0725 16:46:11.068158 29782 out.go:177] * Using Docker Desktop driver with root privileges
I0725 16:46:11.093711 29782 cni.go:95] Creating CNI manager for ""
I0725 16:46:11.093792 29782 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I0725 16:46:11.093813 29782 start_flags.go:310] config:
{Name:old-k8s-version-20220725164610-14919 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220725164610-14919 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSD
omain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
I0725 16:46:11.115982 29782 out.go:177] * Starting control plane node old-k8s-version-20220725164610-14919 in cluster old-k8s-version-20220725164610-14919
I0725 16:46:11.158866 29782 cache.go:120] Beginning downloading kic base image for docker with docker
I0725 16:46:11.179889 29782 out.go:177] * Pulling base image ...
I0725 16:46:11.200672 29782 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0725 16:46:11.200675 29782 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 in local docker daemon
I0725 16:46:11.200735 29782 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4
I0725 16:46:11.200746 29782 cache.go:57] Caching tarball of preloaded images
I0725 16:46:11.200867 29782 preload.go:174] Found /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0725 16:46:11.200885 29782 cache.go:60] Finished verifying existence of preloaded tar for v1.16.0 on docker
I0725 16:46:11.201651 29782 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/config.json ...
I0725 16:46:11.201768 29782 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/config.json: {Name:mk955f69d70cbcbb80d125cc6b9304ecc5ad65f4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0725 16:46:11.264663 29782 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 in local docker daemon, skipping pull
I0725 16:46:11.264696 29782 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 exists in daemon, skipping load
I0725 16:46:11.264708 29782 cache.go:208] Successfully downloaded all kic artifacts
I0725 16:46:11.264770 29782 start.go:370] acquiring machines lock for old-k8s-version-20220725164610-14919: {Name:mk039986a3467f394c941873ee88acd0fb616596 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0725 16:46:11.264928 29782 start.go:374] acquired machines lock for "old-k8s-version-20220725164610-14919" in 146.57µs
I0725 16:46:11.264955 29782 start.go:92] Provisioning new machine with config: &{Name:old-k8s-version-20220725164610-14919 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220725164610-14919
Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMi
rror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0725 16:46:11.265041 29782 start.go:132] createHost starting for "" (driver="docker")
I0725 16:46:11.308632 29782 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0725 16:46:11.308986 29782 start.go:166] libmachine.API.Create for "old-k8s-version-20220725164610-14919" (driver="docker")
I0725 16:46:11.309033 29782 client.go:168] LocalClient.Create starting
I0725 16:46:11.309249 29782 main.go:134] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/ca.pem
I0725 16:46:11.309324 29782 main.go:134] libmachine: Decoding PEM data...
I0725 16:46:11.309354 29782 main.go:134] libmachine: Parsing certificate...
I0725 16:46:11.309455 29782 main.go:134] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/cert.pem
I0725 16:46:11.309525 29782 main.go:134] libmachine: Decoding PEM data...
I0725 16:46:11.309545 29782 main.go:134] libmachine: Parsing certificate...
I0725 16:46:11.310589 29782 cli_runner.go:164] Run: docker network inspect old-k8s-version-20220725164610-14919 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0725 16:46:11.374877 29782 cli_runner.go:211] docker network inspect old-k8s-version-20220725164610-14919 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0725 16:46:11.374975 29782 network_create.go:272] running [docker network inspect old-k8s-version-20220725164610-14919] to gather additional debugging logs...
I0725 16:46:11.375008 29782 cli_runner.go:164] Run: docker network inspect old-k8s-version-20220725164610-14919
W0725 16:46:11.437925 29782 cli_runner.go:211] docker network inspect old-k8s-version-20220725164610-14919 returned with exit code 1
I0725 16:46:11.437954 29782 network_create.go:275] error running [docker network inspect old-k8s-version-20220725164610-14919]: docker network inspect old-k8s-version-20220725164610-14919: exit status 1
stdout:
[]
stderr:
Error: No such network: old-k8s-version-20220725164610-14919
I0725 16:46:11.437986 29782 network_create.go:277] output of [docker network inspect old-k8s-version-20220725164610-14919]: -- stdout --
[]
-- /stdout --
** stderr **
Error: No such network: old-k8s-version-20220725164610-14919
** /stderr **
I0725 16:46:11.438064 29782 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0725 16:46:11.501583 29782 network.go:288] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc0003cc1f0] misses:0}
I0725 16:46:11.501623 29782 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0725 16:46:11.501646 29782 network_create.go:115] attempt to create docker network old-k8s-version-20220725164610-14919 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0725 16:46:11.501721 29782 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220725164610-14919 old-k8s-version-20220725164610-14919
W0725 16:46:11.565008 29782 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220725164610-14919 old-k8s-version-20220725164610-14919 returned with exit code 1
W0725 16:46:11.565042 29782 network_create.go:107] failed to create docker network old-k8s-version-20220725164610-14919 192.168.49.0/24, will retry: subnet is taken
I0725 16:46:11.565341 29782 network.go:279] skipping subnet 192.168.49.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc0003cc1f0] amended:false}} dirty:map[] misses:0}
I0725 16:46:11.565359 29782 network.go:238] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0725 16:46:11.565585 29782 network.go:288] reserving subnet 192.168.58.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc0003cc1f0] amended:true}} dirty:map[192.168.49.0:0xc0003cc1f0 192.168.58.0:0xc000ba1070] misses:0}
I0725 16:46:11.565600 29782 network.go:235] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0725 16:46:11.565623 29782 network_create.go:115] attempt to create docker network old-k8s-version-20220725164610-14919 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ...
I0725 16:46:11.565691 29782 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220725164610-14919 old-k8s-version-20220725164610-14919
W0725 16:46:11.628990 29782 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220725164610-14919 old-k8s-version-20220725164610-14919 returned with exit code 1
W0725 16:46:11.629028 29782 network_create.go:107] failed to create docker network old-k8s-version-20220725164610-14919 192.168.58.0/24, will retry: subnet is taken
I0725 16:46:11.629329 29782 network.go:279] skipping subnet 192.168.58.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc0003cc1f0] amended:true}} dirty:map[192.168.49.0:0xc0003cc1f0 192.168.58.0:0xc000ba1070] misses:1}
I0725 16:46:11.629345 29782 network.go:238] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0725 16:46:11.629547 29782 network.go:288] reserving subnet 192.168.67.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc0003cc1f0] amended:true}} dirty:map[192.168.49.0:0xc0003cc1f0 192.168.58.0:0xc000ba1070 192.168.67.0:0xc000794100] misses:1}
I0725 16:46:11.629567 29782 network.go:235] using free private subnet 192.168.67.0/24: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0725 16:46:11.629575 29782 network_create.go:115] attempt to create docker network old-k8s-version-20220725164610-14919 192.168.67.0/24 with gateway 192.168.67.1 and MTU of 1500 ...
I0725 16:46:11.629667 29782 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220725164610-14919 old-k8s-version-20220725164610-14919
I0725 16:46:11.726873 29782 network_create.go:99] docker network old-k8s-version-20220725164610-14919 192.168.67.0/24 created
I0725 16:46:11.726914 29782 kic.go:106] calculated static IP "192.168.67.2" for the "old-k8s-version-20220725164610-14919" container
I0725 16:46:11.727029 29782 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0725 16:46:11.795602 29782 cli_runner.go:164] Run: docker volume create old-k8s-version-20220725164610-14919 --label name.minikube.sigs.k8s.io=old-k8s-version-20220725164610-14919 --label created_by.minikube.sigs.k8s.io=true
I0725 16:46:11.860123 29782 oci.go:103] Successfully created a docker volume old-k8s-version-20220725164610-14919
I0725 16:46:11.860240 29782 cli_runner.go:164] Run: docker run --rm --name old-k8s-version-20220725164610-14919-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-20220725164610-14919 --entrypoint /usr/bin/test -v old-k8s-version-20220725164610-14919:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 -d /var/lib
I0725 16:46:12.353546 29782 oci.go:107] Successfully prepared a docker volume old-k8s-version-20220725164610-14919
I0725 16:46:12.353597 29782 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0725 16:46:12.353611 29782 kic.go:179] Starting extracting preloaded images to volume ...
I0725 16:46:12.353701 29782 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-20220725164610-14919:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 -I lz4 -xf /preloaded.tar -C /extractDir
I0725 16:46:16.173221 29782 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-20220725164610-14919:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 -I lz4 -xf /preloaded.tar -C /extractDir: (3.819359251s)
I0725 16:46:16.173249 29782 kic.go:188] duration metric: took 3.819603 seconds to extract preloaded images to volume
I0725 16:46:16.173370 29782 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0725 16:46:16.308706 29782 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname old-k8s-version-20220725164610-14919 --name old-k8s-version-20220725164610-14919 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-20220725164610-14919 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=old-k8s-version-20220725164610-14919 --network old-k8s-version-20220725164610-14919 --ip 192.168.67.2 --volume old-k8s-version-20220725164610-14919:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=8443 --publish=22 --publish=2376 --publish=5000 --publish=32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842
I0725 16:46:16.685659 29782 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220725164610-14919 --format={{.State.Running}}
I0725 16:46:16.763483 29782 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220725164610-14919 --format={{.State.Status}}
I0725 16:46:16.849007 29782 cli_runner.go:164] Run: docker exec old-k8s-version-20220725164610-14919 stat /var/lib/dpkg/alternatives/iptables
I0725 16:46:16.979886 29782 oci.go:144] the created container "old-k8s-version-20220725164610-14919" has a running status.
I0725 16:46:16.979929 29782 kic.go:210] Creating ssh key for kic: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/machines/old-k8s-version-20220725164610-14919/id_rsa...
I0725 16:46:17.050673 29782 kic_runner.go:191] docker (temp): /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/machines/old-k8s-version-20220725164610-14919/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0725 16:46:17.203041 29782 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220725164610-14919 --format={{.State.Status}}
I0725 16:46:17.275157 29782 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0725 16:46:17.275176 29782 kic_runner.go:114] Args: [docker exec --privileged old-k8s-version-20220725164610-14919 chown docker:docker /home/docker/.ssh/authorized_keys]
I0725 16:46:17.404271 29782 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220725164610-14919 --format={{.State.Status}}
I0725 16:46:17.476561 29782 machine.go:88] provisioning docker machine ...
I0725 16:46:17.476599 29782 ubuntu.go:169] provisioning hostname "old-k8s-version-20220725164610-14919"
I0725 16:46:17.476719 29782 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220725164610-14919
I0725 16:46:17.549516 29782 main.go:134] libmachine: Using SSH client type: native
I0725 16:46:17.549719 29782 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2e20] 0x13d5e80 <nil> [] 0s} 127.0.0.1 50345 <nil> <nil>}
I0725 16:46:17.549738 29782 main.go:134] libmachine: About to run SSH command:
sudo hostname old-k8s-version-20220725164610-14919 && echo "old-k8s-version-20220725164610-14919" | sudo tee /etc/hostname
I0725 16:46:17.686312 29782 main.go:134] libmachine: SSH cmd err, output: <nil>: old-k8s-version-20220725164610-14919
I0725 16:46:17.686423 29782 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220725164610-14919
I0725 16:46:17.760797 29782 main.go:134] libmachine: Using SSH client type: native
I0725 16:46:17.760969 29782 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2e20] 0x13d5e80 <nil> [] 0s} 127.0.0.1 50345 <nil> <nil>}
I0725 16:46:17.760986 29782 main.go:134] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-20220725164610-14919' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-20220725164610-14919/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-20220725164610-14919' | sudo tee -a /etc/hosts;
fi
fi
I0725 16:46:17.884514 29782 main.go:134] libmachine: SSH cmd err, output: <nil>:
I0725 16:46:17.884536 29782 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube CaCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/key.pem ServerCertRemotePath:/etc/doc
ker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube}
I0725 16:46:17.884557 29782 ubuntu.go:177] setting up certificates
I0725 16:46:17.884564 29782 provision.go:83] configureAuth start
I0725 16:46:17.884632 29782 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220725164610-14919
I0725 16:46:17.957910 29782 provision.go:138] copyHostCerts
I0725 16:46:17.957991 29782 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/ca.pem, removing ...
I0725 16:46:17.958000 29782 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/ca.pem
I0725 16:46:17.958105 29782 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/ca.pem (1082 bytes)
I0725 16:46:17.958288 29782 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/cert.pem, removing ...
I0725 16:46:17.958299 29782 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/cert.pem
I0725 16:46:17.958367 29782 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/cert.pem (1123 bytes)
I0725 16:46:17.958502 29782 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/key.pem, removing ...
I0725 16:46:17.958508 29782 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/key.pem
I0725 16:46:17.958565 29782 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/key.pem (1675 bytes)
I0725 16:46:17.958693 29782 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-20220725164610-14919 san=[192.168.67.2 127.0.0.1 localhost 127.0.0.1 minikube old-k8s-version-20220725164610-14919]
I0725 16:46:18.122713 29782 provision.go:172] copyRemoteCerts
I0725 16:46:18.122771 29782 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0725 16:46:18.122818 29782 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220725164610-14919
I0725 16:46:18.194469 29782 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50345 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/machines/old-k8s-version-20220725164610-14919/id_rsa Username:docker}
I0725 16:46:18.281037 29782 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0725 16:46:18.297284 29782 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/machines/server.pem --> /etc/docker/server.pem (1277 bytes)
I0725 16:46:18.314349 29782 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0725 16:46:18.331082 29782 provision.go:86] duration metric: configureAuth took 446.500407ms
I0725 16:46:18.331094 29782 ubuntu.go:193] setting minikube options for container-runtime
I0725 16:46:18.331234 29782 config.go:178] Loaded profile config "old-k8s-version-20220725164610-14919": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
I0725 16:46:18.331297 29782 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220725164610-14919
I0725 16:46:18.403902 29782 main.go:134] libmachine: Using SSH client type: native
I0725 16:46:18.404048 29782 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2e20] 0x13d5e80 <nil> [] 0s} 127.0.0.1 50345 <nil> <nil>}
I0725 16:46:18.404070 29782 main.go:134] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0725 16:46:18.525407 29782 main.go:134] libmachine: SSH cmd err, output: <nil>: overlay
I0725 16:46:18.525422 29782 ubuntu.go:71] root file system type: overlay
I0725 16:46:18.525592 29782 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0725 16:46:18.525688 29782 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220725164610-14919
I0725 16:46:18.597376 29782 main.go:134] libmachine: Using SSH client type: native
I0725 16:46:18.597534 29782 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2e20] 0x13d5e80 <nil> [] 0s} 127.0.0.1 50345 <nil> <nil>}
I0725 16:46:18.598102 29782 main.go:134] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0725 16:46:18.725150 29782 main.go:134] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0725 16:46:18.725252 29782 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220725164610-14919
I0725 16:46:18.796830 29782 main.go:134] libmachine: Using SSH client type: native
I0725 16:46:18.797062 29782 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2e20] 0x13d5e80 <nil> [] 0s} 127.0.0.1 50345 <nil> <nil>}
I0725 16:46:18.797075 29782 main.go:134] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0725 16:46:19.403756 29782 main.go:134] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2022-06-06 23:01:03.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2022-07-25 23:46:18.730640370 +0000
@@ -1,30 +1,32 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
Wants=network-online.target
-Requires=docker.socket containerd.service
+Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutSec=0
-RestartSec=2
-Restart=always
-
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
+Restart=on-failure
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
@@ -32,16 +34,16 @@
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0725 16:46:19.403778 29782 machine.go:91] provisioned docker machine in 1.927180611s
I0725 16:46:19.403784 29782 client.go:171] LocalClient.Create took 8.094669795s
I0725 16:46:19.403800 29782 start.go:174] duration metric: libmachine.API.Create for "old-k8s-version-20220725164610-14919" took 8.094742401s
I0725 16:46:19.403810 29782 start.go:307] post-start starting for "old-k8s-version-20220725164610-14919" (driver="docker")
I0725 16:46:19.403816 29782 start.go:334] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0725 16:46:19.403880 29782 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0725 16:46:19.403930 29782 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220725164610-14919
I0725 16:46:19.478018 29782 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50345 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/machines/old-k8s-version-20220725164610-14919/id_rsa Username:docker}
I0725 16:46:19.565626 29782 ssh_runner.go:195] Run: cat /etc/os-release
I0725 16:46:19.568982 29782 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0725 16:46:19.568996 29782 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0725 16:46:19.569002 29782 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0725 16:46:19.569010 29782 info.go:137] Remote host: Ubuntu 20.04.4 LTS
I0725 16:46:19.569019 29782 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/addons for local assets ...
I0725 16:46:19.569132 29782 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/files for local assets ...
I0725 16:46:19.569267 29782 filesync.go:149] local asset: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/files/etc/ssl/certs/149192.pem -> 149192.pem in /etc/ssl/certs
I0725 16:46:19.569426 29782 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0725 16:46:19.576479 29782 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/files/etc/ssl/certs/149192.pem --> /etc/ssl/certs/149192.pem (1708 bytes)
I0725 16:46:19.593706 29782 start.go:310] post-start completed in 189.885895ms
I0725 16:46:19.594314 29782 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220725164610-14919
I0725 16:46:19.668193 29782 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/config.json ...
I0725 16:46:19.668589 29782 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0725 16:46:19.668635 29782 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220725164610-14919
I0725 16:46:19.740873 29782 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50345 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/machines/old-k8s-version-20220725164610-14919/id_rsa Username:docker}
I0725 16:46:19.826649 29782 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0725 16:46:19.830981 29782 start.go:135] duration metric: createHost completed in 8.565855596s
I0725 16:46:19.830995 29782 start.go:82] releasing machines lock for "old-k8s-version-20220725164610-14919", held for 8.56598057s
I0725 16:46:19.831066 29782 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220725164610-14919
I0725 16:46:19.902909 29782 ssh_runner.go:195] Run: systemctl --version
I0725 16:46:19.902910 29782 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
I0725 16:46:19.902977 29782 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220725164610-14919
I0725 16:46:19.903011 29782 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220725164610-14919
I0725 16:46:19.983800 29782 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50345 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/machines/old-k8s-version-20220725164610-14919/id_rsa Username:docker}
I0725 16:46:19.985718 29782 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50345 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/machines/old-k8s-version-20220725164610-14919/id_rsa Username:docker}
I0725 16:46:20.294735 29782 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0725 16:46:20.305284 29782 cruntime.go:273] skipping containerd shutdown because we are bound to it
I0725 16:46:20.305353 29782 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0725 16:46:20.314475 29782 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
image-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0725 16:46:20.327435 29782 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0725 16:46:20.400138 29782 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0725 16:46:20.470700 29782 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0725 16:46:20.559602 29782 ssh_runner.go:195] Run: sudo systemctl restart docker
I0725 16:46:20.768117 29782 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0725 16:46:20.805929 29782 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0725 16:46:20.863347 29782 out.go:204] * Preparing Kubernetes v1.16.0 on Docker 20.10.17 ...
I0725 16:46:20.863495 29782 cli_runner.go:164] Run: docker exec -t old-k8s-version-20220725164610-14919 dig +short host.docker.internal
I0725 16:46:20.995516 29782 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2
I0725 16:46:20.995618 29782 ssh_runner.go:195] Run: grep 192.168.65.2 host.minikube.internal$ /etc/hosts
I0725 16:46:21.000347 29782 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0725 16:46:21.010406 29782 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-20220725164610-14919
I0725 16:46:21.082389 29782 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0725 16:46:21.082453 29782 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0725 16:46:21.114056 29782 docker.go:611] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0725 16:46:21.114075 29782 docker.go:542] Images already preloaded, skipping extraction
I0725 16:46:21.114148 29782 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0725 16:46:21.144305 29782 docker.go:611] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0725 16:46:21.144319 29782 cache_images.go:84] Images are preloaded, skipping loading
I0725 16:46:21.144394 29782 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0725 16:46:21.220443 29782 cni.go:95] Creating CNI manager for ""
I0725 16:46:21.220455 29782 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I0725 16:46:21.220473 29782 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0725 16:46:21.220489 29782 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.67.2 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-20220725164610-14919 NodeName:old-k8s-version-20220725164610-14919 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.67.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.67.2 CgroupDriver:systemd Clien
tCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
I0725 16:46:21.220592 29782 kubeadm.go:162] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.67.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-20220725164610-14919"
kubeletExtraArgs:
node-ip: 192.168.67.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.67.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-20220725164610-14919
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.67.2:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0725 16:46:21.220686 29782 kubeadm.go:961] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-20220725164610-14919 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.67.2
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220725164610-14919 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0725 16:46:21.220754 29782 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0725 16:46:21.228505 29782 binaries.go:44] Found k8s binaries, skipping transfer
I0725 16:46:21.228570 29782 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0725 16:46:21.235672 29782 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (362 bytes)
I0725 16:46:21.248816 29782 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0725 16:46:21.261314 29782 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2148 bytes)
I0725 16:46:21.274744 29782 ssh_runner.go:195] Run: grep 192.168.67.2 control-plane.minikube.internal$ /etc/hosts
I0725 16:46:21.278699 29782 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.67.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0725 16:46:21.288108 29782 certs.go:54] Setting up /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919 for IP: 192.168.67.2
I0725 16:46:21.288228 29782 certs.go:182] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/ca.key
I0725 16:46:21.288276 29782 certs.go:182] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/proxy-client-ca.key
I0725 16:46:21.288324 29782 certs.go:302] generating minikube-user signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/client.key
I0725 16:46:21.288338 29782 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/client.crt with IP's: []
I0725 16:46:21.455252 29782 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/client.crt ...
I0725 16:46:21.455267 29782 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/client.crt: {Name:mkba6d49e732aafbde0f5c116921b417f7520b9d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0725 16:46:21.455596 29782 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/client.key ...
I0725 16:46:21.455605 29782 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/client.key: {Name:mkcc4da1b55f9ac8437ce38c3418fabda4e6bba7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0725 16:46:21.455808 29782 certs.go:302] generating minikube signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/apiserver.key.c7fa3a9e
I0725 16:46:21.455826 29782 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/apiserver.crt.c7fa3a9e with IP's: [192.168.67.2 10.96.0.1 127.0.0.1 10.0.0.1]
I0725 16:46:21.561242 29782 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/apiserver.crt.c7fa3a9e ...
I0725 16:46:21.561257 29782 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/apiserver.crt.c7fa3a9e: {Name:mkcf9d43af0ccbdc9ff1f78ea99457959e637fd2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0725 16:46:21.561524 29782 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/apiserver.key.c7fa3a9e ...
I0725 16:46:21.561532 29782 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/apiserver.key.c7fa3a9e: {Name:mkc804d5234ce41537260b885f3b20b29b3fa423 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0725 16:46:21.561797 29782 certs.go:320] copying /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/apiserver.crt.c7fa3a9e -> /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/apiserver.crt
I0725 16:46:21.561944 29782 certs.go:324] copying /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/apiserver.key.c7fa3a9e -> /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/apiserver.key
I0725 16:46:21.562092 29782 certs.go:302] generating aggregator signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/proxy-client.key
I0725 16:46:21.562106 29782 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/proxy-client.crt with IP's: []
I0725 16:46:21.792130 29782 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/proxy-client.crt ...
I0725 16:46:21.792147 29782 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/proxy-client.crt: {Name:mk121670e71eb11856a11e2556c62e7f208ca4a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0725 16:46:21.792468 29782 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/proxy-client.key ...
I0725 16:46:21.792476 29782 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/proxy-client.key: {Name:mkf976ad498043ffcd3566cd738d6ac1bb298be2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0725 16:46:21.792903 29782 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/14919.pem (1338 bytes)
W0725 16:46:21.792944 29782 certs.go:384] ignoring /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/14919_empty.pem, impossibly tiny 0 bytes
I0725 16:46:21.792953 29782 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/ca-key.pem (1679 bytes)
I0725 16:46:21.792982 29782 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/ca.pem (1082 bytes)
I0725 16:46:21.793009 29782 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/cert.pem (1123 bytes)
I0725 16:46:21.793038 29782 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/key.pem (1675 bytes)
I0725 16:46:21.793098 29782 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/files/etc/ssl/certs/149192.pem (1708 bytes)
I0725 16:46:21.793530 29782 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0725 16:46:21.812144 29782 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0725 16:46:21.828779 29782 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0725 16:46:21.844949 29782 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/profiles/old-k8s-version-20220725164610-14919/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0725 16:46:21.861464 29782 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0725 16:46:21.878524 29782 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0725 16:46:21.895836 29782 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0725 16:46:21.913606 29782 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0725 16:46:21.931503 29782 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0725 16:46:21.950632 29782 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/certs/14919.pem --> /usr/share/ca-certificates/14919.pem (1338 bytes)
I0725 16:46:21.967673 29782 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/.minikube/files/etc/ssl/certs/149192.pem --> /usr/share/ca-certificates/149192.pem (1708 bytes)
I0725 16:46:21.986710 29782 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0725 16:46:21.999366 29782 ssh_runner.go:195] Run: openssl version
I0725 16:46:22.004836 29782 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0725 16:46:22.013409 29782 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0725 16:46:22.017276 29782 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jul 25 22:54 /usr/share/ca-certificates/minikubeCA.pem
I0725 16:46:22.017323 29782 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0725 16:46:22.022491 29782 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0725 16:46:22.030754 29782 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14919.pem && ln -fs /usr/share/ca-certificates/14919.pem /etc/ssl/certs/14919.pem"
I0725 16:46:22.038417 29782 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14919.pem
I0725 16:46:22.043141 29782 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jul 25 22:58 /usr/share/ca-certificates/14919.pem
I0725 16:46:22.043182 29782 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14919.pem
I0725 16:46:22.048426 29782 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/14919.pem /etc/ssl/certs/51391683.0"
I0725 16:46:22.056232 29782 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/149192.pem && ln -fs /usr/share/ca-certificates/149192.pem /etc/ssl/certs/149192.pem"
I0725 16:46:22.064198 29782 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/149192.pem
I0725 16:46:22.068191 29782 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jul 25 22:58 /usr/share/ca-certificates/149192.pem
I0725 16:46:22.068234 29782 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/149192.pem
I0725 16:46:22.073340 29782 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/149192.pem /etc/ssl/certs/3ec20f2e.0"
I0725 16:46:22.080818 29782 kubeadm.go:395] StartCluster: {Name:old-k8s-version-20220725164610-14919 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220725164610-14919 Namespace:default API
ServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disa
bleOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
I0725 16:46:22.080951 29782 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0725 16:46:22.109891 29782 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0725 16:46:22.117611 29782 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0725 16:46:22.125078 29782 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I0725 16:46:22.125134 29782 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0725 16:46:22.133021 29782 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0725 16:46:22.133046 29782 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0725 16:46:22.891995 29782 out.go:204] - Generating certificates and keys ...
I0725 16:46:25.333087 29782 out.go:204] - Booting up control plane ...
W0725 16:48:20.245972 29782 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-20220725164610-14919 localhost] and IPs [192.168.67.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-20220725164610-14919 localhost] and IPs [192.168.67.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-20220725164610-14919 localhost] and IPs [192.168.67.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-20220725164610-14919 localhost] and IPs [192.168.67.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0725 16:48:20.246004 29782 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"
I0725 16:48:20.666578 29782 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0725 16:48:20.676169 29782 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I0725 16:48:20.676227 29782 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0725 16:48:20.684004 29782 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0725 16:48:20.684035 29782 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0725 16:48:21.439261 29782 out.go:204] - Generating certificates and keys ...
I0725 16:48:22.253755 29782 out.go:204] - Booting up control plane ...
I0725 16:50:17.204789 29782 kubeadm.go:397] StartCluster complete in 3m55.088856621s
I0725 16:50:17.204866 29782 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0725 16:50:17.233794 29782 logs.go:274] 0 containers: []
W0725 16:50:17.233805 29782 logs.go:276] No container was found matching "kube-apiserver"
I0725 16:50:17.233863 29782 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0725 16:50:17.262487 29782 logs.go:274] 0 containers: []
W0725 16:50:17.262500 29782 logs.go:276] No container was found matching "etcd"
I0725 16:50:17.262558 29782 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0725 16:50:17.290903 29782 logs.go:274] 0 containers: []
W0725 16:50:17.290915 29782 logs.go:276] No container was found matching "coredns"
I0725 16:50:17.290989 29782 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0725 16:50:17.322903 29782 logs.go:274] 0 containers: []
W0725 16:50:17.322914 29782 logs.go:276] No container was found matching "kube-scheduler"
I0725 16:50:17.322973 29782 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0725 16:50:17.354086 29782 logs.go:274] 0 containers: []
W0725 16:50:17.354099 29782 logs.go:276] No container was found matching "kube-proxy"
I0725 16:50:17.354165 29782 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0725 16:50:17.386984 29782 logs.go:274] 0 containers: []
W0725 16:50:17.386997 29782 logs.go:276] No container was found matching "kubernetes-dashboard"
I0725 16:50:17.387061 29782 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0725 16:50:17.418252 29782 logs.go:274] 0 containers: []
W0725 16:50:17.418264 29782 logs.go:276] No container was found matching "storage-provisioner"
I0725 16:50:17.418324 29782 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0725 16:50:17.447478 29782 logs.go:274] 0 containers: []
W0725 16:50:17.447493 29782 logs.go:276] No container was found matching "kube-controller-manager"
I0725 16:50:17.447502 29782 logs.go:123] Gathering logs for dmesg ...
I0725 16:50:17.447510 29782 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0725 16:50:17.459218 29782 logs.go:123] Gathering logs for describe nodes ...
I0725 16:50:17.459230 29782 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0725 16:50:17.513431 29782 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0725 16:50:17.513443 29782 logs.go:123] Gathering logs for Docker ...
I0725 16:50:17.513451 29782 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400"
I0725 16:50:17.528588 29782 logs.go:123] Gathering logs for container status ...
I0725 16:50:17.528602 29782 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0725 16:50:19.583068 29782 ssh_runner.go:235] Completed: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": (2.054395585s)
I0725 16:50:19.583215 29782 logs.go:123] Gathering logs for kubelet ...
I0725 16:50:19.583222 29782 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0725 16:50:19.624134 29782 out.go:369] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0725 16:50:19.624157 29782 out.go:239] *
*
W0725 16:50:19.624283 29782 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0725 16:50:19.624296 29782 out.go:239] *
*
W0725 16:50:19.624852 29782 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0725 16:50:19.688626 29782 out.go:177]
W0725 16:50:19.731051 29782 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0725 16:50:19.731194 29782 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0725 16:50:19.731267 29782 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0725 16:50:19.773651 29782 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p old-k8s-version-20220725164610-14919 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-20220725164610-14919
helpers_test.go:235: (dbg) docker inspect old-k8s-version-20220725164610-14919:
-- stdout --
[
{
"Id": "3e45dea9c0149860b5036e331206733d0f3a614b9342d09e1d56f10802133bbf",
"Created": "2022-07-25T23:46:16.38043483Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 225636,
"ExitCode": 0,
"Error": "",
"StartedAt": "2022-07-25T23:46:16.682079128Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:443d84da239e4e701685e1614ef94cd6b60d0f0b15265a51d4f657992a9c59d8",
"ResolvConfPath": "/var/lib/docker/containers/3e45dea9c0149860b5036e331206733d0f3a614b9342d09e1d56f10802133bbf/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/3e45dea9c0149860b5036e331206733d0f3a614b9342d09e1d56f10802133bbf/hostname",
"HostsPath": "/var/lib/docker/containers/3e45dea9c0149860b5036e331206733d0f3a614b9342d09e1d56f10802133bbf/hosts",
"LogPath": "/var/lib/docker/containers/3e45dea9c0149860b5036e331206733d0f3a614b9342d09e1d56f10802133bbf/3e45dea9c0149860b5036e331206733d0f3a614b9342d09e1d56f10802133bbf-json.log",
"Name": "/old-k8s-version-20220725164610-14919",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-20220725164610-14919:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-20220725164610-14919",
"PortBindings": {
"22/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"2376/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"32443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"5000/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"8443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"ConsoleSize": [
0,
0
],
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": null,
"BlkioDeviceWriteBps": null,
"BlkioDeviceReadIOps": null,
"BlkioDeviceWriteIOps": null,
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"KernelMemory": 0,
"KernelMemoryTCP": 0,
"MemoryReservation": 0,
"MemorySwap": 2306867200,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": null,
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/bfe1bfd7c21d08751e099f537657387a10067aae592a04321ebff9cdc71b600d-init/diff:/var/lib/docker/overlay2/8c24b3eef47c80f0f1c7ecd431fc4ced5f467ae6db9b9e15507366a887a16ed3/diff:/var/lib/docker/overlay2/1b13d21ea451468afe209b1a9bc9df23c784fe766b47a4d2c6b05771b3799217/diff:/var/lib/docker/overlay2/4707d11e07cb14467c80db9fd5e705fd971fe8dff1b1a50631c7c397c2ded00e/diff:/var/lib/docker/overlay2/55106e26e284037bfbb01e36e74e1dc2843604ee0df9e1f3b9d7404173bce2c7/diff:/var/lib/docker/overlay2/b74a4243ccfd0f85c23f3f63b818e16338778001142242810ba6dcd43a8acbd3/diff:/var/lib/docker/overlay2/40567925ce3f8310adb4e84ed27150dcfe6d7a4db7502b89c6135e82fb0d5370/diff:/var/lib/docker/overlay2/be304c5407af1d541d260988e5bb5ebcf56e95809db52c6cae56b59bf40a882a/diff:/var/lib/docker/overlay2/ee25820f5a961c0275b70d9543c62671de190985358a6c691479a4635c953cae/diff:/var/lib/docker/overlay2/cceefc5ac9abbaf9eae8333f659ffe45487e761d55acd59184b60db5e188e624/diff:/var/lib/docker/overlay2/476c70
0ef9d2925715c49427a6eba65a007cf487f40bd93d7b1abfc3da1b61bb/diff:/var/lib/docker/overlay2/d2ab89e790951a9a32019722b341819767da138caefe3df8f62b55b9e8e5010f/diff:/var/lib/docker/overlay2/d8859699ea67a49a1820ca35ba701a745c6705d05f31887dad6eb0230848c57b/diff:/var/lib/docker/overlay2/fcc2d4afadec8f48bffbd14e51b5d12833885b04baadc27b22a9df2fad3499da/diff:/var/lib/docker/overlay2/55fc6531ed6da13485b66937ebcdca76e490ab1f3646b091d8dede2fcdd3a346/diff:/var/lib/docker/overlay2/2d9b9235b115f09d9808bc0b097875a3bb5deba25a946f4317426bce8ba44f30/diff:/var/lib/docker/overlay2/0ddb50127acbbe1c0cd98d2127d38e8f16d399dd88822ec2947750d9a4c07838/diff:/var/lib/docker/overlay2/b1a5a3e9f71556a8e482b985fb477ce882b1d012bf7be9cb5145427cc778a11b/diff:/var/lib/docker/overlay2/3b4d0a1addb375e5599767278ab9fbab6aca53fa23b439beee3a6595a886aa7f/diff:/var/lib/docker/overlay2/6929688577f548f8ddfd5f33c02a81568e93fb3423bbac449561d73b976ee5eb/diff:/var/lib/docker/overlay2/d88d09034e9f9d85ca61b7dcab26b16e4989acaf53af7f5f5f85820a777b0702/diff:/var/lib/d
ocker/overlay2/bbd98fa65a1a543dafee7584755a441fe27533744e7483d4cd3ac2f5edc2589f/diff:/var/lib/docker/overlay2/643ff621d673553cfd9bf1f011c4d135cccb15ddfb0591d701ce396aea54fb79/diff:/var/lib/docker/overlay2/e0969fb7c878c5000fecdc7ba86eab53b8e95ccc25374fda67368db468007e17/diff:/var/lib/docker/overlay2/3052ace23d9ce56505c24df0928b62e74927fc0b2212ece22a1253218759b803/diff:/var/lib/docker/overlay2/03ec01fe8cbf7a6c5232ceb75a3768fd37b829401c006a9a1451d350e71a27b3/diff:/var/lib/docker/overlay2/712f64ccf9f2f3e7d7cb87d06c6cc2e8567099d842b20fbb94d9b1e79694342d/diff:/var/lib/docker/overlay2/ab2b3752b20818866edacb9bf7d0d0965815cb0742628f75d91d85a020c2f1b8/diff:/var/lib/docker/overlay2/21494fe93eee8bbfe09ecd6c6a596cf45c3947085c99f221207936547ea67ca9/diff:/var/lib/docker/overlay2/97063796233cccc3f6decef047bf93573531430d26fad1ac01667a8bbf03aa16/diff:/var/lib/docker/overlay2/78c3f52b1cb607edf4686b5f18658408e1620d2126b67d29b381d2f79ddcd3a5/diff:/var/lib/docker/overlay2/31d59cc979a6585e67e93045d936dda4da395aff1d7ca127697357a0a70
0e9de/diff:/var/lib/docker/overlay2/265847d373e6e0b3e8ec58d1fe1b4233df0c6d82714e5feb90eaf9ae8fd3b4b9/diff:/var/lib/docker/overlay2/e70d9e2b9feff2fb0c862a7365a93b6b7df8f0a57d2968ef41477d99eb3ae917/diff:/var/lib/docker/overlay2/c4f0119620e195fc293916149bc10315ba43bb897dae4e737fb68e2c302eda0a/diff:/var/lib/docker/overlay2/d3d041b45f435899d1cc2475644014c810bb692497d6c85a78f162ca17a9a96e/diff:/var/lib/docker/overlay2/e6c8eac01cbf493968305650e82f20892777ab3681b2783e64005b1fa34495ff/diff:/var/lib/docker/overlay2/bb5531f8ddef5b5f63c98cabf77cd21ae94859aecde256b35ecb339914c657de/diff:/var/lib/docker/overlay2/a747c36582c99af09553f307a3b9483c4ef35006fd456f525fd4ccba6280de59/diff:/var/lib/docker/overlay2/9a1c04cf5350a9de6d7e75995e6f55e40a0403b24cd2251640e43f35ad66294d/diff:/var/lib/docker/overlay2/4f06033da9f3778ae16ce3631a0f071407e6eb2b60b33ff3e383b9999fcfad02/diff:/var/lib/docker/overlay2/a06eabc7f3f9dd8aa35e2fabe565c5e209535101f980c9709a2fb605b96cd586/diff",
"MergedDir": "/var/lib/docker/overlay2/bfe1bfd7c21d08751e099f537657387a10067aae592a04321ebff9cdc71b600d/merged",
"UpperDir": "/var/lib/docker/overlay2/bfe1bfd7c21d08751e099f537657387a10067aae592a04321ebff9cdc71b600d/diff",
"WorkDir": "/var/lib/docker/overlay2/bfe1bfd7c21d08751e099f537657387a10067aae592a04321ebff9cdc71b600d/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-20220725164610-14919",
"Source": "/var/lib/docker/volumes/old-k8s-version-20220725164610-14919/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-20220725164610-14919",
"Domainname": "",
"User": "root",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842",
"Volumes": null,
"WorkingDir": "",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-20220725164610-14919",
"name.minikube.sigs.k8s.io": "old-k8s-version-20220725164610-14919",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "c2e0e898d7aecc974586f5a52d5113cb10ba43580ba7f36615d084c19e3b3031",
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"Ports": {
"22/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "50345"
}
],
"2376/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "50346"
}
],
"32443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "50347"
}
],
"5000/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "50348"
}
],
"8443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "50349"
}
]
},
"SandboxKey": "/var/run/docker/netns/c2e0e898d7ae",
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-20220725164610-14919": {
"IPAMConfig": {
"IPv4Address": "192.168.67.2"
},
"Links": null,
"Aliases": [
"3e45dea9c014",
"old-k8s-version-20220725164610-14919"
],
"NetworkID": "cc2155f0f89448c4255b6f474f0b34c64b5460d3acc5441984909bacee63d7d6",
"EndpointID": "463fd2f847a1a0964bd41bd7713c5c525e0b8be204ab1966d296c2aed2692d2b",
"Gateway": "192.168.67.1",
"IPAddress": "192.168.67.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"MacAddress": "02:42:c0:a8:43:02",
"DriverOpts": null
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-20220725164610-14919 -n old-k8s-version-20220725164610-14919
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-20220725164610-14919 -n old-k8s-version-20220725164610-14919: exit status 6 (464.672445ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0725 16:50:20.394855 30474 status.go:413] kubeconfig endpoint: extract IP: "old-k8s-version-20220725164610-14919" does not appear in /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-13765-9b4ecbb2d2dd64a0f495a0351a574dab999c1b37/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-20220725164610-14919" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (249.96s)