=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-darwin-amd64 start -p old-k8s-version-20220728153807-12923 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0
=== CONT TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-20220728153807-12923 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0: exit status 109 (4m9.660741756s)
-- stdout --
* [old-k8s-version-20220728153807-12923] minikube v1.26.0 on Darwin 12.5
- MINIKUBE_LOCATION=14555
- KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube
* Using the docker driver based on user configuration
* Using Docker Desktop driver with root privileges
* Starting control plane node old-k8s-version-20220728153807-12923 in cluster old-k8s-version-20220728153807-12923
* Pulling base image ...
* Creating docker container (CPUs=2, Memory=2200MB) ...
* Preparing Kubernetes v1.16.0 on Docker 20.10.17 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0728 15:38:07.250726 27927 out.go:296] Setting OutFile to fd 1 ...
I0728 15:38:07.250882 27927 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0728 15:38:07.250887 27927 out.go:309] Setting ErrFile to fd 2...
I0728 15:38:07.250891 27927 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0728 15:38:07.250996 27927 root.go:332] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/bin
I0728 15:38:07.251517 27927 out.go:303] Setting JSON to false
I0728 15:38:07.266615 27927 start.go:115] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":8929,"bootTime":1659038958,"procs":351,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"12.5","kernelVersion":"21.6.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
W0728 15:38:07.266690 27927 start.go:123] gopshost.Virtualization returned error: not implemented yet
I0728 15:38:07.290353 27927 out.go:177] * [old-k8s-version-20220728153807-12923] minikube v1.26.0 on Darwin 12.5
I0728 15:38:07.311861 27927 notify.go:193] Checking for updates...
I0728 15:38:07.333343 27927 out.go:177] - MINIKUBE_LOCATION=14555
I0728 15:38:07.354534 27927 out.go:177] - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/kubeconfig
I0728 15:38:07.376593 27927 out.go:177] - MINIKUBE_BIN=out/minikube-darwin-amd64
I0728 15:38:07.399713 27927 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0728 15:38:07.421825 27927 out.go:177] - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube
I0728 15:38:07.444324 27927 config.go:178] Loaded profile config "kubenet-20220728152330-12923": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.24.3
I0728 15:38:07.444410 27927 driver.go:365] Setting default libvirt URI to qemu:///system
I0728 15:38:07.512412 27927 docker.go:137] docker version: linux-20.10.17
I0728 15:38:07.512532 27927 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0728 15:38:07.641928 27927 info.go:265] docker info: {ID:CGEL:7L63:VIPX:OKTD:LALU:QDEW:WYEQ:5UGM:JX3Z:J7LS:3UVW:STXB Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:62 OomKillDisable:false NGoroutines:52 SystemTime:2022-07-28 22:38:07.583548413 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.104-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexSer
verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6232580096 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defau
lt name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.7.0] map[Name:extension Path:/usr/local/lib/docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.8] map[Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
I0728 15:38:07.663820 27927 out.go:177] * Using the docker driver based on user configuration
I0728 15:38:07.707907 27927 start.go:284] selected driver: docker
I0728 15:38:07.707933 27927 start.go:808] validating driver "docker" against <nil>
I0728 15:38:07.707956 27927 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0728 15:38:07.711402 27927 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0728 15:38:07.842633 27927 info.go:265] docker info: {ID:CGEL:7L63:VIPX:OKTD:LALU:QDEW:WYEQ:5UGM:JX3Z:J7LS:3UVW:STXB Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:62 OomKillDisable:false NGoroutines:52 SystemTime:2022-07-28 22:38:07.783661183 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.104-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexSer
verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6232580096 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defau
lt name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.7.0] map[Name:extension Path:/usr/local/lib/docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.8] map[Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
I0728 15:38:07.842731 27927 start_flags.go:296] no existing cluster config was found, will generate one from the flags
I0728 15:38:07.842863 27927 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0728 15:38:07.864790 27927 out.go:177] * Using Docker Desktop driver with root privileges
I0728 15:38:07.886701 27927 cni.go:95] Creating CNI manager for ""
I0728 15:38:07.886733 27927 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I0728 15:38:07.886752 27927 start_flags.go:310] config:
{Name:old-k8s-version-20220728153807-12923 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220728153807-12923 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSD
omain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
I0728 15:38:07.908696 27927 out.go:177] * Starting control plane node old-k8s-version-20220728153807-12923 in cluster old-k8s-version-20220728153807-12923
I0728 15:38:07.951653 27927 cache.go:120] Beginning downloading kic base image for docker with docker
I0728 15:38:07.973592 27927 out.go:177] * Pulling base image ...
I0728 15:38:08.016517 27927 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0728 15:38:08.016519 27927 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 in local docker daemon
I0728 15:38:08.016568 27927 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4
I0728 15:38:08.016577 27927 cache.go:57] Caching tarball of preloaded images
I0728 15:38:08.016675 27927 preload.go:174] Found /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0728 15:38:08.016686 27927 cache.go:60] Finished verifying existence of preloaded tar for v1.16.0 on docker
I0728 15:38:08.017303 27927 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/config.json ...
I0728 15:38:08.017397 27927 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/config.json: {Name:mk032086ee7c2bed36eac8a5783250f0b059be4d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0728 15:38:08.078596 27927 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 in local docker daemon, skipping pull
I0728 15:38:08.078621 27927 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 exists in daemon, skipping load
I0728 15:38:08.078632 27927 cache.go:208] Successfully downloaded all kic artifacts
I0728 15:38:08.078685 27927 start.go:370] acquiring machines lock for old-k8s-version-20220728153807-12923: {Name:mke15a14ac0b96e8c97ba263723c52eb5c7e7def Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0728 15:38:08.078832 27927 start.go:374] acquired machines lock for "old-k8s-version-20220728153807-12923" in 136.234µs
I0728 15:38:08.078861 27927 start.go:92] Provisioning new machine with config: &{Name:old-k8s-version-20220728153807-12923 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220728153807-12923
Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMi
rror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0728 15:38:08.078921 27927 start.go:132] createHost starting for "" (driver="docker")
I0728 15:38:08.100743 27927 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0728 15:38:08.101185 27927 start.go:166] libmachine.API.Create for "old-k8s-version-20220728153807-12923" (driver="docker")
I0728 15:38:08.101279 27927 client.go:168] LocalClient.Create starting
I0728 15:38:08.101464 27927 main.go:134] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/ca.pem
I0728 15:38:08.101555 27927 main.go:134] libmachine: Decoding PEM data...
I0728 15:38:08.101606 27927 main.go:134] libmachine: Parsing certificate...
I0728 15:38:08.101732 27927 main.go:134] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/cert.pem
I0728 15:38:08.101791 27927 main.go:134] libmachine: Decoding PEM data...
I0728 15:38:08.101814 27927 main.go:134] libmachine: Parsing certificate...
I0728 15:38:08.102468 27927 cli_runner.go:164] Run: docker network inspect old-k8s-version-20220728153807-12923 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0728 15:38:08.164751 27927 cli_runner.go:211] docker network inspect old-k8s-version-20220728153807-12923 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0728 15:38:08.164841 27927 network_create.go:272] running [docker network inspect old-k8s-version-20220728153807-12923] to gather additional debugging logs...
I0728 15:38:08.164856 27927 cli_runner.go:164] Run: docker network inspect old-k8s-version-20220728153807-12923
W0728 15:38:08.226254 27927 cli_runner.go:211] docker network inspect old-k8s-version-20220728153807-12923 returned with exit code 1
I0728 15:38:08.226283 27927 network_create.go:275] error running [docker network inspect old-k8s-version-20220728153807-12923]: docker network inspect old-k8s-version-20220728153807-12923: exit status 1
stdout:
[]
stderr:
Error: No such network: old-k8s-version-20220728153807-12923
I0728 15:38:08.226304 27927 network_create.go:277] output of [docker network inspect old-k8s-version-20220728153807-12923]: -- stdout --
[]
-- /stdout --
** stderr **
Error: No such network: old-k8s-version-20220728153807-12923
** /stderr **
I0728 15:38:08.226384 27927 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0728 15:38:08.286893 27927 network.go:288] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc000c10800] misses:0}
I0728 15:38:08.286930 27927 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0728 15:38:08.286946 27927 network_create.go:115] attempt to create docker network old-k8s-version-20220728153807-12923 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0728 15:38:08.287017 27927 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220728153807-12923 old-k8s-version-20220728153807-12923
W0728 15:38:08.347685 27927 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220728153807-12923 old-k8s-version-20220728153807-12923 returned with exit code 1
W0728 15:38:08.347717 27927 network_create.go:107] failed to create docker network old-k8s-version-20220728153807-12923 192.168.49.0/24, will retry: subnet is taken
I0728 15:38:08.348021 27927 network.go:279] skipping subnet 192.168.49.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000c10800] amended:false}} dirty:map[] misses:0}
I0728 15:38:08.348036 27927 network.go:238] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0728 15:38:08.348247 27927 network.go:288] reserving subnet 192.168.58.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000c10800] amended:true}} dirty:map[192.168.49.0:0xc000c10800 192.168.58.0:0xc00080c1f8] misses:0}
I0728 15:38:08.348262 27927 network.go:235] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0728 15:38:08.348269 27927 network_create.go:115] attempt to create docker network old-k8s-version-20220728153807-12923 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ...
I0728 15:38:08.348362 27927 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220728153807-12923 old-k8s-version-20220728153807-12923
W0728 15:38:08.410077 27927 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220728153807-12923 old-k8s-version-20220728153807-12923 returned with exit code 1
W0728 15:38:08.410117 27927 network_create.go:107] failed to create docker network old-k8s-version-20220728153807-12923 192.168.58.0/24, will retry: subnet is taken
I0728 15:38:08.410399 27927 network.go:279] skipping subnet 192.168.58.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000c10800] amended:true}} dirty:map[192.168.49.0:0xc000c10800 192.168.58.0:0xc00080c1f8] misses:1}
I0728 15:38:08.410421 27927 network.go:238] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0728 15:38:08.410625 27927 network.go:288] reserving subnet 192.168.67.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000c10800] amended:true}} dirty:map[192.168.49.0:0xc000c10800 192.168.58.0:0xc00080c1f8 192.168.67.0:0xc000c10838] misses:1}
I0728 15:38:08.410644 27927 network.go:235] using free private subnet 192.168.67.0/24: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0728 15:38:08.410656 27927 network_create.go:115] attempt to create docker network old-k8s-version-20220728153807-12923 192.168.67.0/24 with gateway 192.168.67.1 and MTU of 1500 ...
I0728 15:38:08.410713 27927 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220728153807-12923 old-k8s-version-20220728153807-12923
W0728 15:38:08.473077 27927 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220728153807-12923 old-k8s-version-20220728153807-12923 returned with exit code 1
W0728 15:38:08.473108 27927 network_create.go:107] failed to create docker network old-k8s-version-20220728153807-12923 192.168.67.0/24, will retry: subnet is taken
I0728 15:38:08.473395 27927 network.go:279] skipping subnet 192.168.67.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000c10800] amended:true}} dirty:map[192.168.49.0:0xc000c10800 192.168.58.0:0xc00080c1f8 192.168.67.0:0xc000c10838] misses:2}
I0728 15:38:08.473417 27927 network.go:238] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0728 15:38:08.473613 27927 network.go:288] reserving subnet 192.168.76.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000c10800] amended:true}} dirty:map[192.168.49.0:0xc000c10800 192.168.58.0:0xc00080c1f8 192.168.67.0:0xc000c10838 192.168.76.0:0xc00080c230] misses:2}
I0728 15:38:08.473627 27927 network.go:235] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0728 15:38:08.473634 27927 network_create.go:115] attempt to create docker network old-k8s-version-20220728153807-12923 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I0728 15:38:08.473686 27927 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220728153807-12923 old-k8s-version-20220728153807-12923
I0728 15:38:08.567146 27927 network_create.go:99] docker network old-k8s-version-20220728153807-12923 192.168.76.0/24 created
I0728 15:38:08.567176 27927 kic.go:106] calculated static IP "192.168.76.2" for the "old-k8s-version-20220728153807-12923" container
I0728 15:38:08.567295 27927 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0728 15:38:08.631262 27927 cli_runner.go:164] Run: docker volume create old-k8s-version-20220728153807-12923 --label name.minikube.sigs.k8s.io=old-k8s-version-20220728153807-12923 --label created_by.minikube.sigs.k8s.io=true
I0728 15:38:08.693876 27927 oci.go:103] Successfully created a docker volume old-k8s-version-20220728153807-12923
I0728 15:38:08.693995 27927 cli_runner.go:164] Run: docker run --rm --name old-k8s-version-20220728153807-12923-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-20220728153807-12923 --entrypoint /usr/bin/test -v old-k8s-version-20220728153807-12923:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 -d /var/lib
I0728 15:38:09.194496 27927 oci.go:107] Successfully prepared a docker volume old-k8s-version-20220728153807-12923
I0728 15:38:09.194552 27927 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0728 15:38:09.194566 27927 kic.go:179] Starting extracting preloaded images to volume ...
I0728 15:38:09.194680 27927 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-20220728153807-12923:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 -I lz4 -xf /preloaded.tar -C /extractDir
I0728 15:38:13.925302 27927 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-20220728153807-12923:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 -I lz4 -xf /preloaded.tar -C /extractDir: (4.730616433s)
I0728 15:38:13.925323 27927 kic.go:188] duration metric: took 4.730819 seconds to extract preloaded images to volume
I0728 15:38:13.925434 27927 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0728 15:38:14.073519 27927 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname old-k8s-version-20220728153807-12923 --name old-k8s-version-20220728153807-12923 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-20220728153807-12923 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=old-k8s-version-20220728153807-12923 --network old-k8s-version-20220728153807-12923 --ip 192.168.76.2 --volume old-k8s-version-20220728153807-12923:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=8443 --publish=22 --publish=2376 --publish=5000 --publish=32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842
I0728 15:38:14.505737 27927 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220728153807-12923 --format={{.State.Running}}
I0728 15:38:14.571899 27927 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220728153807-12923 --format={{.State.Status}}
I0728 15:38:14.643096 27927 cli_runner.go:164] Run: docker exec old-k8s-version-20220728153807-12923 stat /var/lib/dpkg/alternatives/iptables
I0728 15:38:14.769306 27927 oci.go:144] the created container "old-k8s-version-20220728153807-12923" has a running status.
I0728 15:38:14.769335 27927 kic.go:210] Creating ssh key for kic: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/machines/old-k8s-version-20220728153807-12923/id_rsa...
I0728 15:38:14.961744 27927 kic_runner.go:191] docker (temp): /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/machines/old-k8s-version-20220728153807-12923/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0728 15:38:15.081728 27927 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220728153807-12923 --format={{.State.Status}}
I0728 15:38:15.150577 27927 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0728 15:38:15.150594 27927 kic_runner.go:114] Args: [docker exec --privileged old-k8s-version-20220728153807-12923 chown docker:docker /home/docker/.ssh/authorized_keys]
I0728 15:38:15.263761 27927 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220728153807-12923 --format={{.State.Status}}
I0728 15:38:15.330850 27927 machine.go:88] provisioning docker machine ...
I0728 15:38:15.330897 27927 ubuntu.go:169] provisioning hostname "old-k8s-version-20220728153807-12923"
I0728 15:38:15.330990 27927 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220728153807-12923
I0728 15:38:15.395648 27927 main.go:134] libmachine: Using SSH client type: native
I0728 15:38:15.395871 27927 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2e20] 0x13d5e80 <nil> [] 0s} 127.0.0.1 58781 <nil> <nil>}
I0728 15:38:15.395892 27927 main.go:134] libmachine: About to run SSH command:
sudo hostname old-k8s-version-20220728153807-12923 && echo "old-k8s-version-20220728153807-12923" | sudo tee /etc/hostname
I0728 15:38:15.525188 27927 main.go:134] libmachine: SSH cmd err, output: <nil>: old-k8s-version-20220728153807-12923
I0728 15:38:15.525269 27927 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220728153807-12923
I0728 15:38:15.588709 27927 main.go:134] libmachine: Using SSH client type: native
I0728 15:38:15.588988 27927 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2e20] 0x13d5e80 <nil> [] 0s} 127.0.0.1 58781 <nil> <nil>}
I0728 15:38:15.589004 27927 main.go:134] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-20220728153807-12923' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-20220728153807-12923/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-20220728153807-12923' | sudo tee -a /etc/hosts;
fi
fi
I0728 15:38:15.709466 27927 main.go:134] libmachine: SSH cmd err, output: <nil>:
I0728 15:38:15.709492 27927 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube CaCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/key.pem ServerCertRemotePath:/etc/doc
ker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube}
I0728 15:38:15.709518 27927 ubuntu.go:177] setting up certificates
I0728 15:38:15.709529 27927 provision.go:83] configureAuth start
I0728 15:38:15.709595 27927 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220728153807-12923
I0728 15:38:15.774215 27927 provision.go:138] copyHostCerts
I0728 15:38:15.774308 27927 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/ca.pem, removing ...
I0728 15:38:15.774317 27927 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/ca.pem
I0728 15:38:15.774415 27927 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/ca.pem (1082 bytes)
I0728 15:38:15.774595 27927 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/cert.pem, removing ...
I0728 15:38:15.774613 27927 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/cert.pem
I0728 15:38:15.774677 27927 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/cert.pem (1123 bytes)
I0728 15:38:15.774836 27927 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/key.pem, removing ...
I0728 15:38:15.774843 27927 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/key.pem
I0728 15:38:15.774902 27927 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/key.pem (1679 bytes)
I0728 15:38:15.775013 27927 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-20220728153807-12923 san=[192.168.76.2 127.0.0.1 localhost 127.0.0.1 minikube old-k8s-version-20220728153807-12923]
I0728 15:38:15.899503 27927 provision.go:172] copyRemoteCerts
I0728 15:38:15.899563 27927 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0728 15:38:15.899611 27927 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220728153807-12923
I0728 15:38:15.963981 27927 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:58781 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/machines/old-k8s-version-20220728153807-12923/id_rsa Username:docker}
I0728 15:38:16.050382 27927 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0728 15:38:16.066578 27927 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0728 15:38:16.087903 27927 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/machines/server.pem --> /etc/docker/server.pem (1281 bytes)
I0728 15:38:16.108951 27927 provision.go:86] duration metric: configureAuth took 399.409148ms
I0728 15:38:16.108966 27927 ubuntu.go:193] setting minikube options for container-runtime
I0728 15:38:16.109115 27927 config.go:178] Loaded profile config "old-k8s-version-20220728153807-12923": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
I0728 15:38:16.109180 27927 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220728153807-12923
I0728 15:38:16.177890 27927 main.go:134] libmachine: Using SSH client type: native
I0728 15:38:16.178067 27927 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2e20] 0x13d5e80 <nil> [] 0s} 127.0.0.1 58781 <nil> <nil>}
I0728 15:38:16.178085 27927 main.go:134] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0728 15:38:16.297211 27927 main.go:134] libmachine: SSH cmd err, output: <nil>: overlay
I0728 15:38:16.297224 27927 ubuntu.go:71] root file system type: overlay
I0728 15:38:16.297346 27927 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0728 15:38:16.297412 27927 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220728153807-12923
I0728 15:38:16.363516 27927 main.go:134] libmachine: Using SSH client type: native
I0728 15:38:16.363692 27927 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2e20] 0x13d5e80 <nil> [] 0s} 127.0.0.1 58781 <nil> <nil>}
I0728 15:38:16.363743 27927 main.go:134] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0728 15:38:16.492801 27927 main.go:134] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0728 15:38:16.492886 27927 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220728153807-12923
I0728 15:38:16.556575 27927 main.go:134] libmachine: Using SSH client type: native
I0728 15:38:16.556776 27927 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2e20] 0x13d5e80 <nil> [] 0s} 127.0.0.1 58781 <nil> <nil>}
I0728 15:38:16.556790 27927 main.go:134] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0728 15:38:17.202459 27927 main.go:134] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2022-06-06 23:01:03.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2022-07-28 22:38:16.511658139 +0000
@@ -1,30 +1,32 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
Wants=network-online.target
-Requires=docker.socket containerd.service
+Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutSec=0
-RestartSec=2
-Restart=always
-
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
+Restart=on-failure
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
@@ -32,16 +34,16 @@
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0728 15:38:17.202499 27927 machine.go:91] provisioned docker machine in 1.871649133s
I0728 15:38:17.202508 27927 client.go:171] LocalClient.Create took 9.101339793s
I0728 15:38:17.202539 27927 start.go:174] duration metric: libmachine.API.Create for "old-k8s-version-20220728153807-12923" took 9.101474061s
I0728 15:38:17.202560 27927 start.go:307] post-start starting for "old-k8s-version-20220728153807-12923" (driver="docker")
I0728 15:38:17.202570 27927 start.go:334] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0728 15:38:17.202670 27927 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0728 15:38:17.202741 27927 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220728153807-12923
I0728 15:38:17.288304 27927 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:58781 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/machines/old-k8s-version-20220728153807-12923/id_rsa Username:docker}
I0728 15:38:17.380618 27927 ssh_runner.go:195] Run: cat /etc/os-release
I0728 15:38:17.385616 27927 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0728 15:38:17.385635 27927 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0728 15:38:17.385646 27927 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0728 15:38:17.385655 27927 info.go:137] Remote host: Ubuntu 20.04.4 LTS
I0728 15:38:17.385675 27927 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/addons for local assets ...
I0728 15:38:17.385789 27927 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/files for local assets ...
I0728 15:38:17.385925 27927 filesync.go:149] local asset: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/files/etc/ssl/certs/129232.pem -> 129232.pem in /etc/ssl/certs
I0728 15:38:17.386076 27927 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0728 15:38:17.396010 27927 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/files/etc/ssl/certs/129232.pem --> /etc/ssl/certs/129232.pem (1708 bytes)
I0728 15:38:17.423596 27927 start.go:310] post-start completed in 221.017184ms
I0728 15:38:17.424131 27927 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220728153807-12923
I0728 15:38:17.496370 27927 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/config.json ...
I0728 15:38:17.496804 27927 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0728 15:38:17.496857 27927 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220728153807-12923
I0728 15:38:17.562865 27927 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:58781 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/machines/old-k8s-version-20220728153807-12923/id_rsa Username:docker}
I0728 15:38:17.646793 27927 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0728 15:38:17.651157 27927 start.go:135] duration metric: createHost completed in 9.572356191s
I0728 15:38:17.651175 27927 start.go:82] releasing machines lock for "old-k8s-version-20220728153807-12923", held for 9.572460526s
I0728 15:38:17.651237 27927 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220728153807-12923
I0728 15:38:17.715411 27927 ssh_runner.go:195] Run: systemctl --version
I0728 15:38:17.715416 27927 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
I0728 15:38:17.715479 27927 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220728153807-12923
I0728 15:38:17.715504 27927 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220728153807-12923
I0728 15:38:17.785144 27927 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:58781 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/machines/old-k8s-version-20220728153807-12923/id_rsa Username:docker}
I0728 15:38:17.785149 27927 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:58781 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/machines/old-k8s-version-20220728153807-12923/id_rsa Username:docker}
I0728 15:38:18.063520 27927 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0728 15:38:18.074596 27927 cruntime.go:273] skipping containerd shutdown because we are bound to it
I0728 15:38:18.074650 27927 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0728 15:38:18.083660 27927 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
image-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0728 15:38:18.097614 27927 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0728 15:38:18.163505 27927 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0728 15:38:18.244996 27927 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0728 15:38:18.317060 27927 ssh_runner.go:195] Run: sudo systemctl restart docker
I0728 15:38:18.522239 27927 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0728 15:38:18.556554 27927 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0728 15:38:18.667066 27927 out.go:204] * Preparing Kubernetes v1.16.0 on Docker 20.10.17 ...
I0728 15:38:18.667168 27927 cli_runner.go:164] Run: docker exec -t old-k8s-version-20220728153807-12923 dig +short host.docker.internal
I0728 15:38:18.803331 27927 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2
I0728 15:38:18.803425 27927 ssh_runner.go:195] Run: grep 192.168.65.2 host.minikube.internal$ /etc/hosts
I0728 15:38:18.807907 27927 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0728 15:38:18.817213 27927 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-20220728153807-12923
I0728 15:38:18.881578 27927 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0728 15:38:18.881652 27927 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0728 15:38:18.910887 27927 docker.go:611] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0728 15:38:18.910903 27927 docker.go:542] Images already preloaded, skipping extraction
I0728 15:38:18.910987 27927 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0728 15:38:18.940953 27927 docker.go:611] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0728 15:38:18.940975 27927 cache_images.go:84] Images are preloaded, skipping loading
I0728 15:38:18.941048 27927 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0728 15:38:19.016486 27927 cni.go:95] Creating CNI manager for ""
I0728 15:38:19.016499 27927 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I0728 15:38:19.016511 27927 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0728 15:38:19.016523 27927 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-20220728153807-12923 NodeName:old-k8s-version-20220728153807-12923 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.76.2 CgroupDriver:systemd Clien
tCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
I0728 15:38:19.016644 27927 kubeadm.go:162] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-20220728153807-12923"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-20220728153807-12923
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.76.2:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0728 15:38:19.016721 27927 kubeadm.go:961] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-20220728153807-12923 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220728153807-12923 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0728 15:38:19.016785 27927 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0728 15:38:19.024430 27927 binaries.go:44] Found k8s binaries, skipping transfer
I0728 15:38:19.024491 27927 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0728 15:38:19.031591 27927 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (362 bytes)
I0728 15:38:19.045956 27927 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0728 15:38:19.058828 27927 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2148 bytes)
I0728 15:38:19.073795 27927 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0728 15:38:19.077968 27927 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0728 15:38:19.088322 27927 certs.go:54] Setting up /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923 for IP: 192.168.76.2
I0728 15:38:19.088448 27927 certs.go:182] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/ca.key
I0728 15:38:19.088504 27927 certs.go:182] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/proxy-client-ca.key
I0728 15:38:19.088552 27927 certs.go:302] generating minikube-user signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/client.key
I0728 15:38:19.088566 27927 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/client.crt with IP's: []
I0728 15:38:19.252005 27927 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/client.crt ...
I0728 15:38:19.252027 27927 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/client.crt: {Name:mka033eff282b954f3b2dde5752bd32e62161e74 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0728 15:38:19.252325 27927 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/client.key ...
I0728 15:38:19.252334 27927 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/client.key: {Name:mkbda0593c134af0dbf46c1c2781d8a68993e61e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0728 15:38:19.252530 27927 certs.go:302] generating minikube signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/apiserver.key.31bdca25
I0728 15:38:19.252545 27927 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/apiserver.crt.31bdca25 with IP's: [192.168.76.2 10.96.0.1 127.0.0.1 10.0.0.1]
I0728 15:38:19.307652 27927 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/apiserver.crt.31bdca25 ...
I0728 15:38:19.307668 27927 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/apiserver.crt.31bdca25: {Name:mk669d1ca2802bdb63bdbad49562b2b5961e4fbb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0728 15:38:19.307932 27927 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/apiserver.key.31bdca25 ...
I0728 15:38:19.307940 27927 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/apiserver.key.31bdca25: {Name:mkf4d087e4021e6ada42b74fefa47868c546b41b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0728 15:38:19.308131 27927 certs.go:320] copying /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/apiserver.crt.31bdca25 -> /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/apiserver.crt
I0728 15:38:19.308292 27927 certs.go:324] copying /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/apiserver.key.31bdca25 -> /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/apiserver.key
I0728 15:38:19.308459 27927 certs.go:302] generating aggregator signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/proxy-client.key
I0728 15:38:19.308474 27927 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/proxy-client.crt with IP's: []
I0728 15:38:19.455366 27927 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/proxy-client.crt ...
I0728 15:38:19.455381 27927 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/proxy-client.crt: {Name:mk845294ccfee4134a79875b8362eed7cb69091f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0728 15:38:19.455658 27927 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/proxy-client.key ...
I0728 15:38:19.455665 27927 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/proxy-client.key: {Name:mk74e0c9db3049489b1f3eb531bde2d6b1d72bd5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0728 15:38:19.456042 27927 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/12923.pem (1338 bytes)
W0728 15:38:19.456082 27927 certs.go:384] ignoring /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/12923_empty.pem, impossibly tiny 0 bytes
I0728 15:38:19.456094 27927 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/ca-key.pem (1679 bytes)
I0728 15:38:19.456124 27927 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/ca.pem (1082 bytes)
I0728 15:38:19.456153 27927 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/cert.pem (1123 bytes)
I0728 15:38:19.456180 27927 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/key.pem (1679 bytes)
I0728 15:38:19.456242 27927 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/files/etc/ssl/certs/129232.pem (1708 bytes)
I0728 15:38:19.456685 27927 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0728 15:38:19.474959 27927 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0728 15:38:19.493378 27927 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0728 15:38:19.512070 27927 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/profiles/old-k8s-version-20220728153807-12923/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0728 15:38:19.528727 27927 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0728 15:38:19.549639 27927 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0728 15:38:19.566917 27927 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0728 15:38:19.583472 27927 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0728 15:38:19.602953 27927 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/files/etc/ssl/certs/129232.pem --> /usr/share/ca-certificates/129232.pem (1708 bytes)
I0728 15:38:19.621469 27927 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0728 15:38:19.640433 27927 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/.minikube/certs/12923.pem --> /usr/share/ca-certificates/12923.pem (1338 bytes)
I0728 15:38:19.660220 27927 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0728 15:38:19.673942 27927 ssh_runner.go:195] Run: openssl version
I0728 15:38:19.679322 27927 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/12923.pem && ln -fs /usr/share/ca-certificates/12923.pem /etc/ssl/certs/12923.pem"
I0728 15:38:19.688705 27927 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/12923.pem
I0728 15:38:19.692671 27927 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jul 28 21:44 /usr/share/ca-certificates/12923.pem
I0728 15:38:19.692712 27927 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/12923.pem
I0728 15:38:19.697809 27927 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/12923.pem /etc/ssl/certs/51391683.0"
I0728 15:38:19.705558 27927 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/129232.pem && ln -fs /usr/share/ca-certificates/129232.pem /etc/ssl/certs/129232.pem"
I0728 15:38:19.713390 27927 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/129232.pem
I0728 15:38:19.717330 27927 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jul 28 21:44 /usr/share/ca-certificates/129232.pem
I0728 15:38:19.717371 27927 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/129232.pem
I0728 15:38:19.722257 27927 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/129232.pem /etc/ssl/certs/3ec20f2e.0"
I0728 15:38:19.729645 27927 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0728 15:38:19.738898 27927 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0728 15:38:19.742608 27927 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jul 28 21:40 /usr/share/ca-certificates/minikubeCA.pem
I0728 15:38:19.742650 27927 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0728 15:38:19.747708 27927 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0728 15:38:19.755280 27927 kubeadm.go:395] StartCluster: {Name:old-k8s-version-20220728153807-12923 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220728153807-12923 Namespace:default API
ServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disa
bleOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
I0728 15:38:19.755368 27927 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0728 15:38:19.783507 27927 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0728 15:38:19.792258 27927 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0728 15:38:19.799510 27927 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I0728 15:38:19.799554 27927 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0728 15:38:19.806695 27927 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0728 15:38:19.806716 27927 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0728 15:38:20.568004 27927 out.go:204] - Generating certificates and keys ...
I0728 15:38:22.412571 27927 out.go:204] - Booting up control plane ...
W0728 15:40:17.352088 27927 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-20220728153807-12923 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-20220728153807-12923 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-20220728153807-12923 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-20220728153807-12923 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0728 15:40:17.352125 27927 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"
I0728 15:40:17.775034 27927 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0728 15:40:17.784129 27927 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I0728 15:40:17.784185 27927 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0728 15:40:17.791107 27927 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0728 15:40:17.791133 27927 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0728 15:40:18.541329 27927 out.go:204] - Generating certificates and keys ...
I0728 15:40:19.326055 27927 out.go:204] - Booting up control plane ...
I0728 15:42:14.239101 27927 kubeadm.go:397] StartCluster complete in 3m54.485080664s
I0728 15:42:14.239179 27927 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0728 15:42:14.268541 27927 logs.go:274] 0 containers: []
W0728 15:42:14.268557 27927 logs.go:276] No container was found matching "kube-apiserver"
I0728 15:42:14.268616 27927 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0728 15:42:14.298089 27927 logs.go:274] 0 containers: []
W0728 15:42:14.298102 27927 logs.go:276] No container was found matching "etcd"
I0728 15:42:14.298162 27927 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0728 15:42:14.326063 27927 logs.go:274] 0 containers: []
W0728 15:42:14.326075 27927 logs.go:276] No container was found matching "coredns"
I0728 15:42:14.326135 27927 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0728 15:42:14.355747 27927 logs.go:274] 0 containers: []
W0728 15:42:14.355759 27927 logs.go:276] No container was found matching "kube-scheduler"
I0728 15:42:14.355818 27927 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0728 15:42:14.385008 27927 logs.go:274] 0 containers: []
W0728 15:42:14.385020 27927 logs.go:276] No container was found matching "kube-proxy"
I0728 15:42:14.385075 27927 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0728 15:42:14.413496 27927 logs.go:274] 0 containers: []
W0728 15:42:14.413509 27927 logs.go:276] No container was found matching "kubernetes-dashboard"
I0728 15:42:14.413571 27927 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0728 15:42:14.441883 27927 logs.go:274] 0 containers: []
W0728 15:42:14.441896 27927 logs.go:276] No container was found matching "storage-provisioner"
I0728 15:42:14.441954 27927 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0728 15:42:14.470599 27927 logs.go:274] 0 containers: []
W0728 15:42:14.470610 27927 logs.go:276] No container was found matching "kube-controller-manager"
I0728 15:42:14.470617 27927 logs.go:123] Gathering logs for describe nodes ...
I0728 15:42:14.470626 27927 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0728 15:42:14.522139 27927 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0728 15:42:14.522154 27927 logs.go:123] Gathering logs for Docker ...
I0728 15:42:14.522161 27927 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400"
I0728 15:42:14.537954 27927 logs.go:123] Gathering logs for container status ...
I0728 15:42:14.537966 27927 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0728 15:42:16.592814 27927 ssh_runner.go:235] Completed: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": (2.054870383s)
I0728 15:42:16.592951 27927 logs.go:123] Gathering logs for kubelet ...
I0728 15:42:16.592958 27927 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0728 15:42:16.632638 27927 logs.go:123] Gathering logs for dmesg ...
I0728 15:42:16.632650 27927 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
W0728 15:42:16.644203 27927 out.go:369] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0728 15:42:16.644218 27927 out.go:239] *
*
W0728 15:42:16.644342 27927 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0728 15:42:16.644357 27927 out.go:239] *
*
W0728 15:42:16.644920 27927 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0728 15:42:16.707587 27927 out.go:177]
W0728 15:42:16.749727 27927 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0728 15:42:16.749881 27927 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0728 15:42:16.749961 27927 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0728 15:42:16.792503 27927 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p old-k8s-version-20220728153807-12923 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-20220728153807-12923
helpers_test.go:235: (dbg) docker inspect old-k8s-version-20220728153807-12923:
-- stdout --
[
{
"Id": "2056d9a86a4ca08e1ec783c3ce5a34920343f59ecadd8b3d5a33c2a05952e44f",
"Created": "2022-07-28T22:38:14.165684968Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 226367,
"ExitCode": 0,
"Error": "",
"StartedAt": "2022-07-28T22:38:14.474965174Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:443d84da239e4e701685e1614ef94cd6b60d0f0b15265a51d4f657992a9c59d8",
"ResolvConfPath": "/var/lib/docker/containers/2056d9a86a4ca08e1ec783c3ce5a34920343f59ecadd8b3d5a33c2a05952e44f/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/2056d9a86a4ca08e1ec783c3ce5a34920343f59ecadd8b3d5a33c2a05952e44f/hostname",
"HostsPath": "/var/lib/docker/containers/2056d9a86a4ca08e1ec783c3ce5a34920343f59ecadd8b3d5a33c2a05952e44f/hosts",
"LogPath": "/var/lib/docker/containers/2056d9a86a4ca08e1ec783c3ce5a34920343f59ecadd8b3d5a33c2a05952e44f/2056d9a86a4ca08e1ec783c3ce5a34920343f59ecadd8b3d5a33c2a05952e44f-json.log",
"Name": "/old-k8s-version-20220728153807-12923",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-20220728153807-12923:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-20220728153807-12923",
"PortBindings": {
"22/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"2376/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"32443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"5000/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"8443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"ConsoleSize": [
0,
0
],
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": null,
"BlkioDeviceWriteBps": null,
"BlkioDeviceReadIOps": null,
"BlkioDeviceWriteIOps": null,
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"KernelMemory": 0,
"KernelMemoryTCP": 0,
"MemoryReservation": 0,
"MemorySwap": 2306867200,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": null,
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/352be77058f615864a907445aa12422ebe9fd025617aac2141ae82132058eefb-init/diff:/var/lib/docker/overlay2/056596d2929957d3e3e5b833685acff2b231f40eb9a087a59341c3c300a1b50e/diff:/var/lib/docker/overlay2/aeeecdb6606dd9393c4cb99ce4808b7bc24a6ef0097f307d6fed1bc526f97dc4/diff:/var/lib/docker/overlay2/e07e57252d473c4cf4585dd0b9e432d12de28ab92afbbfb37f7665912e11fc18/diff:/var/lib/docker/overlay2/bbac83d2502e96ec5da00604b65463367cd22f277fe6f609360044fb0f9e1377/diff:/var/lib/docker/overlay2/87e23b65710d2a58c9173bc6e4d8b8ffd791c437e43a6f436592bd31957aabec/diff:/var/lib/docker/overlay2/66ff02810cb15e198965336352c77a7ddfed37b38eabcb9c06bcf16d38254863/diff:/var/lib/docker/overlay2/54bab0cb140c2be9a41713079493f675d8c09dad36e2723ba0d090675c6c3a4a/diff:/var/lib/docker/overlay2/8b8e155fa64f1976f5bd773e5fd1f752349548f540f72a6f97626b319a6628c4/diff:/var/lib/docker/overlay2/288f61b1f03f49e0f468d48a99b71c5dda52c62497376c20e4062e00e0e212b0/diff:/var/lib/docker/overlay2/7ffdb6
eab366aa778a281545eab06c14f736685bcedd528425f7239d4182e3d6/diff:/var/lib/docker/overlay2/8084a5e10489b1f3c8307655c75072b74006e27dc9000fe9e4cd5a894ed2c5d0/diff:/var/lib/docker/overlay2/b22caa19afdac0befabc36e685db869ca09aacdfa3b05d0e6ed6509088428d5c/diff:/var/lib/docker/overlay2/da177b4c55e195e7dbd4bcfac4164d946999086a0b3f6cebea03d13078c5b054/diff:/var/lib/docker/overlay2/fed1ccce88d43bca8f3a608efe70e9c1bf5d7e0316a3b44092c51dcb76407869/diff:/var/lib/docker/overlay2/0deef43118296a1cdca3fdbb73d71fa36221439d43819f9d382585d4bb88e514/diff:/var/lib/docker/overlay2/36703718b3a187ca182c33b4a6196384bc12465f45284242445ef1c911522a3a/diff:/var/lib/docker/overlay2/d5495158f0841c57fe30745169420c5874add7c8753c5184c81c0eca278b7663/diff:/var/lib/docker/overlay2/b8e24e1ded71e0c81d302dd42229a8e6ecc6b70249b773e7f31c5e384bfbe807/diff:/var/lib/docker/overlay2/255faf81b7577b32278f8d91ac6c5fa13f016ce25c57f27a74ab25966c6aef1c/diff:/var/lib/docker/overlay2/b56171b260f9801a2b7aff8a07cb1feaebeaf99662ca0f1ecab49d06546da75a/diff:/var/lib/d
ocker/overlay2/c28df73f923fc29cb544712edb8520a508e27fbf70089902b11049fca8b16cce/diff:/var/lib/docker/overlay2/d33e1f8d5d5405cbf2ffb03b86e0627c34bf11c04ae68eb2e3bfdd718caf9aa4/diff:/var/lib/docker/overlay2/b8da86470b0957b347d26133bf0a33ac606fe96785e6360b4f04523256656b52/diff:/var/lib/docker/overlay2/dc2546d770c4cc6caae497560c40bc3e264046b42ed741118864be97a3dae436/diff:/var/lib/docker/overlay2/ccbb4f6660f8f577ace2d82cf7f55a1839a4fed8e177a672115b9606da1e39d6/diff:/var/lib/docker/overlay2/0fa957ad848132aca392d60e78058506e8df61bebe0a7e396d1d2915dc9f432d/diff:/var/lib/docker/overlay2/b7977f3de7aaa2ed3410442ce34e3a453c594428adc88b3a534b2956afe799ce/diff:/var/lib/docker/overlay2/ed33072eb8076fa8fe0c9fdb0a3de4e4bda337c4dfd23bb26223dd09570e2d20/diff:/var/lib/docker/overlay2/0cdef085db86a9c6f9657c4297d14a366fd816b8bdd2efd31970c0f70b87a490/diff:/var/lib/docker/overlay2/74cd47bcc28085a71facaa0f36ee9279e40db7efc4256190e05a4e938156c446/diff:/var/lib/docker/overlay2/a4e9b207a11193fc51296a1c4f8460cf573030f090caa5c97931b239d05
9732f/diff:/var/lib/docker/overlay2/f9c465c3e0ea0efb497df00981b3bff779c6baafbf2ab7a5a2584ba86a98eb7d/diff:/var/lib/docker/overlay2/11b9edd42ce56b4368a5179b4ab24cad8119edce94b34805aa7d32583ebb83a1/diff:/var/lib/docker/overlay2/e7a5451e6dd38cb177abc0ddc9d8ec6fc06f6f84b64c6a327e5bb3f3861e9f50/diff:/var/lib/docker/overlay2/6acbb8b5586c22d8819fa398bd3eabdebffad58c08685b439c7a610a0d0529ce/diff:/var/lib/docker/overlay2/57c0cdd0c15b962e55c5c26017708753503d33944831570b135a54e8c181e20a/diff:/var/lib/docker/overlay2/bf658887a041fdb93d1609e296e154bccfc5e0d0e222a5b72f917b85be40fbd8/diff:/var/lib/docker/overlay2/df3b97a9157b26b4b7ba94b94a2a64ff57b161f00247adc2ac33e4278f44ff77/diff:/var/lib/docker/overlay2/d89e345666b7dbd89c5ddff8f20f1d5a4889dbfe34585f220f881e95575fcaa1/diff:/var/lib/docker/overlay2/674ee03596c158982d0fb07646f4791c02de0938e0f732c546d2f668426fce13/diff:/var/lib/docker/overlay2/5665cbe7dda9368c88dc12d81c21851029f12099d4ac4a45dccb0ca694352e02/diff",
"MergedDir": "/var/lib/docker/overlay2/352be77058f615864a907445aa12422ebe9fd025617aac2141ae82132058eefb/merged",
"UpperDir": "/var/lib/docker/overlay2/352be77058f615864a907445aa12422ebe9fd025617aac2141ae82132058eefb/diff",
"WorkDir": "/var/lib/docker/overlay2/352be77058f615864a907445aa12422ebe9fd025617aac2141ae82132058eefb/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-20220728153807-12923",
"Source": "/var/lib/docker/volumes/old-k8s-version-20220728153807-12923/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-20220728153807-12923",
"Domainname": "",
"User": "root",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656700284-14481@sha256:96d18f055abcf72b9f587e13317d6f9b5bb6f60e9fa09d6c51e11defaf9bf842",
"Volumes": null,
"WorkingDir": "",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-20220728153807-12923",
"name.minikube.sigs.k8s.io": "old-k8s-version-20220728153807-12923",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "583724ad15a1bb5d0d85e751ff38f95aa3b292879509514520f82dc83bcbd15c",
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"Ports": {
"22/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "58781"
}
],
"2376/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "58782"
}
],
"32443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "58783"
}
],
"5000/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "58779"
}
],
"8443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "58780"
}
]
},
"SandboxKey": "/var/run/docker/netns/583724ad15a1",
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-20220728153807-12923": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": [
"2056d9a86a4c",
"old-k8s-version-20220728153807-12923"
],
"NetworkID": "a0b55590b406427f4aa9e75be1fbe382dd54fa7a1c14e888e401b45bb478b32d",
"EndpointID": "5b6d296354ccf12d05eec7dc23f27fb6b8a44e70e4b712e35f015256db9a0026",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"MacAddress": "02:42:c0:a8:4c:02",
"DriverOpts": null
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-20220728153807-12923 -n old-k8s-version-20220728153807-12923
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-20220728153807-12923 -n old-k8s-version-20220728153807-12923: exit status 6 (414.940751ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0728 15:42:17.365290 28591 status.go:413] kubeconfig endpoint: extract IP: "old-k8s-version-20220728153807-12923" does not appear in /Users/jenkins/minikube-integration/darwin-amd64-docker--14555-11737-f5b83d4f17589580a6f3f2e048ea841d5f2ba2cd/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-20220728153807-12923" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (250.17s)