=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-darwin-amd64 start -p old-k8s-version-20220629114717-24356 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0
=== CONT TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-20220629114717-24356 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0: exit status 109 (4m10.080986678s)
-- stdout --
* [old-k8s-version-20220629114717-24356] minikube v1.26.0 on Darwin 12.4
- MINIKUBE_LOCATION=14420
- KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube
* Using the docker driver based on user configuration
* Using Docker Desktop driver with root privileges
* Starting control plane node old-k8s-version-20220629114717-24356 in cluster old-k8s-version-20220629114717-24356
* Pulling base image ...
* Creating docker container (CPUs=2, Memory=2200MB) ...
* Preparing Kubernetes v1.16.0 on Docker 20.10.17 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0629 11:47:17.644451 38502 out.go:296] Setting OutFile to fd 1 ...
I0629 11:47:17.682080 38502 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0629 11:47:17.682129 38502 out.go:309] Setting ErrFile to fd 2...
I0629 11:47:17.682142 38502 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0629 11:47:17.682850 38502 root.go:329] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/bin
I0629 11:47:17.683797 38502 out.go:303] Setting JSON to false
I0629 11:47:17.699626 38502 start.go:115] hostinfo: {"hostname":"MacOS-Agent-3.local","uptime":10005,"bootTime":1656518432,"procs":373,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"12.4","kernelVersion":"21.5.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}
W0629 11:47:17.699720 38502 start.go:123] gopshost.Virtualization returned error: not implemented yet
I0629 11:47:17.727405 38502 out.go:177] * [old-k8s-version-20220629114717-24356] minikube v1.26.0 on Darwin 12.4
I0629 11:47:17.771594 38502 notify.go:193] Checking for updates...
I0629 11:47:17.793244 38502 out.go:177] - MINIKUBE_LOCATION=14420
I0629 11:47:17.857382 38502 out.go:177] - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/kubeconfig
I0629 11:47:17.923145 38502 out.go:177] - MINIKUBE_BIN=out/minikube-darwin-amd64
I0629 11:47:17.987324 38502 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0629 11:47:18.051347 38502 out.go:177] - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube
I0629 11:47:18.094771 38502 config.go:178] Loaded profile config "kubenet-20220629112950-24356": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.24.2
I0629 11:47:18.094850 38502 driver.go:360] Setting default libvirt URI to qemu:///system
I0629 11:47:18.256730 38502 docker.go:137] docker version: linux-20.10.16
I0629 11:47:18.256916 38502 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0629 11:47:18.391205 38502 info.go:265] docker info: {ID:YEZN:IB64:KEY7:MCNF:3VYN:XJOR:INZ4:HGIE:5H6H:U4DW:UQTX:HH2D Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:57 OomKillDisable:false NGoroutines:51 SystemTime:2022-06-29 18:47:18.33996239 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.104-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6232580096 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.16 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16 Expected:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16} RuncCommit:{ID:v1.1.1-0-g52de29d Expected:v1.1.1-0-g52de29d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defaul
t name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
I0629 11:47:18.436175 38502 out.go:177] * Using the docker driver based on user configuration
I0629 11:47:18.457336 38502 start.go:284] selected driver: docker
I0629 11:47:18.457372 38502 start.go:808] validating driver "docker" against <nil>
I0629 11:47:18.457405 38502 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0629 11:47:18.460806 38502 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0629 11:47:18.583301 38502 info.go:265] docker info: {ID:YEZN:IB64:KEY7:MCNF:3VYN:XJOR:INZ4:HGIE:5H6H:U4DW:UQTX:HH2D Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:57 OomKillDisable:false NGoroutines:51 SystemTime:2022-06-29 18:47:18.534695487 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.104-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexSer
verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6232580096 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.16 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16 Expected:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16} RuncCommit:{ID:v1.1.1-0-g52de29d Expected:v1.1.1-0-g52de29d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defau
lt name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
I0629 11:47:18.583415 38502 start_flags.go:296] no existing cluster config was found, will generate one from the flags
I0629 11:47:18.583589 38502 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0629 11:47:18.605433 38502 out.go:177] * Using Docker Desktop driver with root privileges
I0629 11:47:18.626039 38502 cni.go:95] Creating CNI manager for ""
I0629 11:47:18.626072 38502 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I0629 11:47:18.626098 38502 start_flags.go:310] config:
{Name:old-k8s-version-20220629114717-24356 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220629114717-24356 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSD
omain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
I0629 11:47:18.648089 38502 out.go:177] * Starting control plane node old-k8s-version-20220629114717-24356 in cluster old-k8s-version-20220629114717-24356
I0629 11:47:18.690163 38502 cache.go:120] Beginning downloading kic base image for docker with docker
I0629 11:47:18.727289 38502 out.go:177] * Pulling base image ...
I0629 11:47:18.804419 38502 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0629 11:47:18.804438 38502 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon
I0629 11:47:18.804496 38502 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4
I0629 11:47:18.804515 38502 cache.go:57] Caching tarball of preloaded images
I0629 11:47:18.804742 38502 preload.go:174] Found /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0629 11:47:18.804766 38502 cache.go:60] Finished verifying existence of preloaded tar for v1.16.0 on docker
I0629 11:47:18.805842 38502 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/config.json ...
I0629 11:47:18.806009 38502 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/config.json: {Name:mkdb4740e1b86af358bfc56945e6563d5dfe31af Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0629 11:47:18.870786 38502 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e in local docker daemon, skipping pull
I0629 11:47:18.870815 38502 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e exists in daemon, skipping load
I0629 11:47:18.870825 38502 cache.go:208] Successfully downloaded all kic artifacts
I0629 11:47:18.870878 38502 start.go:352] acquiring machines lock for old-k8s-version-20220629114717-24356: {Name:mkeaf278b11a6771761242ef819919656a0edee3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0629 11:47:18.871033 38502 start.go:356] acquired machines lock for "old-k8s-version-20220629114717-24356" in 142.857µs
I0629 11:47:18.871063 38502 start.go:91] Provisioning new machine with config: &{Name:old-k8s-version-20220629114717-24356 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220629114717-24356
Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMi
rror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0629 11:47:18.871152 38502 start.go:131] createHost starting for "" (driver="docker")
I0629 11:47:18.913918 38502 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0629 11:47:18.914133 38502 start.go:165] libmachine.API.Create for "old-k8s-version-20220629114717-24356" (driver="docker")
I0629 11:47:18.914162 38502 client.go:168] LocalClient.Create starting
I0629 11:47:18.914254 38502 main.go:134] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/ca.pem
I0629 11:47:18.914325 38502 main.go:134] libmachine: Decoding PEM data...
I0629 11:47:18.914340 38502 main.go:134] libmachine: Parsing certificate...
I0629 11:47:18.914391 38502 main.go:134] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/cert.pem
I0629 11:47:18.914416 38502 main.go:134] libmachine: Decoding PEM data...
I0629 11:47:18.914428 38502 main.go:134] libmachine: Parsing certificate...
I0629 11:47:18.935332 38502 cli_runner.go:164] Run: docker network inspect old-k8s-version-20220629114717-24356 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0629 11:47:19.001052 38502 cli_runner.go:211] docker network inspect old-k8s-version-20220629114717-24356 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0629 11:47:19.001171 38502 network_create.go:272] running [docker network inspect old-k8s-version-20220629114717-24356] to gather additional debugging logs...
I0629 11:47:19.001226 38502 cli_runner.go:164] Run: docker network inspect old-k8s-version-20220629114717-24356
W0629 11:47:19.065659 38502 cli_runner.go:211] docker network inspect old-k8s-version-20220629114717-24356 returned with exit code 1
I0629 11:47:19.065693 38502 network_create.go:275] error running [docker network inspect old-k8s-version-20220629114717-24356]: docker network inspect old-k8s-version-20220629114717-24356: exit status 1
stdout:
[]
stderr:
Error: No such network: old-k8s-version-20220629114717-24356
I0629 11:47:19.065712 38502 network_create.go:277] output of [docker network inspect old-k8s-version-20220629114717-24356]: -- stdout --
[]
-- /stdout --
** stderr **
Error: No such network: old-k8s-version-20220629114717-24356
** /stderr **
I0629 11:47:19.065811 38502 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0629 11:47:19.129416 38502 network.go:288] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc000ac07b8] misses:0}
I0629 11:47:19.129451 38502 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0629 11:47:19.129465 38502 network_create.go:115] attempt to create docker network old-k8s-version-20220629114717-24356 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0629 11:47:19.129541 38502 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220629114717-24356 old-k8s-version-20220629114717-24356
W0629 11:47:19.192526 38502 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220629114717-24356 old-k8s-version-20220629114717-24356 returned with exit code 1
W0629 11:47:19.192577 38502 network_create.go:107] failed to create docker network old-k8s-version-20220629114717-24356 192.168.49.0/24, will retry: subnet is taken
I0629 11:47:19.192849 38502 network.go:279] skipping subnet 192.168.49.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000ac07b8] amended:false}} dirty:map[] misses:0}
I0629 11:47:19.192866 38502 network.go:238] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0629 11:47:19.193062 38502 network.go:288] reserving subnet 192.168.58.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000ac07b8] amended:true}} dirty:map[192.168.49.0:0xc000ac07b8 192.168.58.0:0xc000ac0820] misses:0}
I0629 11:47:19.193076 38502 network.go:235] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0629 11:47:19.193086 38502 network_create.go:115] attempt to create docker network old-k8s-version-20220629114717-24356 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ...
I0629 11:47:19.193141 38502 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220629114717-24356 old-k8s-version-20220629114717-24356
W0629 11:47:19.255484 38502 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220629114717-24356 old-k8s-version-20220629114717-24356 returned with exit code 1
W0629 11:47:19.255533 38502 network_create.go:107] failed to create docker network old-k8s-version-20220629114717-24356 192.168.58.0/24, will retry: subnet is taken
I0629 11:47:19.255800 38502 network.go:279] skipping subnet 192.168.58.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000ac07b8] amended:true}} dirty:map[192.168.49.0:0xc000ac07b8 192.168.58.0:0xc000ac0820] misses:1}
I0629 11:47:19.255817 38502 network.go:238] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0629 11:47:19.256020 38502 network.go:288] reserving subnet 192.168.67.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000ac07b8] amended:true}} dirty:map[192.168.49.0:0xc000ac07b8 192.168.58.0:0xc000ac0820 192.168.67.0:0xc00000e548] misses:1}
I0629 11:47:19.256038 38502 network.go:235] using free private subnet 192.168.67.0/24: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0629 11:47:19.256046 38502 network_create.go:115] attempt to create docker network old-k8s-version-20220629114717-24356 192.168.67.0/24 with gateway 192.168.67.1 and MTU of 1500 ...
I0629 11:47:19.256105 38502 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220629114717-24356 old-k8s-version-20220629114717-24356
W0629 11:47:19.319422 38502 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220629114717-24356 old-k8s-version-20220629114717-24356 returned with exit code 1
W0629 11:47:19.319485 38502 network_create.go:107] failed to create docker network old-k8s-version-20220629114717-24356 192.168.67.0/24, will retry: subnet is taken
I0629 11:47:19.319772 38502 network.go:279] skipping subnet 192.168.67.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000ac07b8] amended:true}} dirty:map[192.168.49.0:0xc000ac07b8 192.168.58.0:0xc000ac0820 192.168.67.0:0xc00000e548] misses:2}
I0629 11:47:19.319789 38502 network.go:238] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0629 11:47:19.319991 38502 network.go:288] reserving subnet 192.168.76.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000ac07b8] amended:true}} dirty:map[192.168.49.0:0xc000ac07b8 192.168.58.0:0xc000ac0820 192.168.67.0:0xc00000e548 192.168.76.0:0xc00000e580] misses:2}
I0629 11:47:19.320002 38502 network.go:235] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0629 11:47:19.320009 38502 network_create.go:115] attempt to create docker network old-k8s-version-20220629114717-24356 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I0629 11:47:19.320066 38502 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220629114717-24356 old-k8s-version-20220629114717-24356
I0629 11:47:19.413673 38502 network_create.go:99] docker network old-k8s-version-20220629114717-24356 192.168.76.0/24 created
I0629 11:47:19.413712 38502 kic.go:106] calculated static IP "192.168.76.2" for the "old-k8s-version-20220629114717-24356" container
I0629 11:47:19.413814 38502 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0629 11:47:19.481161 38502 cli_runner.go:164] Run: docker volume create old-k8s-version-20220629114717-24356 --label name.minikube.sigs.k8s.io=old-k8s-version-20220629114717-24356 --label created_by.minikube.sigs.k8s.io=true
I0629 11:47:19.545128 38502 oci.go:103] Successfully created a docker volume old-k8s-version-20220629114717-24356
I0629 11:47:19.545237 38502 cli_runner.go:164] Run: docker run --rm --name old-k8s-version-20220629114717-24356-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-20220629114717-24356 --entrypoint /usr/bin/test -v old-k8s-version-20220629114717-24356:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -d /var/lib
I0629 11:47:20.008108 38502 oci.go:107] Successfully prepared a docker volume old-k8s-version-20220629114717-24356
I0629 11:47:20.008151 38502 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0629 11:47:20.008164 38502 kic.go:179] Starting extracting preloaded images to volume ...
I0629 11:47:20.008265 38502 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-20220629114717-24356:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -I lz4 -xf /preloaded.tar -C /extractDir
I0629 11:47:24.446906 38502 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-20220629114717-24356:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e -I lz4 -xf /preloaded.tar -C /extractDir: (4.438424116s)
I0629 11:47:24.446928 38502 kic.go:188] duration metric: took 4.438628 seconds to extract preloaded images to volume
I0629 11:47:24.447043 38502 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0629 11:47:24.595228 38502 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname old-k8s-version-20220629114717-24356 --name old-k8s-version-20220629114717-24356 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-20220629114717-24356 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=old-k8s-version-20220629114717-24356 --network old-k8s-version-20220629114717-24356 --ip 192.168.76.2 --volume old-k8s-version-20220629114717-24356:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=8443 --publish=22 --publish=2376 --publish=5000 --publish=32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e
I0629 11:47:25.026322 38502 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220629114717-24356 --format={{.State.Running}}
I0629 11:47:25.110900 38502 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220629114717-24356 --format={{.State.Status}}
I0629 11:47:25.201202 38502 cli_runner.go:164] Run: docker exec old-k8s-version-20220629114717-24356 stat /var/lib/dpkg/alternatives/iptables
I0629 11:47:25.341564 38502 oci.go:144] the created container "old-k8s-version-20220629114717-24356" has a running status.
I0629 11:47:25.341590 38502 kic.go:210] Creating ssh key for kic: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/machines/old-k8s-version-20220629114717-24356/id_rsa...
I0629 11:47:25.547452 38502 kic_runner.go:191] docker (temp): /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/machines/old-k8s-version-20220629114717-24356/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0629 11:47:25.675053 38502 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220629114717-24356 --format={{.State.Status}}
I0629 11:47:25.751542 38502 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0629 11:47:25.751560 38502 kic_runner.go:114] Args: [docker exec --privileged old-k8s-version-20220629114717-24356 chown docker:docker /home/docker/.ssh/authorized_keys]
I0629 11:47:25.879955 38502 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220629114717-24356 --format={{.State.Status}}
I0629 11:47:25.953786 38502 machine.go:88] provisioning docker machine ...
I0629 11:47:25.953846 38502 ubuntu.go:169] provisioning hostname "old-k8s-version-20220629114717-24356"
I0629 11:47:25.953948 38502 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220629114717-24356
I0629 11:47:26.037283 38502 main.go:134] libmachine: Using SSH client type: native
I0629 11:47:26.037492 38502 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2d60] 0x13d5dc0 <nil> [] 0s} 127.0.0.1 59835 <nil> <nil>}
I0629 11:47:26.037507 38502 main.go:134] libmachine: About to run SSH command:
sudo hostname old-k8s-version-20220629114717-24356 && echo "old-k8s-version-20220629114717-24356" | sudo tee /etc/hostname
I0629 11:47:26.168074 38502 main.go:134] libmachine: SSH cmd err, output: <nil>: old-k8s-version-20220629114717-24356
I0629 11:47:26.168145 38502 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220629114717-24356
I0629 11:47:26.239757 38502 main.go:134] libmachine: Using SSH client type: native
I0629 11:47:26.239908 38502 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2d60] 0x13d5dc0 <nil> [] 0s} 127.0.0.1 59835 <nil> <nil>}
I0629 11:47:26.239931 38502 main.go:134] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-20220629114717-24356' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-20220629114717-24356/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-20220629114717-24356' | sudo tee -a /etc/hosts;
fi
fi
I0629 11:47:26.358681 38502 main.go:134] libmachine: SSH cmd err, output: <nil>:
I0629 11:47:26.358700 38502 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube CaCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/key.pem ServerCertRemotePath:/etc/doc
ker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube}
I0629 11:47:26.358722 38502 ubuntu.go:177] setting up certificates
I0629 11:47:26.358731 38502 provision.go:83] configureAuth start
I0629 11:47:26.358800 38502 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220629114717-24356
I0629 11:47:26.430202 38502 provision.go:138] copyHostCerts
I0629 11:47:26.430288 38502 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/ca.pem, removing ...
I0629 11:47:26.430301 38502 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/ca.pem
I0629 11:47:26.430393 38502 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/ca.pem (1082 bytes)
I0629 11:47:26.430580 38502 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/cert.pem, removing ...
I0629 11:47:26.430588 38502 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/cert.pem
I0629 11:47:26.430645 38502 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/cert.pem (1123 bytes)
I0629 11:47:26.430783 38502 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/key.pem, removing ...
I0629 11:47:26.430790 38502 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/key.pem
I0629 11:47:26.430845 38502 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/key.pem (1675 bytes)
I0629 11:47:26.430955 38502 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-20220629114717-24356 san=[192.168.76.2 127.0.0.1 localhost 127.0.0.1 minikube old-k8s-version-20220629114717-24356]
I0629 11:47:26.493180 38502 provision.go:172] copyRemoteCerts
I0629 11:47:26.493230 38502 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0629 11:47:26.493275 38502 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220629114717-24356
I0629 11:47:26.564289 38502 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59835 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/machines/old-k8s-version-20220629114717-24356/id_rsa Username:docker}
I0629 11:47:26.650291 38502 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0629 11:47:26.668572 38502 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/machines/server.pem --> /etc/docker/server.pem (1277 bytes)
I0629 11:47:26.686307 38502 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0629 11:47:26.704202 38502 provision.go:86] duration metric: configureAuth took 345.449655ms
I0629 11:47:26.704218 38502 ubuntu.go:193] setting minikube options for container-runtime
I0629 11:47:26.704364 38502 config.go:178] Loaded profile config "old-k8s-version-20220629114717-24356": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
I0629 11:47:26.704422 38502 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220629114717-24356
I0629 11:47:26.776215 38502 main.go:134] libmachine: Using SSH client type: native
I0629 11:47:26.776382 38502 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2d60] 0x13d5dc0 <nil> [] 0s} 127.0.0.1 59835 <nil> <nil>}
I0629 11:47:26.776398 38502 main.go:134] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0629 11:47:26.893563 38502 main.go:134] libmachine: SSH cmd err, output: <nil>: overlay
I0629 11:47:26.893575 38502 ubuntu.go:71] root file system type: overlay
I0629 11:47:26.893709 38502 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0629 11:47:26.893780 38502 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220629114717-24356
I0629 11:47:26.968227 38502 main.go:134] libmachine: Using SSH client type: native
I0629 11:47:26.968375 38502 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2d60] 0x13d5dc0 <nil> [] 0s} 127.0.0.1 59835 <nil> <nil>}
I0629 11:47:26.968433 38502 main.go:134] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0629 11:47:27.096481 38502 main.go:134] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0629 11:47:27.096558 38502 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220629114717-24356
I0629 11:47:27.168876 38502 main.go:134] libmachine: Using SSH client type: native
I0629 11:47:27.169051 38502 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2d60] 0x13d5dc0 <nil> [] 0s} 127.0.0.1 59835 <nil> <nil>}
I0629 11:47:27.169065 38502 main.go:134] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0629 11:47:27.772083 38502 main.go:134] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2022-06-06 23:01:03.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2022-06-29 18:47:27.094284897 +0000
@@ -1,30 +1,32 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
Wants=network-online.target
-Requires=docker.socket containerd.service
+Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutSec=0
-RestartSec=2
-Restart=always
-
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
+Restart=on-failure
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
@@ -32,16 +34,16 @@
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0629 11:47:27.772109 38502 machine.go:91] provisioned docker machine in 1.818250241s
I0629 11:47:27.772117 38502 client.go:171] LocalClient.Create took 8.857685319s
I0629 11:47:27.772132 38502 start.go:173] duration metric: libmachine.API.Create for "old-k8s-version-20220629114717-24356" took 8.857733409s
I0629 11:47:27.772140 38502 start.go:306] post-start starting for "old-k8s-version-20220629114717-24356" (driver="docker")
I0629 11:47:27.772143 38502 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0629 11:47:27.772217 38502 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0629 11:47:27.772264 38502 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220629114717-24356
I0629 11:47:27.843800 38502 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59835 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/machines/old-k8s-version-20220629114717-24356/id_rsa Username:docker}
I0629 11:47:27.929805 38502 ssh_runner.go:195] Run: cat /etc/os-release
I0629 11:47:27.933519 38502 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0629 11:47:27.933537 38502 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0629 11:47:27.933545 38502 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0629 11:47:27.933550 38502 info.go:137] Remote host: Ubuntu 20.04.4 LTS
I0629 11:47:27.933562 38502 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/addons for local assets ...
I0629 11:47:27.933679 38502 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/files for local assets ...
I0629 11:47:27.933823 38502 filesync.go:149] local asset: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/files/etc/ssl/certs/243562.pem -> 243562.pem in /etc/ssl/certs
I0629 11:47:27.933994 38502 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0629 11:47:27.940914 38502 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/files/etc/ssl/certs/243562.pem --> /etc/ssl/certs/243562.pem (1708 bytes)
I0629 11:47:27.957560 38502 start.go:309] post-start completed in 185.406959ms
I0629 11:47:27.958055 38502 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220629114717-24356
I0629 11:47:28.030418 38502 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/config.json ...
I0629 11:47:28.030830 38502 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0629 11:47:28.030877 38502 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220629114717-24356
I0629 11:47:28.103874 38502 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59835 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/machines/old-k8s-version-20220629114717-24356/id_rsa Username:docker}
I0629 11:47:28.186621 38502 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0629 11:47:28.191700 38502 start.go:134] duration metric: createHost completed in 9.320258172s
I0629 11:47:28.191719 38502 start.go:81] releasing machines lock for "old-k8s-version-20220629114717-24356", held for 9.320397909s
I0629 11:47:28.191805 38502 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220629114717-24356
I0629 11:47:28.263210 38502 ssh_runner.go:195] Run: systemctl --version
I0629 11:47:28.263212 38502 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
I0629 11:47:28.263276 38502 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220629114717-24356
I0629 11:47:28.263283 38502 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220629114717-24356
I0629 11:47:28.341598 38502 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59835 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/machines/old-k8s-version-20220629114717-24356/id_rsa Username:docker}
I0629 11:47:28.343395 38502 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59835 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/machines/old-k8s-version-20220629114717-24356/id_rsa Username:docker}
I0629 11:47:28.911318 38502 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0629 11:47:28.921140 38502 cruntime.go:273] skipping containerd shutdown because we are bound to it
I0629 11:47:28.921198 38502 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0629 11:47:28.930271 38502 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
image-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0629 11:47:28.943291 38502 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0629 11:47:29.012150 38502 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0629 11:47:29.078682 38502 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0629 11:47:29.143209 38502 ssh_runner.go:195] Run: sudo systemctl restart docker
I0629 11:47:29.332491 38502 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0629 11:47:29.367292 38502 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0629 11:47:29.448861 38502 out.go:204] * Preparing Kubernetes v1.16.0 on Docker 20.10.17 ...
I0629 11:47:29.448993 38502 cli_runner.go:164] Run: docker exec -t old-k8s-version-20220629114717-24356 dig +short host.docker.internal
I0629 11:47:29.576308 38502 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2
I0629 11:47:29.576459 38502 ssh_runner.go:195] Run: grep 192.168.65.2 host.minikube.internal$ /etc/hosts
I0629 11:47:29.580807 38502 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0629 11:47:29.590423 38502 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-20220629114717-24356
I0629 11:47:29.661360 38502 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0629 11:47:29.661476 38502 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0629 11:47:29.691319 38502 docker.go:602] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0629 11:47:29.691335 38502 docker.go:533] Images already preloaded, skipping extraction
I0629 11:47:29.691399 38502 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0629 11:47:29.721198 38502 docker.go:602] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0629 11:47:29.721213 38502 cache_images.go:84] Images are preloaded, skipping loading
I0629 11:47:29.721289 38502 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0629 11:47:29.795688 38502 cni.go:95] Creating CNI manager for ""
I0629 11:47:29.795699 38502 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I0629 11:47:29.795711 38502 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0629 11:47:29.795723 38502 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-20220629114717-24356 NodeName:old-k8s-version-20220629114717-24356 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.76.2 CgroupDriver:systemd Clien
tCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
I0629 11:47:29.795849 38502 kubeadm.go:162] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-20220629114717-24356"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-20220629114717-24356
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.76.2:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0629 11:47:29.795957 38502 kubeadm.go:961] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-20220629114717-24356 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220629114717-24356 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0629 11:47:29.796023 38502 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0629 11:47:29.804023 38502 binaries.go:44] Found k8s binaries, skipping transfer
I0629 11:47:29.804078 38502 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0629 11:47:29.811181 38502 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (362 bytes)
I0629 11:47:29.824113 38502 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0629 11:47:29.837376 38502 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2148 bytes)
I0629 11:47:29.851461 38502 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0629 11:47:29.855421 38502 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0629 11:47:29.865239 38502 certs.go:54] Setting up /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356 for IP: 192.168.76.2
I0629 11:47:29.865351 38502 certs.go:182] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/ca.key
I0629 11:47:29.865407 38502 certs.go:182] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/proxy-client-ca.key
I0629 11:47:29.865450 38502 certs.go:302] generating minikube-user signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/client.key
I0629 11:47:29.865463 38502 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/client.crt with IP's: []
I0629 11:47:30.080789 38502 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/client.crt ...
I0629 11:47:30.080805 38502 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/client.crt: {Name:mk06d1b6fb5a6c2a0090db931089315503ccf9f2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0629 11:47:30.081129 38502 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/client.key ...
I0629 11:47:30.081137 38502 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/client.key: {Name:mkdcda8673cee87eb276fe3bc7c5eb204ed6a41a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0629 11:47:30.081339 38502 certs.go:302] generating minikube signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/apiserver.key.31bdca25
I0629 11:47:30.081355 38502 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/apiserver.crt.31bdca25 with IP's: [192.168.76.2 10.96.0.1 127.0.0.1 10.0.0.1]
I0629 11:47:30.223931 38502 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/apiserver.crt.31bdca25 ...
I0629 11:47:30.223950 38502 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/apiserver.crt.31bdca25: {Name:mkdccf56d431fb5727dd8a19b2e6e287bd1fca79 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0629 11:47:30.224241 38502 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/apiserver.key.31bdca25 ...
I0629 11:47:30.224250 38502 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/apiserver.key.31bdca25: {Name:mk6babcde6e507128042b395fcd53c1318bcb7f7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0629 11:47:30.224440 38502 certs.go:320] copying /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/apiserver.crt.31bdca25 -> /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/apiserver.crt
I0629 11:47:30.224597 38502 certs.go:324] copying /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/apiserver.key.31bdca25 -> /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/apiserver.key
I0629 11:47:30.224743 38502 certs.go:302] generating aggregator signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/proxy-client.key
I0629 11:47:30.224757 38502 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/proxy-client.crt with IP's: []
I0629 11:47:30.341340 38502 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/proxy-client.crt ...
I0629 11:47:30.341351 38502 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/proxy-client.crt: {Name:mk0d3bf27d37a4ba638a5ee42bde9350dcf1986f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0629 11:47:30.341564 38502 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/proxy-client.key ...
I0629 11:47:30.341575 38502 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/proxy-client.key: {Name:mk4fd1ca42d409c187906d6faefb61818bb44a7d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0629 11:47:30.341952 38502 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/24356.pem (1338 bytes)
W0629 11:47:30.341990 38502 certs.go:384] ignoring /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/24356_empty.pem, impossibly tiny 0 bytes
I0629 11:47:30.341999 38502 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/ca-key.pem (1679 bytes)
I0629 11:47:30.342030 38502 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/ca.pem (1082 bytes)
I0629 11:47:30.342059 38502 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/cert.pem (1123 bytes)
I0629 11:47:30.342091 38502 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/key.pem (1675 bytes)
I0629 11:47:30.342152 38502 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/files/etc/ssl/certs/243562.pem (1708 bytes)
I0629 11:47:30.342647 38502 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0629 11:47:30.360856 38502 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0629 11:47:30.379208 38502 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0629 11:47:30.396324 38502 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/profiles/old-k8s-version-20220629114717-24356/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0629 11:47:30.413111 38502 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0629 11:47:30.430032 38502 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0629 11:47:30.446648 38502 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0629 11:47:30.463279 38502 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0629 11:47:30.483220 38502 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/files/etc/ssl/certs/243562.pem --> /usr/share/ca-certificates/243562.pem (1708 bytes)
I0629 11:47:30.500570 38502 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0629 11:47:30.517177 38502 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/.minikube/certs/24356.pem --> /usr/share/ca-certificates/24356.pem (1338 bytes)
I0629 11:47:30.533842 38502 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0629 11:47:30.546311 38502 ssh_runner.go:195] Run: openssl version
I0629 11:47:30.551594 38502 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/243562.pem && ln -fs /usr/share/ca-certificates/243562.pem /etc/ssl/certs/243562.pem"
I0629 11:47:30.559230 38502 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/243562.pem
I0629 11:47:30.563007 38502 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Jun 29 17:58 /usr/share/ca-certificates/243562.pem
I0629 11:47:30.563049 38502 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/243562.pem
I0629 11:47:30.568124 38502 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/243562.pem /etc/ssl/certs/3ec20f2e.0"
I0629 11:47:30.575991 38502 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0629 11:47:30.583548 38502 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0629 11:47:30.587451 38502 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Jun 29 17:54 /usr/share/ca-certificates/minikubeCA.pem
I0629 11:47:30.587497 38502 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0629 11:47:30.592772 38502 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0629 11:47:30.600927 38502 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/24356.pem && ln -fs /usr/share/ca-certificates/24356.pem /etc/ssl/certs/24356.pem"
I0629 11:47:30.608346 38502 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/24356.pem
I0629 11:47:30.612207 38502 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Jun 29 17:58 /usr/share/ca-certificates/24356.pem
I0629 11:47:30.612246 38502 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/24356.pem
I0629 11:47:30.617431 38502 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/24356.pem /etc/ssl/certs/51391683.0"
I0629 11:47:30.627202 38502 kubeadm.go:395] StartCluster: {Name:old-k8s-version-20220629114717-24356 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220629114717-24356 Namespace:default API
ServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disa
bleOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
I0629 11:47:30.627303 38502 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0629 11:47:30.655826 38502 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0629 11:47:30.663670 38502 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0629 11:47:30.671007 38502 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I0629 11:47:30.671059 38502 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0629 11:47:30.678333 38502 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0629 11:47:30.678365 38502 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0629 11:47:31.426784 38502 out.go:204] - Generating certificates and keys ...
I0629 11:47:33.374598 38502 out.go:204] - Booting up control plane ...
W0629 11:49:28.315689 38502 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-20220629114717-24356 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-20220629114717-24356 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-20220629114717-24356 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-20220629114717-24356 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0629 11:49:28.315724 38502 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"
I0629 11:49:28.737777 38502 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0629 11:49:28.747473 38502 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I0629 11:49:28.747520 38502 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0629 11:49:28.755381 38502 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0629 11:49:28.755404 38502 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0629 11:49:29.491757 38502 out.go:204] - Generating certificates and keys ...
I0629 11:49:30.143676 38502 out.go:204] - Booting up control plane ...
I0629 11:51:25.061000 38502 kubeadm.go:397] StartCluster complete in 3m54.426771912s
I0629 11:51:25.061082 38502 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0629 11:51:25.091524 38502 logs.go:274] 0 containers: []
W0629 11:51:25.091536 38502 logs.go:276] No container was found matching "kube-apiserver"
I0629 11:51:25.091604 38502 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0629 11:51:25.120619 38502 logs.go:274] 0 containers: []
W0629 11:51:25.120630 38502 logs.go:276] No container was found matching "etcd"
I0629 11:51:25.120685 38502 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0629 11:51:25.149716 38502 logs.go:274] 0 containers: []
W0629 11:51:25.149728 38502 logs.go:276] No container was found matching "coredns"
I0629 11:51:25.149784 38502 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0629 11:51:25.178932 38502 logs.go:274] 0 containers: []
W0629 11:51:25.178943 38502 logs.go:276] No container was found matching "kube-scheduler"
I0629 11:51:25.179001 38502 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0629 11:51:25.211386 38502 logs.go:274] 0 containers: []
W0629 11:51:25.211397 38502 logs.go:276] No container was found matching "kube-proxy"
I0629 11:51:25.211453 38502 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0629 11:51:25.240364 38502 logs.go:274] 0 containers: []
W0629 11:51:25.240376 38502 logs.go:276] No container was found matching "kubernetes-dashboard"
I0629 11:51:25.240434 38502 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0629 11:51:25.271627 38502 logs.go:274] 0 containers: []
W0629 11:51:25.271638 38502 logs.go:276] No container was found matching "storage-provisioner"
I0629 11:51:25.271696 38502 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0629 11:51:25.301050 38502 logs.go:274] 0 containers: []
W0629 11:51:25.301063 38502 logs.go:276] No container was found matching "kube-controller-manager"
I0629 11:51:25.301069 38502 logs.go:123] Gathering logs for kubelet ...
I0629 11:51:25.301078 38502 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0629 11:51:25.341847 38502 logs.go:123] Gathering logs for dmesg ...
I0629 11:51:25.341866 38502 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0629 11:51:25.353980 38502 logs.go:123] Gathering logs for describe nodes ...
I0629 11:51:25.353996 38502 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0629 11:51:25.407485 38502 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0629 11:51:25.407496 38502 logs.go:123] Gathering logs for Docker ...
I0629 11:51:25.407503 38502 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400"
I0629 11:51:25.423225 38502 logs.go:123] Gathering logs for container status ...
I0629 11:51:25.423238 38502 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0629 11:51:27.480116 38502 ssh_runner.go:235] Completed: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": (2.056803755s)
W0629 11:51:27.480242 38502 out.go:369] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0629 11:51:27.480257 38502 out.go:239] *
*
W0629 11:51:27.480430 38502 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0629 11:51:27.480445 38502 out.go:239] *
*
W0629 11:51:27.480986 38502 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0629 11:51:27.511210 38502 out.go:177]
W0629 11:51:27.553790 38502 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0629 11:51:27.553952 38502 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0629 11:51:27.554027 38502 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0629 11:51:27.619179 38502 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p old-k8s-version-20220629114717-24356 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-20220629114717-24356
helpers_test.go:235: (dbg) docker inspect old-k8s-version-20220629114717-24356:
-- stdout --
[
{
"Id": "b1f5e01895cc1103306679d3533ef11cedc6b295be9176de1584494d8e6541b2",
"Created": "2022-06-29T18:47:24.686705454Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 227955,
"ExitCode": 0,
"Error": "",
"StartedAt": "2022-06-29T18:47:25.036356976Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:573e7be5768273a7845baee1ae90fa2e33b83b10a7fbb0f0f41efbf29b53d1f1",
"ResolvConfPath": "/var/lib/docker/containers/b1f5e01895cc1103306679d3533ef11cedc6b295be9176de1584494d8e6541b2/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/b1f5e01895cc1103306679d3533ef11cedc6b295be9176de1584494d8e6541b2/hostname",
"HostsPath": "/var/lib/docker/containers/b1f5e01895cc1103306679d3533ef11cedc6b295be9176de1584494d8e6541b2/hosts",
"LogPath": "/var/lib/docker/containers/b1f5e01895cc1103306679d3533ef11cedc6b295be9176de1584494d8e6541b2/b1f5e01895cc1103306679d3533ef11cedc6b295be9176de1584494d8e6541b2-json.log",
"Name": "/old-k8s-version-20220629114717-24356",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-20220629114717-24356:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-20220629114717-24356",
"PortBindings": {
"22/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"2376/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"32443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"5000/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"8443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"ConsoleSize": [
0,
0
],
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": null,
"BlkioDeviceWriteBps": null,
"BlkioDeviceReadIOps": null,
"BlkioDeviceWriteIOps": null,
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"KernelMemory": 0,
"KernelMemoryTCP": 0,
"MemoryReservation": 0,
"MemorySwap": 2306867200,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": null,
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/b8bbb3a836ae906780806bd799b3e65882c687028377353ae9c79c7c4e6a3132-init/diff:/var/lib/docker/overlay2/fffebe0fdfada5807aeb835ff23043496ab70477725ee4f168b630301ac03e45/diff:/var/lib/docker/overlay2/d4eb6d2f34aa8e5c143d900dccdec5da9e3d130567442e6745d4efac5202fe49/diff:/var/lib/docker/overlay2/eb35fadba12ed9c48500d69b77e98e7dd72e90d3de5197d58b370df5b5dca4c7/diff:/var/lib/docker/overlay2/7b63894f671ef1edaa7c3b80a2acbde52dcdb21970e320799b6884e79553ea3e/diff:/var/lib/docker/overlay2/3740b6bc6ff226137eb09a6350d4395dc04bd9012c6c66125dc2ea6b663082cd/diff:/var/lib/docker/overlay2/a2fda66ed4937725e85838baed61cac418abe2ba55b4e664bf944246efcdd371/diff:/var/lib/docker/overlay2/574408913c5c73ee699b85768bbb4c0ce70e697bf6eb623e32017c62e8413acd/diff:/var/lib/docker/overlay2/1cde03c3877bfb18ad0533f814863e3030abec268ff30faceab8815ea7e2daf2/diff:/var/lib/docker/overlay2/52bf889e64b2ea0160f303622d5febb9c52b864e5a6dc2bfa5db90933ccaaa29/diff:/var/lib/docker/overlay2/b131e6
ae4a7a7f5705d087e4001676276e4daa26d6acfc99799bb4992e322410/diff:/var/lib/docker/overlay2/3f5c774f6f46936a974bfc6530b012fda75a59b22450e3342486fe400ab4b531/diff:/var/lib/docker/overlay2/8462528084f0c44a79e421427e0e4bc9ddd7642428c47ff1899d41b265223245/diff:/var/lib/docker/overlay2/cb9765866d13ba37669ec242ea0a1af87c92c7291c716e52037a2ccadc64ac82/diff:/var/lib/docker/overlay2/f0d06e6fa53f3ca9622f1efcfac6fe3fd18d2e5b9e07be3d624b0b9987073e55/diff:/var/lib/docker/overlay2/4ebd12d8b25cff2d3d8a989c047b696088121f0964cc7f94c6d0178ef16e3e1f/diff:/var/lib/docker/overlay2/40e16f5720fd3a8c1c8792aea0ec143af819f19cad845dde40b57ed7e372ab73/diff:/var/lib/docker/overlay2/3ce5ee64ba683c997a13b7ffa65978b4c9652772729737facd794209d49251c3/diff:/var/lib/docker/overlay2/c55c549a78d490ea576942661ba65103ea2992693548217973bb8fa1a5948b74/diff:/var/lib/docker/overlay2/4651b16dbc2e22b8a43dc1154546514f2076168d12f9c108f85fe7c6e60325f0/diff:/var/lib/docker/overlay2/9576343ea03501b15b520a83ffdc675c6d9ecd501f6ffcf6564dd75aa4f2812a/diff:/var/lib/d
ocker/overlay2/635ba7d01f96fd1ec1acabf157f4e5c00cbf80adf65b7f8873e444745fef2c9b/diff:/var/lib/docker/overlay2/6bbe0ce6ca00a7eb5bd7c22def5fcab4ebecab4a0b4cbc5ed236429671a41b6c/diff:/var/lib/docker/overlay2/b335551ba0fcfd6bff6ef5627289041f3083dc338e67b4f4728d4937bb6fb33a/diff:/var/lib/docker/overlay2/58cd90f6ad9016f3c4befb63eac504c9d2f0fc66251c5c9e3348080785d3cec4/diff:/var/lib/docker/overlay2/b7d943a8463e032d405d531846436b89574f10efeea6e4f2df92e3bb0e169d8e/diff:/var/lib/docker/overlay2/e633899f71c18e322af1b75837392bc89fd4275534b5bc70037965b0b80a770d/diff:/var/lib/docker/overlay2/651aabda39b5851bd186e23bc84f1029d819ed8eb032b13ac12f50f3d1486bfb/diff:/var/lib/docker/overlay2/3b137e27694d242a419b3fd2f8605837edfe77dae9462c63c3d7b41538e82591/diff:/var/lib/docker/overlay2/e9d4369b871c47acb146b73f8cbe14b89b0f74027df9117a7dc73f5dee8fee1c/diff:/var/lib/docker/overlay2/9379269362a969b07cc7d7f9faff9fa3b745529df38758733014a5dbe2470775/diff:/var/lib/docker/overlay2/9231c154723fa536d9894f703ec0388448e8611d5a01d54bca3a5b0a0b1
7ffd2/diff:/var/lib/docker/overlay2/9610e37ded5c6da7bd2c8edc56c3ae864637bb354f8ea3d6d1ccee6bd5c2aa7f/diff:/var/lib/docker/overlay2/025ecca5e756b1b8177204df7b2f2567a76dda456b2f1a8e312efd63150a8943/diff:/var/lib/docker/overlay2/7e69089e438e096c36ea0a4a37280fd036841e3287e57635e3407eb58fc0b6da/diff:/var/lib/docker/overlay2/c6d9ef67ed33e64c8ac8c4cdc7c33eb68f5266987969676165cabc2cf2fd346b/diff:/var/lib/docker/overlay2/394627c68237f7993b91eb0c377001630bb2e709dd58f65d899d44a3586dae91/diff:/var/lib/docker/overlay2/0c0c3c94789fc85cd70d9ee2b56d67ce6471d4dced47f21f15152d4edb6bc3e5/diff:/var/lib/docker/overlay2/849809e48c9bcbfe092aa063fcd274f284eeacde89acbb602b439d4cf0aef9b6/diff:/var/lib/docker/overlay2/49c27f0a55f204b161aa2da33ba8004f46cb93bf673975ad1b6286ce659db632/diff:/var/lib/docker/overlay2/a712a8f5cdb2f3840c706296240407405826d2936df034393c1ddf3cf2480b5f/diff:/var/lib/docker/overlay2/47949bfd134ff7a50def5e9b3af3424faf216354d1f157552f3c63c67c2728ad/diff",
"MergedDir": "/var/lib/docker/overlay2/b8bbb3a836ae906780806bd799b3e65882c687028377353ae9c79c7c4e6a3132/merged",
"UpperDir": "/var/lib/docker/overlay2/b8bbb3a836ae906780806bd799b3e65882c687028377353ae9c79c7c4e6a3132/diff",
"WorkDir": "/var/lib/docker/overlay2/b8bbb3a836ae906780806bd799b3e65882c687028377353ae9c79c7c4e6a3132/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-20220629114717-24356",
"Source": "/var/lib/docker/volumes/old-k8s-version-20220629114717-24356/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-20220629114717-24356",
"Domainname": "",
"User": "root",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e",
"Volumes": null,
"WorkingDir": "",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-20220629114717-24356",
"name.minikube.sigs.k8s.io": "old-k8s-version-20220629114717-24356",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "0ad81cc98b0ebf2b160d8945fca2e2856e503fffc2084c3be728057b77e40b5b",
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"Ports": {
"22/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "59835"
}
],
"2376/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "59836"
}
],
"32443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "59837"
}
],
"5000/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "59838"
}
],
"8443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "59839"
}
]
},
"SandboxKey": "/var/run/docker/netns/0ad81cc98b0e",
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-20220629114717-24356": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": [
"b1f5e01895cc",
"old-k8s-version-20220629114717-24356"
],
"NetworkID": "7e2ec4ec0dd8da4d477d55acc03296107258203e7a7a266adf169e3b0ee9c64c",
"EndpointID": "7041bb4c7eadd754f0ae15426e0376c2005b1379e2507d9f07e2b7d8eb3cb6d3",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"MacAddress": "02:42:c0:a8:4c:02",
"DriverOpts": null
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-20220629114717-24356 -n old-k8s-version-20220629114717-24356
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-20220629114717-24356 -n old-k8s-version-20220629114717-24356: exit status 6 (447.772798ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0629 11:51:28.222885 39168 status.go:413] kubeconfig endpoint: extract IP: "old-k8s-version-20220629114717-24356" does not appear in /Users/jenkins/minikube-integration/darwin-amd64-docker--14420-23160-7d3b93abdd89ce8ebba3c81494e660414100c7c4/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-20220629114717-24356" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (250.63s)