=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-darwin-amd64 start -p old-k8s-version-20220906154143-22187 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0
=== CONT TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-20220906154143-22187 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0: exit status 109 (4m10.742793916s)
-- stdout --
* [old-k8s-version-20220906154143-22187] minikube v1.26.1 on Darwin 12.5.1
- MINIKUBE_LOCATION=14848
- KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube
* Using the docker driver based on user configuration
* Using Docker Desktop driver with root privileges
* Starting control plane node old-k8s-version-20220906154143-22187 in cluster old-k8s-version-20220906154143-22187
* Pulling base image ...
* Creating docker container (CPUs=2, Memory=2200MB) ...
* Preparing Kubernetes v1.16.0 on Docker 20.10.17 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0906 15:41:43.729188 35815 out.go:296] Setting OutFile to fd 1 ...
I0906 15:41:43.729415 35815 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0906 15:41:43.729421 35815 out.go:309] Setting ErrFile to fd 2...
I0906 15:41:43.729425 35815 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0906 15:41:43.729531 35815 root.go:333] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/bin
I0906 15:41:43.730080 35815 out.go:303] Setting JSON to false
I0906 15:41:43.745188 35815 start.go:115] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":9674,"bootTime":1662494429,"procs":331,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"12.5.1","kernelVersion":"21.6.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
W0906 15:41:43.745297 35815 start.go:123] gopshost.Virtualization returned error: not implemented yet
I0906 15:41:43.766462 35815 out.go:177] * [old-k8s-version-20220906154143-22187] minikube v1.26.1 on Darwin 12.5.1
I0906 15:41:43.809875 35815 notify.go:193] Checking for updates...
I0906 15:41:43.831352 35815 out.go:177] - MINIKUBE_LOCATION=14848
I0906 15:41:43.852467 35815 out.go:177] - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/kubeconfig
I0906 15:41:43.873728 35815 out.go:177] - MINIKUBE_BIN=out/minikube-darwin-amd64
I0906 15:41:43.895379 35815 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0906 15:41:43.916735 35815 out.go:177] - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube
I0906 15:41:43.939420 35815 config.go:180] Loaded profile config "kubenet-20220906152522-22187": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.25.0
I0906 15:41:43.939521 35815 driver.go:365] Setting default libvirt URI to qemu:///system
I0906 15:41:44.008769 35815 docker.go:137] docker version: linux-20.10.17
I0906 15:41:44.008881 35815 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0906 15:41:44.194427 35815 info.go:265] docker info: {ID:HSF4:724Q:33A4:LV3T:VEUE:HFH5:DXTR:C6CE:AQR6:XBHD:TCTB:UPJH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:62 OomKillDisable:false NGoroutines:52 SystemTime:2022-09-06 22:41:44.127133174 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.124-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexSer
verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6232588288 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:9cd3357b7fd7218e4aec3eae239db1f68a5a6ec6 Expected:9cd3357b7fd7218e4aec3eae239db1f68a5a6ec6} RuncCommit:{ID:v1.1.4-0-g5fd4c4d Expected:v1.1.4-0-g5fd4c4d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defau
lt name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.9.1] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.10.2] map[Name:extension Path:/usr/local/lib/docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.9] map[Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.19.0]] Warnings:<nil>}}
I0906 15:41:44.236426 35815 out.go:177] * Using the docker driver based on user configuration
I0906 15:41:44.257405 35815 start.go:284] selected driver: docker
I0906 15:41:44.257418 35815 start.go:808] validating driver "docker" against <nil>
I0906 15:41:44.257434 35815 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0906 15:41:44.259676 35815 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0906 15:41:44.391231 35815 info.go:265] docker info: {ID:HSF4:724Q:33A4:LV3T:VEUE:HFH5:DXTR:C6CE:AQR6:XBHD:TCTB:UPJH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:62 OomKillDisable:false NGoroutines:52 SystemTime:2022-09-06 22:41:44.32441657 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.124-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServ
erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6232588288 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:9cd3357b7fd7218e4aec3eae239db1f68a5a6ec6 Expected:9cd3357b7fd7218e4aec3eae239db1f68a5a6ec6} RuncCommit:{ID:v1.1.4-0-g5fd4c4d Expected:v1.1.4-0-g5fd4c4d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defaul
t name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.9.1] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.10.2] map[Name:extension Path:/usr/local/lib/docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.9] map[Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.19.0]] Warnings:<nil>}}
I0906 15:41:44.391351 35815 start_flags.go:296] no existing cluster config was found, will generate one from the flags
I0906 15:41:44.391514 35815 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0906 15:41:44.412713 35815 out.go:177] * Using Docker Desktop driver with root privileges
I0906 15:41:44.433610 35815 cni.go:95] Creating CNI manager for ""
I0906 15:41:44.433631 35815 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I0906 15:41:44.433640 35815 start_flags.go:310] config:
{Name:old-k8s-version-20220906154143-22187 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.33-1661795577-14482@sha256:e92c29880a4b3b095ed3b61b1f4a696b57c5cd5212bc8256f9599a777020645d Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220906154143-22187 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSD
omain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
I0906 15:41:44.454517 35815 out.go:177] * Starting control plane node old-k8s-version-20220906154143-22187 in cluster old-k8s-version-20220906154143-22187
I0906 15:41:44.475456 35815 cache.go:120] Beginning downloading kic base image for docker with docker
I0906 15:41:44.496614 35815 out.go:177] * Pulling base image ...
I0906 15:41:44.517548 35815 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0906 15:41:44.517629 35815 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.33-1661795577-14482@sha256:e92c29880a4b3b095ed3b61b1f4a696b57c5cd5212bc8256f9599a777020645d in local docker daemon
I0906 15:41:44.517631 35815 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4
I0906 15:41:44.517660 35815 cache.go:57] Caching tarball of preloaded images
I0906 15:41:44.517843 35815 preload.go:174] Found /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0906 15:41:44.517860 35815 cache.go:60] Finished verifying existence of preloaded tar for v1.16.0 on docker
I0906 15:41:44.518759 35815 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/config.json ...
I0906 15:41:44.518875 35815 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/config.json: {Name:mk596860f4aa7c067a0623f36a64c9f4cee09676 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 15:41:44.581173 35815 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.33-1661795577-14482@sha256:e92c29880a4b3b095ed3b61b1f4a696b57c5cd5212bc8256f9599a777020645d in local docker daemon, skipping pull
I0906 15:41:44.581209 35815 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.33-1661795577-14482@sha256:e92c29880a4b3b095ed3b61b1f4a696b57c5cd5212bc8256f9599a777020645d exists in daemon, skipping load
I0906 15:41:44.581223 35815 cache.go:208] Successfully downloaded all kic artifacts
I0906 15:41:44.581280 35815 start.go:364] acquiring machines lock for old-k8s-version-20220906154143-22187: {Name:mkf6412c70024633cc757c4659ae827dd641d20a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0906 15:41:44.581432 35815 start.go:368] acquired machines lock for "old-k8s-version-20220906154143-22187" in 140.516µs
I0906 15:41:44.581460 35815 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-20220906154143-22187 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.33-1661795577-14482@sha256:e92c29880a4b3b095ed3b61b1f4a696b57c5cd5212bc8256f9599a777020645d Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220906154143-22187
Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMi
rror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0906 15:41:44.581547 35815 start.go:125] createHost starting for "" (driver="docker")
I0906 15:41:44.625109 35815 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0906 15:41:44.625402 35815 start.go:159] libmachine.API.Create for "old-k8s-version-20220906154143-22187" (driver="docker")
I0906 15:41:44.625443 35815 client.go:168] LocalClient.Create starting
I0906 15:41:44.625591 35815 main.go:134] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/ca.pem
I0906 15:41:44.625651 35815 main.go:134] libmachine: Decoding PEM data...
I0906 15:41:44.625673 35815 main.go:134] libmachine: Parsing certificate...
I0906 15:41:44.625758 35815 main.go:134] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/cert.pem
I0906 15:41:44.625795 35815 main.go:134] libmachine: Decoding PEM data...
I0906 15:41:44.625811 35815 main.go:134] libmachine: Parsing certificate...
I0906 15:41:44.626423 35815 cli_runner.go:164] Run: docker network inspect old-k8s-version-20220906154143-22187 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0906 15:41:44.687696 35815 cli_runner.go:211] docker network inspect old-k8s-version-20220906154143-22187 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0906 15:41:44.687802 35815 network_create.go:272] running [docker network inspect old-k8s-version-20220906154143-22187] to gather additional debugging logs...
I0906 15:41:44.687824 35815 cli_runner.go:164] Run: docker network inspect old-k8s-version-20220906154143-22187
W0906 15:41:44.749626 35815 cli_runner.go:211] docker network inspect old-k8s-version-20220906154143-22187 returned with exit code 1
I0906 15:41:44.749647 35815 network_create.go:275] error running [docker network inspect old-k8s-version-20220906154143-22187]: docker network inspect old-k8s-version-20220906154143-22187: exit status 1
stdout:
[]
stderr:
Error: No such network: old-k8s-version-20220906154143-22187
I0906 15:41:44.749667 35815 network_create.go:277] output of [docker network inspect old-k8s-version-20220906154143-22187]: -- stdout --
[]
-- /stdout --
** stderr **
Error: No such network: old-k8s-version-20220906154143-22187
** /stderr **
I0906 15:41:44.749755 35815 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0906 15:41:44.811884 35815 network.go:290] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc00065ac08] misses:0}
I0906 15:41:44.811923 35815 network.go:236] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0906 15:41:44.811937 35815 network_create.go:115] attempt to create docker network old-k8s-version-20220906154143-22187 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0906 15:41:44.812019 35815 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220906154143-22187 old-k8s-version-20220906154143-22187
W0906 15:41:44.873117 35815 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220906154143-22187 old-k8s-version-20220906154143-22187 returned with exit code 1
W0906 15:41:44.873154 35815 network_create.go:107] failed to create docker network old-k8s-version-20220906154143-22187 192.168.49.0/24, will retry: subnet is taken
I0906 15:41:44.873403 35815 network.go:281] skipping subnet 192.168.49.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc00065ac08] amended:false}} dirty:map[] misses:0}
I0906 15:41:44.873420 35815 network.go:239] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0906 15:41:44.873637 35815 network.go:290] reserving subnet 192.168.58.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc00065ac08] amended:true}} dirty:map[192.168.49.0:0xc00065ac08 192.168.58.0:0xc00058c378] misses:0}
I0906 15:41:44.873662 35815 network.go:236] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0906 15:41:44.873698 35815 network_create.go:115] attempt to create docker network old-k8s-version-20220906154143-22187 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ...
I0906 15:41:44.873762 35815 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220906154143-22187 old-k8s-version-20220906154143-22187
W0906 15:41:44.935695 35815 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220906154143-22187 old-k8s-version-20220906154143-22187 returned with exit code 1
W0906 15:41:44.935725 35815 network_create.go:107] failed to create docker network old-k8s-version-20220906154143-22187 192.168.58.0/24, will retry: subnet is taken
I0906 15:41:44.936016 35815 network.go:281] skipping subnet 192.168.58.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc00065ac08] amended:true}} dirty:map[192.168.49.0:0xc00065ac08 192.168.58.0:0xc00058c378] misses:1}
I0906 15:41:44.936034 35815 network.go:239] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0906 15:41:44.936227 35815 network.go:290] reserving subnet 192.168.67.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc00065ac08] amended:true}} dirty:map[192.168.49.0:0xc00065ac08 192.168.58.0:0xc00058c378 192.168.67.0:0xc00058c3b0] misses:1}
I0906 15:41:44.936238 35815 network.go:236] using free private subnet 192.168.67.0/24: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0906 15:41:44.936246 35815 network_create.go:115] attempt to create docker network old-k8s-version-20220906154143-22187 192.168.67.0/24 with gateway 192.168.67.1 and MTU of 1500 ...
I0906 15:41:44.936313 35815 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220906154143-22187 old-k8s-version-20220906154143-22187
I0906 15:41:45.032945 35815 network_create.go:99] docker network old-k8s-version-20220906154143-22187 192.168.67.0/24 created
I0906 15:41:45.032988 35815 kic.go:106] calculated static IP "192.168.67.2" for the "old-k8s-version-20220906154143-22187" container
I0906 15:41:45.033078 35815 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0906 15:41:45.096274 35815 cli_runner.go:164] Run: docker volume create old-k8s-version-20220906154143-22187 --label name.minikube.sigs.k8s.io=old-k8s-version-20220906154143-22187 --label created_by.minikube.sigs.k8s.io=true
I0906 15:41:45.158561 35815 oci.go:103] Successfully created a docker volume old-k8s-version-20220906154143-22187
I0906 15:41:45.158687 35815 cli_runner.go:164] Run: docker run --rm --name old-k8s-version-20220906154143-22187-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-20220906154143-22187 --entrypoint /usr/bin/test -v old-k8s-version-20220906154143-22187:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.33-1661795577-14482@sha256:e92c29880a4b3b095ed3b61b1f4a696b57c5cd5212bc8256f9599a777020645d -d /var/lib
I0906 15:41:45.610386 35815 oci.go:107] Successfully prepared a docker volume old-k8s-version-20220906154143-22187
I0906 15:41:45.610442 35815 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0906 15:41:45.610456 35815 kic.go:179] Starting extracting preloaded images to volume ...
I0906 15:41:45.610541 35815 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-20220906154143-22187:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.33-1661795577-14482@sha256:e92c29880a4b3b095ed3b61b1f4a696b57c5cd5212bc8256f9599a777020645d -I lz4 -xf /preloaded.tar -C /extractDir
I0906 15:41:49.408177 35815 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-20220906154143-22187:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.33-1661795577-14482@sha256:e92c29880a4b3b095ed3b61b1f4a696b57c5cd5212bc8256f9599a777020645d -I lz4 -xf /preloaded.tar -C /extractDir: (3.797583242s)
I0906 15:41:49.408197 35815 kic.go:188] duration metric: took 3.797740 seconds to extract preloaded images to volume
I0906 15:41:49.408320 35815 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0906 15:41:49.544125 35815 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname old-k8s-version-20220906154143-22187 --name old-k8s-version-20220906154143-22187 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-20220906154143-22187 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=old-k8s-version-20220906154143-22187 --network old-k8s-version-20220906154143-22187 --ip 192.168.67.2 --volume old-k8s-version-20220906154143-22187:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=8443 --publish=22 --publish=2376 --publish=5000 --publish=32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.33-1661795577-14482@sha256:e92c29880a4b3b095ed3b61b1f4a696b57c5cd5212bc8256f9599a777020645d
I0906 15:41:50.054028 35815 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220906154143-22187 --format={{.State.Running}}
I0906 15:41:50.280631 35815 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220906154143-22187 --format={{.State.Status}}
I0906 15:41:50.355100 35815 cli_runner.go:164] Run: docker exec old-k8s-version-20220906154143-22187 stat /var/lib/dpkg/alternatives/iptables
I0906 15:41:50.467697 35815 oci.go:144] the created container "old-k8s-version-20220906154143-22187" has a running status.
I0906 15:41:50.467726 35815 kic.go:210] Creating ssh key for kic: /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/machines/old-k8s-version-20220906154143-22187/id_rsa...
I0906 15:41:50.691989 35815 kic_runner.go:191] docker (temp): /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/machines/old-k8s-version-20220906154143-22187/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0906 15:41:50.811146 35815 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220906154143-22187 --format={{.State.Status}}
I0906 15:41:50.903580 35815 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0906 15:41:50.903600 35815 kic_runner.go:114] Args: [docker exec --privileged old-k8s-version-20220906154143-22187 chown docker:docker /home/docker/.ssh/authorized_keys]
I0906 15:41:51.141788 35815 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220906154143-22187 --format={{.State.Status}}
I0906 15:41:51.255645 35815 machine.go:88] provisioning docker machine ...
I0906 15:41:51.255688 35815 ubuntu.go:169] provisioning hostname "old-k8s-version-20220906154143-22187"
I0906 15:41:51.255779 35815 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220906154143-22187
I0906 15:41:51.322041 35815 main.go:134] libmachine: Using SSH client type: native
I0906 15:41:51.322234 35815 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13e5a40] 0x13e8bc0 <nil> [] 0s} 127.0.0.1 59416 <nil> <nil>}
I0906 15:41:51.322255 35815 main.go:134] libmachine: About to run SSH command:
sudo hostname old-k8s-version-20220906154143-22187 && echo "old-k8s-version-20220906154143-22187" | sudo tee /etc/hostname
I0906 15:41:51.443099 35815 main.go:134] libmachine: SSH cmd err, output: <nil>: old-k8s-version-20220906154143-22187
I0906 15:41:51.443189 35815 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220906154143-22187
I0906 15:41:51.507846 35815 main.go:134] libmachine: Using SSH client type: native
I0906 15:41:51.508028 35815 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13e5a40] 0x13e8bc0 <nil> [] 0s} 127.0.0.1 59416 <nil> <nil>}
I0906 15:41:51.508046 35815 main.go:134] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-20220906154143-22187' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-20220906154143-22187/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-20220906154143-22187' | sudo tee -a /etc/hosts;
fi
fi
I0906 15:41:51.621295 35815 main.go:134] libmachine: SSH cmd err, output: <nil>:
I0906 15:41:51.621313 35815 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube CaCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/key.pem ServerCertRemotePath:/etc/doc
ker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube}
I0906 15:41:51.621331 35815 ubuntu.go:177] setting up certificates
I0906 15:41:51.621338 35815 provision.go:83] configureAuth start
I0906 15:41:51.621405 35815 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220906154143-22187
I0906 15:41:51.785586 35815 provision.go:138] copyHostCerts
I0906 15:41:51.785691 35815 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/ca.pem, removing ...
I0906 15:41:51.785705 35815 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/ca.pem
I0906 15:41:51.785808 35815 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/ca.pem (1082 bytes)
I0906 15:41:51.786003 35815 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/cert.pem, removing ...
I0906 15:41:51.786012 35815 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/cert.pem
I0906 15:41:51.786100 35815 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/cert.pem (1123 bytes)
I0906 15:41:51.786258 35815 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/key.pem, removing ...
I0906 15:41:51.786264 35815 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/key.pem
I0906 15:41:51.786323 35815 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/key.pem (1675 bytes)
I0906 15:41:51.786463 35815 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-20220906154143-22187 san=[192.168.67.2 127.0.0.1 localhost 127.0.0.1 minikube old-k8s-version-20220906154143-22187]
I0906 15:41:52.014177 35815 provision.go:172] copyRemoteCerts
I0906 15:41:52.014277 35815 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0906 15:41:52.014338 35815 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220906154143-22187
I0906 15:41:52.202533 35815 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59416 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/machines/old-k8s-version-20220906154143-22187/id_rsa Username:docker}
I0906 15:41:52.285143 35815 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0906 15:41:52.341626 35815 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/machines/server.pem --> /etc/docker/server.pem (1281 bytes)
I0906 15:41:52.360005 35815 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0906 15:41:52.377714 35815 provision.go:86] duration metric: configureAuth took 756.35406ms
I0906 15:41:52.377742 35815 ubuntu.go:193] setting minikube options for container-runtime
I0906 15:41:52.377893 35815 config.go:180] Loaded profile config "old-k8s-version-20220906154143-22187": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
I0906 15:41:52.377949 35815 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220906154143-22187
I0906 15:41:52.524141 35815 main.go:134] libmachine: Using SSH client type: native
I0906 15:41:52.524302 35815 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13e5a40] 0x13e8bc0 <nil> [] 0s} 127.0.0.1 59416 <nil> <nil>}
I0906 15:41:52.524330 35815 main.go:134] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0906 15:41:52.634876 35815 main.go:134] libmachine: SSH cmd err, output: <nil>: overlay
I0906 15:41:52.634887 35815 ubuntu.go:71] root file system type: overlay
I0906 15:41:52.635044 35815 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0906 15:41:52.635122 35815 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220906154143-22187
I0906 15:41:52.768400 35815 main.go:134] libmachine: Using SSH client type: native
I0906 15:41:52.768566 35815 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13e5a40] 0x13e8bc0 <nil> [] 0s} 127.0.0.1 59416 <nil> <nil>}
I0906 15:41:52.768616 35815 main.go:134] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0906 15:41:52.895896 35815 main.go:134] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0906 15:41:52.895947 35815 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220906154143-22187
I0906 15:41:52.962893 35815 main.go:134] libmachine: Using SSH client type: native
I0906 15:41:52.963067 35815 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13e5a40] 0x13e8bc0 <nil> [] 0s} 127.0.0.1 59416 <nil> <nil>}
I0906 15:41:52.963080 35815 main.go:134] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0906 15:41:53.645736 35815 main.go:134] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2022-06-06 23:01:03.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2022-09-06 22:41:52.904611496 +0000
@@ -1,30 +1,32 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
Wants=network-online.target
-Requires=docker.socket containerd.service
+Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutSec=0
-RestartSec=2
-Restart=always
-
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
+Restart=on-failure
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
@@ -32,16 +34,16 @@
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0906 15:41:53.645757 35815 machine.go:91] provisioned docker machine in 2.390092865s
I0906 15:41:53.645764 35815 client.go:171] LocalClient.Create took 9.02031576s
I0906 15:41:53.645783 35815 start.go:167] duration metric: libmachine.API.Create for "old-k8s-version-20220906154143-22187" took 9.020378441s
I0906 15:41:53.645797 35815 start.go:300] post-start starting for "old-k8s-version-20220906154143-22187" (driver="docker")
I0906 15:41:53.645802 35815 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0906 15:41:53.645872 35815 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0906 15:41:53.645927 35815 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220906154143-22187
I0906 15:41:53.714610 35815 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59416 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/machines/old-k8s-version-20220906154143-22187/id_rsa Username:docker}
I0906 15:41:53.808529 35815 ssh_runner.go:195] Run: cat /etc/os-release
I0906 15:41:53.813982 35815 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0906 15:41:53.813997 35815 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0906 15:41:53.814003 35815 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0906 15:41:53.814008 35815 info.go:137] Remote host: Ubuntu 20.04.4 LTS
I0906 15:41:53.814018 35815 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/addons for local assets ...
I0906 15:41:53.814134 35815 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/files for local assets ...
I0906 15:41:53.814290 35815 filesync.go:149] local asset: /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/files/etc/ssl/certs/221872.pem -> 221872.pem in /etc/ssl/certs
I0906 15:41:53.814466 35815 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0906 15:41:53.822427 35815 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/files/etc/ssl/certs/221872.pem --> /etc/ssl/certs/221872.pem (1708 bytes)
I0906 15:41:53.839573 35815 start.go:303] post-start completed in 193.767276ms
I0906 15:41:53.840117 35815 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220906154143-22187
I0906 15:41:53.914467 35815 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/config.json ...
I0906 15:41:53.914887 35815 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0906 15:41:53.914935 35815 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220906154143-22187
I0906 15:41:53.990844 35815 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59416 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/machines/old-k8s-version-20220906154143-22187/id_rsa Username:docker}
I0906 15:41:54.069568 35815 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0906 15:41:54.074348 35815 start.go:128] duration metric: createHost completed in 9.492792568s
I0906 15:41:54.074363 35815 start.go:83] releasing machines lock for "old-k8s-version-20220906154143-22187", held for 9.492921618s
I0906 15:41:54.074441 35815 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220906154143-22187
I0906 15:41:54.160805 35815 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
I0906 15:41:54.160809 35815 ssh_runner.go:195] Run: systemctl --version
I0906 15:41:54.160891 35815 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220906154143-22187
I0906 15:41:54.160924 35815 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220906154143-22187
I0906 15:41:54.228665 35815 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59416 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/machines/old-k8s-version-20220906154143-22187/id_rsa Username:docker}
I0906 15:41:54.228775 35815 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59416 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/machines/old-k8s-version-20220906154143-22187/id_rsa Username:docker}
I0906 15:41:54.470611 35815 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0906 15:41:54.480545 35815 cruntime.go:273] skipping containerd shutdown because we are bound to it
I0906 15:41:54.480602 35815 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0906 15:41:54.489665 35815 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
image-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0906 15:41:54.502824 35815 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0906 15:41:54.565758 35815 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0906 15:41:54.631073 35815 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0906 15:41:54.695325 35815 ssh_runner.go:195] Run: sudo systemctl restart docker
I0906 15:41:54.906702 35815 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0906 15:41:54.945380 35815 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0906 15:41:55.017877 35815 out.go:204] * Preparing Kubernetes v1.16.0 on Docker 20.10.17 ...
I0906 15:41:55.017982 35815 cli_runner.go:164] Run: docker exec -t old-k8s-version-20220906154143-22187 dig +short host.docker.internal
I0906 15:41:55.143234 35815 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2
I0906 15:41:55.143331 35815 ssh_runner.go:195] Run: grep 192.168.65.2 host.minikube.internal$ /etc/hosts
I0906 15:41:55.148507 35815 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0906 15:41:55.159656 35815 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-20220906154143-22187
I0906 15:41:55.227963 35815 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0906 15:41:55.228045 35815 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0906 15:41:55.259904 35815 docker.go:611] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0906 15:41:55.259923 35815 docker.go:542] Images already preloaded, skipping extraction
I0906 15:41:55.260005 35815 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0906 15:41:55.296160 35815 docker.go:611] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0906 15:41:55.296178 35815 cache_images.go:84] Images are preloaded, skipping loading
I0906 15:41:55.296264 35815 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0906 15:41:55.379992 35815 cni.go:95] Creating CNI manager for ""
I0906 15:41:55.380005 35815 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I0906 15:41:55.380018 35815 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0906 15:41:55.380034 35815 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.67.2 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-20220906154143-22187 NodeName:old-k8s-version-20220906154143-22187 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.67.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.67.2 CgroupDriver:systemd Clien
tCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
I0906 15:41:55.380160 35815 kubeadm.go:162] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.67.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-20220906154143-22187"
kubeletExtraArgs:
node-ip: 192.168.67.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.67.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-20220906154143-22187
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.67.2:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0906 15:41:55.380248 35815 kubeadm.go:962] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-20220906154143-22187 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.67.2
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220906154143-22187 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0906 15:41:55.380303 35815 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0906 15:41:55.388961 35815 binaries.go:44] Found k8s binaries, skipping transfer
I0906 15:41:55.389031 35815 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0906 15:41:55.397909 35815 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (362 bytes)
I0906 15:41:55.412313 35815 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0906 15:41:55.425760 35815 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2148 bytes)
I0906 15:41:55.440821 35815 ssh_runner.go:195] Run: grep 192.168.67.2 control-plane.minikube.internal$ /etc/hosts
I0906 15:41:55.445228 35815 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.67.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0906 15:41:55.455708 35815 certs.go:54] Setting up /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187 for IP: 192.168.67.2
I0906 15:41:55.455841 35815 certs.go:182] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/ca.key
I0906 15:41:55.455889 35815 certs.go:182] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/proxy-client-ca.key
I0906 15:41:55.455931 35815 certs.go:302] generating minikube-user signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/client.key
I0906 15:41:55.455944 35815 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/client.crt with IP's: []
I0906 15:41:55.585969 35815 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/client.crt ...
I0906 15:41:55.585985 35815 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/client.crt: {Name:mk1505cf30a2b007025128e6aedc865e8245166b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 15:41:55.586303 35815 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/client.key ...
I0906 15:41:55.586317 35815 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/client.key: {Name:mk045d4247250d43fa577c2c3ea9fb89445721c9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 15:41:55.586521 35815 certs.go:302] generating minikube signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/apiserver.key.c7fa3a9e
I0906 15:41:55.586536 35815 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/apiserver.crt.c7fa3a9e with IP's: [192.168.67.2 10.96.0.1 127.0.0.1 10.0.0.1]
I0906 15:41:55.726877 35815 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/apiserver.crt.c7fa3a9e ...
I0906 15:41:55.726898 35815 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/apiserver.crt.c7fa3a9e: {Name:mkd05d27ea31b316564977cae5183d5bea7443c2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 15:41:55.727244 35815 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/apiserver.key.c7fa3a9e ...
I0906 15:41:55.727253 35815 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/apiserver.key.c7fa3a9e: {Name:mk3dae47afc1bda6798170c7998bfddd46afac5c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 15:41:55.727458 35815 certs.go:320] copying /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/apiserver.crt.c7fa3a9e -> /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/apiserver.crt
I0906 15:41:55.727636 35815 certs.go:324] copying /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/apiserver.key.c7fa3a9e -> /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/apiserver.key
I0906 15:41:55.727811 35815 certs.go:302] generating aggregator signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/proxy-client.key
I0906 15:41:55.727828 35815 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/proxy-client.crt with IP's: []
I0906 15:41:55.899373 35815 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/proxy-client.crt ...
I0906 15:41:55.899389 35815 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/proxy-client.crt: {Name:mk92ae17b2104cea7dbc2beb4f763fdd8d427b38 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 15:41:55.899663 35815 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/proxy-client.key ...
I0906 15:41:55.899671 35815 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/proxy-client.key: {Name:mk3402b52a7c0c839926d27210770fc1270b22ad Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 15:41:55.900030 35815 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/22187.pem (1338 bytes)
W0906 15:41:55.900073 35815 certs.go:384] ignoring /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/22187_empty.pem, impossibly tiny 0 bytes
I0906 15:41:55.900082 35815 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/ca-key.pem (1675 bytes)
I0906 15:41:55.900117 35815 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/ca.pem (1082 bytes)
I0906 15:41:55.900157 35815 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/cert.pem (1123 bytes)
I0906 15:41:55.900192 35815 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/key.pem (1675 bytes)
I0906 15:41:55.900255 35815 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/files/etc/ssl/certs/221872.pem (1708 bytes)
I0906 15:41:55.900707 35815 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0906 15:41:55.919140 35815 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0906 15:41:55.936903 35815 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0906 15:41:55.954461 35815 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/profiles/old-k8s-version-20220906154143-22187/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0906 15:41:55.973417 35815 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0906 15:41:55.991209 35815 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0906 15:41:56.008976 35815 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0906 15:41:56.028814 35815 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0906 15:41:56.045545 35815 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0906 15:41:56.062095 35815 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/certs/22187.pem --> /usr/share/ca-certificates/22187.pem (1338 bytes)
I0906 15:41:56.079053 35815 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/.minikube/files/etc/ssl/certs/221872.pem --> /usr/share/ca-certificates/221872.pem (1708 bytes)
I0906 15:41:56.095859 35815 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0906 15:41:56.108772 35815 ssh_runner.go:195] Run: openssl version
I0906 15:41:56.114247 35815 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0906 15:41:56.122443 35815 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0906 15:41:56.126370 35815 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Sep 6 21:45 /usr/share/ca-certificates/minikubeCA.pem
I0906 15:41:56.126414 35815 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0906 15:41:56.131730 35815 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0906 15:41:56.139238 35815 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/22187.pem && ln -fs /usr/share/ca-certificates/22187.pem /etc/ssl/certs/22187.pem"
I0906 15:41:56.147790 35815 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/22187.pem
I0906 15:41:56.152179 35815 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Sep 6 21:50 /usr/share/ca-certificates/22187.pem
I0906 15:41:56.152223 35815 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/22187.pem
I0906 15:41:56.157800 35815 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/22187.pem /etc/ssl/certs/51391683.0"
I0906 15:41:56.166493 35815 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/221872.pem && ln -fs /usr/share/ca-certificates/221872.pem /etc/ssl/certs/221872.pem"
I0906 15:41:56.174679 35815 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/221872.pem
I0906 15:41:56.178645 35815 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Sep 6 21:50 /usr/share/ca-certificates/221872.pem
I0906 15:41:56.178688 35815 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/221872.pem
I0906 15:41:56.184909 35815 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/221872.pem /etc/ssl/certs/3ec20f2e.0"
I0906 15:41:56.193511 35815 kubeadm.go:396] StartCluster: {Name:old-k8s-version-20220906154143-22187 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.33-1661795577-14482@sha256:e92c29880a4b3b095ed3b61b1f4a696b57c5cd5212bc8256f9599a777020645d Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220906154143-22187 Namespace:default API
ServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disa
bleOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
I0906 15:41:56.193602 35815 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0906 15:41:56.223639 35815 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0906 15:41:56.231254 35815 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0906 15:41:56.238669 35815 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I0906 15:41:56.238717 35815 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0906 15:41:56.246088 35815 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0906 15:41:56.246113 35815 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0906 15:41:56.290274 35815 kubeadm.go:317] [init] Using Kubernetes version: v1.16.0
I0906 15:41:56.290326 35815 kubeadm.go:317] [preflight] Running pre-flight checks
I0906 15:41:56.612947 35815 kubeadm.go:317] [preflight] Pulling images required for setting up a Kubernetes cluster
I0906 15:41:56.613027 35815 kubeadm.go:317] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0906 15:41:56.613120 35815 kubeadm.go:317] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0906 15:41:56.895291 35815 kubeadm.go:317] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0906 15:41:56.896297 35815 kubeadm.go:317] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0906 15:41:56.902494 35815 kubeadm.go:317] [kubelet-start] Activating the kubelet service
I0906 15:41:56.960890 35815 kubeadm.go:317] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0906 15:41:57.003042 35815 out.go:204] - Generating certificates and keys ...
I0906 15:41:57.003132 35815 kubeadm.go:317] [certs] Using existing ca certificate authority
I0906 15:41:57.003237 35815 kubeadm.go:317] [certs] Using existing apiserver certificate and key on disk
I0906 15:41:57.293078 35815 kubeadm.go:317] [certs] Generating "apiserver-kubelet-client" certificate and key
I0906 15:41:57.420671 35815 kubeadm.go:317] [certs] Generating "front-proxy-ca" certificate and key
I0906 15:41:57.806645 35815 kubeadm.go:317] [certs] Generating "front-proxy-client" certificate and key
I0906 15:41:58.049833 35815 kubeadm.go:317] [certs] Generating "etcd/ca" certificate and key
I0906 15:41:58.143766 35815 kubeadm.go:317] [certs] Generating "etcd/server" certificate and key
I0906 15:41:58.143897 35815 kubeadm.go:317] [certs] etcd/server serving cert is signed for DNS names [old-k8s-version-20220906154143-22187 localhost] and IPs [192.168.67.2 127.0.0.1 ::1]
I0906 15:41:58.483059 35815 kubeadm.go:317] [certs] Generating "etcd/peer" certificate and key
I0906 15:41:58.483170 35815 kubeadm.go:317] [certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-20220906154143-22187 localhost] and IPs [192.168.67.2 127.0.0.1 ::1]
I0906 15:41:58.762546 35815 kubeadm.go:317] [certs] Generating "etcd/healthcheck-client" certificate and key
I0906 15:41:58.919225 35815 kubeadm.go:317] [certs] Generating "apiserver-etcd-client" certificate and key
I0906 15:41:59.210599 35815 kubeadm.go:317] [certs] Generating "sa" key and public key
I0906 15:41:59.210819 35815 kubeadm.go:317] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0906 15:41:59.561364 35815 kubeadm.go:317] [kubeconfig] Writing "admin.conf" kubeconfig file
I0906 15:41:59.733662 35815 kubeadm.go:317] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0906 15:41:59.848584 35815 kubeadm.go:317] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0906 15:42:00.013451 35815 kubeadm.go:317] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0906 15:42:00.014267 35815 kubeadm.go:317] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0906 15:42:00.042867 35815 out.go:204] - Booting up control plane ...
I0906 15:42:00.042970 35815 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0906 15:42:00.043068 35815 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0906 15:42:00.043133 35815 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0906 15:42:00.043218 35815 kubeadm.go:317] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0906 15:42:00.043364 35815 kubeadm.go:317] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0906 15:42:39.995396 35815 kubeadm.go:317] [kubelet-check] Initial timeout of 40s passed.
I0906 15:42:39.996060 35815 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0906 15:42:39.996288 35815 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0906 15:42:44.993135 35815 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0906 15:42:44.993303 35815 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0906 15:42:54.987985 35815 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0906 15:42:54.988174 35815 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0906 15:43:14.974649 35815 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0906 15:43:14.974793 35815 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0906 15:43:54.948061 35815 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0906 15:43:54.948271 35815 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0906 15:43:54.948296 35815 kubeadm.go:317]
I0906 15:43:54.948373 35815 kubeadm.go:317] Unfortunately, an error has occurred:
I0906 15:43:54.948446 35815 kubeadm.go:317] timed out waiting for the condition
I0906 15:43:54.948461 35815 kubeadm.go:317]
I0906 15:43:54.948496 35815 kubeadm.go:317] This error is likely caused by:
I0906 15:43:54.948533 35815 kubeadm.go:317] - The kubelet is not running
I0906 15:43:54.948655 35815 kubeadm.go:317] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0906 15:43:54.948668 35815 kubeadm.go:317]
I0906 15:43:54.948765 35815 kubeadm.go:317] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0906 15:43:54.948795 35815 kubeadm.go:317] - 'systemctl status kubelet'
I0906 15:43:54.948824 35815 kubeadm.go:317] - 'journalctl -xeu kubelet'
I0906 15:43:54.948832 35815 kubeadm.go:317]
I0906 15:43:54.948951 35815 kubeadm.go:317] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0906 15:43:54.949053 35815 kubeadm.go:317] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I0906 15:43:54.949154 35815 kubeadm.go:317] Here is one example how you may list all Kubernetes containers running in docker:
I0906 15:43:54.949217 35815 kubeadm.go:317] - 'docker ps -a | grep kube | grep -v pause'
I0906 15:43:54.949280 35815 kubeadm.go:317] Once you have found the failing container, you can inspect its logs with:
I0906 15:43:54.949308 35815 kubeadm.go:317] - 'docker logs CONTAINERID'
I0906 15:43:54.951922 35815 kubeadm.go:317] [WARNING Swap]: running with swap on is not supported. Please disable swap
I0906 15:43:54.952034 35815 kubeadm.go:317] [WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
I0906 15:43:54.952111 35815 kubeadm.go:317] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0906 15:43:54.952164 35815 kubeadm.go:317] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0906 15:43:54.952224 35815 kubeadm.go:317] To see the stack trace of this error execute with --v=5 or higher
W0906 15:43:54.952365 35815 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-20220906154143-22187 localhost] and IPs [192.168.67.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-20220906154143-22187 localhost] and IPs [192.168.67.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-20220906154143-22187 localhost] and IPs [192.168.67.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-20220906154143-22187 localhost] and IPs [192.168.67.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0906 15:43:54.952393 35815 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"
I0906 15:43:55.375087 35815 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0906 15:43:55.384472 35815 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I0906 15:43:55.384522 35815 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0906 15:43:55.391553 35815 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0906 15:43:55.391574 35815 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0906 15:43:55.439958 35815 kubeadm.go:317] [init] Using Kubernetes version: v1.16.0
I0906 15:43:55.440022 35815 kubeadm.go:317] [preflight] Running pre-flight checks
I0906 15:43:55.756199 35815 kubeadm.go:317] [preflight] Pulling images required for setting up a Kubernetes cluster
I0906 15:43:55.756298 35815 kubeadm.go:317] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0906 15:43:55.756394 35815 kubeadm.go:317] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0906 15:43:56.031864 35815 kubeadm.go:317] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0906 15:43:56.032504 35815 kubeadm.go:317] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0906 15:43:56.039605 35815 kubeadm.go:317] [kubelet-start] Activating the kubelet service
I0906 15:43:56.108801 35815 kubeadm.go:317] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0906 15:43:56.130871 35815 out.go:204] - Generating certificates and keys ...
I0906 15:43:56.130944 35815 kubeadm.go:317] [certs] Using existing ca certificate authority
I0906 15:43:56.131018 35815 kubeadm.go:317] [certs] Using existing apiserver certificate and key on disk
I0906 15:43:56.131100 35815 kubeadm.go:317] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0906 15:43:56.131196 35815 kubeadm.go:317] [certs] Using existing front-proxy-ca certificate authority
I0906 15:43:56.131300 35815 kubeadm.go:317] [certs] Using existing front-proxy-client certificate and key on disk
I0906 15:43:56.131375 35815 kubeadm.go:317] [certs] Using existing etcd/ca certificate authority
I0906 15:43:56.131446 35815 kubeadm.go:317] [certs] Using existing etcd/server certificate and key on disk
I0906 15:43:56.131503 35815 kubeadm.go:317] [certs] Using existing etcd/peer certificate and key on disk
I0906 15:43:56.131565 35815 kubeadm.go:317] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0906 15:43:56.131622 35815 kubeadm.go:317] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0906 15:43:56.131661 35815 kubeadm.go:317] [certs] Using the existing "sa" key
I0906 15:43:56.131710 35815 kubeadm.go:317] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0906 15:43:56.497958 35815 kubeadm.go:317] [kubeconfig] Writing "admin.conf" kubeconfig file
I0906 15:43:56.624222 35815 kubeadm.go:317] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0906 15:43:56.692141 35815 kubeadm.go:317] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0906 15:43:56.808415 35815 kubeadm.go:317] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0906 15:43:56.809365 35815 kubeadm.go:317] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0906 15:43:56.830788 35815 out.go:204] - Booting up control plane ...
I0906 15:43:56.830949 35815 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0906 15:43:56.831081 35815 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0906 15:43:56.831185 35815 kubeadm.go:317] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0906 15:43:56.831316 35815 kubeadm.go:317] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0906 15:43:56.831549 35815 kubeadm.go:317] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0906 15:44:36.792451 35815 kubeadm.go:317] [kubelet-check] Initial timeout of 40s passed.
I0906 15:44:36.793776 35815 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0906 15:44:36.793975 35815 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0906 15:44:41.796844 35815 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0906 15:44:41.796991 35815 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0906 15:44:51.797815 35815 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0906 15:44:51.797957 35815 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0906 15:45:11.790322 35815 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0906 15:45:11.790492 35815 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0906 15:45:51.764711 35815 kubeadm.go:317] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0906 15:45:51.764950 35815 kubeadm.go:317] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0906 15:45:51.764966 35815 kubeadm.go:317]
I0906 15:45:51.765002 35815 kubeadm.go:317] Unfortunately, an error has occurred:
I0906 15:45:51.765063 35815 kubeadm.go:317] timed out waiting for the condition
I0906 15:45:51.765078 35815 kubeadm.go:317]
I0906 15:45:51.765118 35815 kubeadm.go:317] This error is likely caused by:
I0906 15:45:51.765155 35815 kubeadm.go:317] - The kubelet is not running
I0906 15:45:51.765264 35815 kubeadm.go:317] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0906 15:45:51.765277 35815 kubeadm.go:317]
I0906 15:45:51.765357 35815 kubeadm.go:317] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0906 15:45:51.765393 35815 kubeadm.go:317] - 'systemctl status kubelet'
I0906 15:45:51.765420 35815 kubeadm.go:317] - 'journalctl -xeu kubelet'
I0906 15:45:51.765424 35815 kubeadm.go:317]
I0906 15:45:51.765497 35815 kubeadm.go:317] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0906 15:45:51.765563 35815 kubeadm.go:317] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I0906 15:45:51.765632 35815 kubeadm.go:317] Here is one example how you may list all Kubernetes containers running in docker:
I0906 15:45:51.765672 35815 kubeadm.go:317] - 'docker ps -a | grep kube | grep -v pause'
I0906 15:45:51.765732 35815 kubeadm.go:317] Once you have found the failing container, you can inspect its logs with:
I0906 15:45:51.765753 35815 kubeadm.go:317] - 'docker logs CONTAINERID'
I0906 15:45:51.768990 35815 kubeadm.go:317] [WARNING Swap]: running with swap on is not supported. Please disable swap
I0906 15:45:51.769108 35815 kubeadm.go:317] [WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
I0906 15:45:51.769189 35815 kubeadm.go:317] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0906 15:45:51.769280 35815 kubeadm.go:317] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0906 15:45:51.769338 35815 kubeadm.go:317] To see the stack trace of this error execute with --v=5 or higher
I0906 15:45:51.769367 35815 kubeadm.go:398] StartCluster complete in 3m55.553264145s
I0906 15:45:51.769435 35815 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0906 15:45:51.798602 35815 logs.go:274] 0 containers: []
W0906 15:45:51.798615 35815 logs.go:276] No container was found matching "kube-apiserver"
I0906 15:45:51.798668 35815 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0906 15:45:51.827813 35815 logs.go:274] 0 containers: []
W0906 15:45:51.827825 35815 logs.go:276] No container was found matching "etcd"
I0906 15:45:51.827886 35815 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0906 15:45:51.856802 35815 logs.go:274] 0 containers: []
W0906 15:45:51.856815 35815 logs.go:276] No container was found matching "coredns"
I0906 15:45:51.856876 35815 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0906 15:45:51.887964 35815 logs.go:274] 0 containers: []
W0906 15:45:51.887976 35815 logs.go:276] No container was found matching "kube-scheduler"
I0906 15:45:51.888047 35815 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0906 15:45:51.919888 35815 logs.go:274] 0 containers: []
W0906 15:45:51.919900 35815 logs.go:276] No container was found matching "kube-proxy"
I0906 15:45:51.919982 35815 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0906 15:45:51.950771 35815 logs.go:274] 0 containers: []
W0906 15:45:51.950789 35815 logs.go:276] No container was found matching "kubernetes-dashboard"
I0906 15:45:51.950852 35815 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0906 15:45:51.979531 35815 logs.go:274] 0 containers: []
W0906 15:45:51.979544 35815 logs.go:276] No container was found matching "storage-provisioner"
I0906 15:45:51.979599 35815 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0906 15:45:52.010593 35815 logs.go:274] 0 containers: []
W0906 15:45:52.010605 35815 logs.go:276] No container was found matching "kube-controller-manager"
I0906 15:45:52.010613 35815 logs.go:123] Gathering logs for dmesg ...
I0906 15:45:52.010620 35815 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0906 15:45:52.023098 35815 logs.go:123] Gathering logs for describe nodes ...
I0906 15:45:52.023110 35815 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0906 15:45:52.075718 35815 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0906 15:45:52.075730 35815 logs.go:123] Gathering logs for Docker ...
I0906 15:45:52.075737 35815 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400"
I0906 15:45:52.091302 35815 logs.go:123] Gathering logs for container status ...
I0906 15:45:52.091314 35815 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0906 15:45:54.143067 35815 ssh_runner.go:235] Completed: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": (2.051714027s)
I0906 15:45:54.143208 35815 logs.go:123] Gathering logs for kubelet ...
I0906 15:45:54.143215 35815 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0906 15:45:54.185008 35815 out.go:369] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0906 15:45:54.185027 35815 out.go:239] *
*
W0906 15:45:54.185169 35815 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0906 15:45:54.185182 35815 out.go:239] *
*
W0906 15:45:54.185812 35815 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0906 15:45:54.247989 35815 out.go:177]
W0906 15:45:54.322252 35815 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0906 15:45:54.322399 35815 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0906 15:45:54.322455 35815 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0906 15:45:54.379951 35815 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p old-k8s-version-20220906154143-22187 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-20220906154143-22187
helpers_test.go:235: (dbg) docker inspect old-k8s-version-20220906154143-22187:
-- stdout --
[
{
"Id": "3ccebcd496a258876daf9080330dc747b000e5ed2d46306dcee2b578da5dade8",
"Created": "2022-09-06T22:41:49.616534464Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 233297,
"ExitCode": 0,
"Error": "",
"StartedAt": "2022-09-06T22:41:49.947340708Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:2ba71c3417619fdcfc963d836ce066d238b9a7120a650b2e3e1479172675dba7",
"ResolvConfPath": "/var/lib/docker/containers/3ccebcd496a258876daf9080330dc747b000e5ed2d46306dcee2b578da5dade8/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/3ccebcd496a258876daf9080330dc747b000e5ed2d46306dcee2b578da5dade8/hostname",
"HostsPath": "/var/lib/docker/containers/3ccebcd496a258876daf9080330dc747b000e5ed2d46306dcee2b578da5dade8/hosts",
"LogPath": "/var/lib/docker/containers/3ccebcd496a258876daf9080330dc747b000e5ed2d46306dcee2b578da5dade8/3ccebcd496a258876daf9080330dc747b000e5ed2d46306dcee2b578da5dade8-json.log",
"Name": "/old-k8s-version-20220906154143-22187",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-20220906154143-22187:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-20220906154143-22187",
"PortBindings": {
"22/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"2376/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"32443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"5000/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"8443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"ConsoleSize": [
0,
0
],
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": null,
"BlkioDeviceWriteBps": null,
"BlkioDeviceReadIOps": null,
"BlkioDeviceWriteIOps": null,
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"KernelMemory": 0,
"KernelMemoryTCP": 0,
"MemoryReservation": 0,
"MemorySwap": 2306867200,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": null,
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/a3ac547ea3e5ca47a66946b75ad2142ca777ca0c2891e5cf89e36574deede447-init/diff:/var/lib/docker/overlay2/a562149d66f4eb8f5518f0ead57ae27ab583c1eeeb0d38f07f5396cd3866d815/diff:/var/lib/docker/overlay2/74eccebe6faed6975afb963d12613841faca02bf4d174485c963e2527c53a200/diff:/var/lib/docker/overlay2/0bdf5bc6b0a6ccd0e955f7ebf2bcfa87f9201bdf2c218bd47e6d1cd6025fb96b/diff:/var/lib/docker/overlay2/c4c2dd1586b51d6e8ca7a504a53ffbb8b2973fb0ddc21be2d58ba761552e32ff/diff:/var/lib/docker/overlay2/f5ff15396dfa63df0418175f14b4dd4abf0410a489aa00b18d5779478cbed022/diff:/var/lib/docker/overlay2/4f6df783c35248d9995096ab352c9bebd3d0c540232ed107971de794a28fcaf5/diff:/var/lib/docker/overlay2/fd71c2f32b76c099747ff260b8cd6a94172bf263f86463f1daf0764db4e83999/diff:/var/lib/docker/overlay2/496c52c2d5e01156bf5ff28fa60809272db59e3c59bafd30204f24fb08861446/diff:/var/lib/docker/overlay2/57deb25eee11fbfc14fd895c916e29970e206c2727688c054f27f0f25686fd55/diff:/var/lib/docker/overlay2/5a8433
204278b53d60d5f2b75b5aacd615ae7a0ebdd67a29ec13cd33f9853db9/diff:/var/lib/docker/overlay2/2932b2cd731955e5faf801c340b6e1022996064615e6ae972e6b293cd8b2fa51/diff:/var/lib/docker/overlay2/a0a1e1937feb64b0d7a5c9ac655ec573113780fdaaffc81cf0f4da5950c78f8a/diff:/var/lib/docker/overlay2/2e595f3b99c92e64209782201f20aff147f2c576dd2999efcc76f866eca52ddc/diff:/var/lib/docker/overlay2/464360d4c39f56fc8d6fa835135ac5814ef91437da753fdd4560797cd3b027eb/diff:/var/lib/docker/overlay2/83211c8e9021816fa8c23de95334bd655b68395bb92d7d61e12d7203dc3d714b/diff:/var/lib/docker/overlay2/a8d8fb2f88288922a9b0bf7943c62a3cfcc024a78581e37d5d3c3acc560f553b/diff:/var/lib/docker/overlay2/96c72ca78e29930d7154438af9871d4cfdc2e24aa532a6a6d3c76d25dcfb5eb9/diff:/var/lib/docker/overlay2/519ceecd99b3a0789bef5c7f67cf247268443d5309ba11fc4bd60f359a26e5fe/diff:/var/lib/docker/overlay2/f0b0ca5f04610107e34e6462cb9431d6bfb9cbd96cb632feb1b47b83e3b523e3/diff:/var/lib/docker/overlay2/015f27bc54118485988dfd1bac9b6d916497512d4c5c00053d2defd3844f397c/diff:/var/lib/d
ocker/overlay2/c7c3acdd1162eae501ece2f4a765e7277af9b67363596f1b616f62ec1ca1ad9f/diff:/var/lib/docker/overlay2/9d1323620e50a1dcedd43e2f57dd25e3968aa0a5ae54788552b9b82e8cacef60/diff:/var/lib/docker/overlay2/7aa7cb069fa8adbd0959a63f126ab99eb426108fec0a7a84fe851c4740adaa40/diff:/var/lib/docker/overlay2/071db635c09ef55a6c883833fe3d08a6fa405d0d24debb89e72f2878fd0abd7a/diff:/var/lib/docker/overlay2/987f7bbc210fec0b342c78f5e7a4c0cf6bbbe7d8799634e00a806f768c2d8d3c/diff:/var/lib/docker/overlay2/462fd8a072151e44657567c3ff2efe1faa8244e9848407d97306e551bb1454e8/diff:/var/lib/docker/overlay2/98707451f52f942875bf1a8e247c85fa0f1d1ee92784f52ceb6b096e2efdf533/diff:/var/lib/docker/overlay2/e5066a3945cc023c1629aa29bde0e437b188e70338451c71049bf3c33a7e555c/diff:/var/lib/docker/overlay2/14c2b9d6745644b40e95c6cc56ff6170d6c03ed111777658cbe2daac2730a6a9/diff:/var/lib/docker/overlay2/8479935d545eb59e481aaa679ab8f60b391464287762a8c90a5cffff477bb68d/diff:/var/lib/docker/overlay2/fb806fe43c96acd77d33e891e616cf29950417d95d9a5428b16f0bc908e
d5aa1/diff:/var/lib/docker/overlay2/4da1a1ac77f9d2641c6379794ff698c0af3eccf9c96f08f428548ae22b260b5e/diff:/var/lib/docker/overlay2/30fc26375d1ca954f0dc6ef93e7df2bfbf970493b4a8bc7e8df2ad8c1be420a0/diff:/var/lib/docker/overlay2/26af946e2832e6fc46a8fe67f66364e371a6dd8bb644a094d7a72f0e25037bdf/diff:/var/lib/docker/overlay2/1452a272fd05aa9fca5a7ec62b972f6a661d0bc955e4dfc63ef2ddf4fce7eceb/diff:/var/lib/docker/overlay2/a65b8c56de8c6974a72ff9eb3ccbdb9aae618ddcbbe1e8d65186965a884ef056/diff:/var/lib/docker/overlay2/ead0a1e4bdf1831cf3d67779cc393228e236145e457493de05388e10e77028d8/diff:/var/lib/docker/overlay2/6fd54f0af6de98ede514110cb94fbd23ea44c265aa2128c1d7f9fa973c21d1dc/diff:/var/lib/docker/overlay2/4e1c05ee18d705f9265e361ccd75b65824b8ea694cf8c94032cb15561a4e8e4e/diff:/var/lib/docker/overlay2/943d49f99d14345240a33491159a383efafbf57de90cf2766b7468b7ce9a7a15/diff:/var/lib/docker/overlay2/34acb6edcafe85cd91851d5c497b31d1aedd5724caa80176cec756b07cab5e88/diff:/var/lib/docker/overlay2/616725bf00ee410535fc74d0c2b833611f875f
36f0acd64b9a76b0d3949b9150/diff",
"MergedDir": "/var/lib/docker/overlay2/a3ac547ea3e5ca47a66946b75ad2142ca777ca0c2891e5cf89e36574deede447/merged",
"UpperDir": "/var/lib/docker/overlay2/a3ac547ea3e5ca47a66946b75ad2142ca777ca0c2891e5cf89e36574deede447/diff",
"WorkDir": "/var/lib/docker/overlay2/a3ac547ea3e5ca47a66946b75ad2142ca777ca0c2891e5cf89e36574deede447/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "volume",
"Name": "old-k8s-version-20220906154143-22187",
"Source": "/var/lib/docker/volumes/old-k8s-version-20220906154143-22187/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
},
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
}
],
"Config": {
"Hostname": "old-k8s-version-20220906154143-22187",
"Domainname": "",
"User": "root",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.33-1661795577-14482@sha256:e92c29880a4b3b095ed3b61b1f4a696b57c5cd5212bc8256f9599a777020645d",
"Volumes": null,
"WorkingDir": "",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-20220906154143-22187",
"name.minikube.sigs.k8s.io": "old-k8s-version-20220906154143-22187",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "ac26f8e95c47984d4f033eccb6473e2db1bc4b07e981e1c31c620ad3db239966",
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"Ports": {
"22/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "59416"
}
],
"2376/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "59412"
}
],
"32443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "59413"
}
],
"5000/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "59414"
}
],
"8443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "59415"
}
]
},
"SandboxKey": "/var/run/docker/netns/ac26f8e95c47",
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-20220906154143-22187": {
"IPAMConfig": {
"IPv4Address": "192.168.67.2"
},
"Links": null,
"Aliases": [
"3ccebcd496a2",
"old-k8s-version-20220906154143-22187"
],
"NetworkID": "3e22c4664759861d82314ff89c941b324eadf283ebb8fd6949e8fc4ad4c9a041",
"EndpointID": "96050ea0ab9bfeeb7e9e137674d4e2b254dd8e8ae8f463ca42529fed01f0431b",
"Gateway": "192.168.67.1",
"IPAddress": "192.168.67.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"MacAddress": "02:42:c0:a8:43:02",
"DriverOpts": null
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-20220906154143-22187 -n old-k8s-version-20220906154143-22187
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-20220906154143-22187 -n old-k8s-version-20220906154143-22187: exit status 6 (425.886549ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0906 15:45:54.958819 36459 status.go:413] kubeconfig endpoint: extract IP: "old-k8s-version-20220906154143-22187" does not appear in /Users/jenkins/minikube-integration/darwin-amd64-docker--14848-20969-b63acb7dafa1eea311309da4a351492ab3bac7a2/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-20220906154143-22187" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (251.27s)