=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-darwin-amd64 start -p old-k8s-version-20220801172716-13911 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0
E0801 17:27:21.475714 13911 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/auto-20220801171037-13911/client.crt: no such file or directory
E0801 17:27:37.499102 13911 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/addons-20220801163530-13911/client.crt: no such file or directory
E0801 17:27:39.135609 13911 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/functional-20220801163958-13911/client.crt: no such file or directory
E0801 17:27:50.318707 13911 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/kindnet-20220801171038-13911/client.crt: no such file or directory
E0801 17:27:50.325055 13911 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/kindnet-20220801171038-13911/client.crt: no such file or directory
E0801 17:27:50.335386 13911 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/kindnet-20220801171038-13911/client.crt: no such file or directory
E0801 17:27:50.357559 13911 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/kindnet-20220801171038-13911/client.crt: no such file or directory
E0801 17:27:50.398288 13911 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/kindnet-20220801171038-13911/client.crt: no such file or directory
E0801 17:27:50.479572 13911 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/kindnet-20220801171038-13911/client.crt: no such file or directory
E0801 17:27:50.640827 13911 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/kindnet-20220801171038-13911/client.crt: no such file or directory
E0801 17:27:50.960933 13911 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/kindnet-20220801171038-13911/client.crt: no such file or directory
E0801 17:27:51.601078 13911 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/kindnet-20220801171038-13911/client.crt: no such file or directory
E0801 17:27:52.882981 13911 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/kindnet-20220801171038-13911/client.crt: no such file or directory
E0801 17:27:55.444605 13911 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/kindnet-20220801171038-13911/client.crt: no such file or directory
E0801 17:28:00.564811 13911 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/kindnet-20220801171038-13911/client.crt: no such file or directory
=== CONT TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-20220801172716-13911 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0: exit status 109 (4m11.668697595s)
-- stdout --
* [old-k8s-version-20220801172716-13911] minikube v1.26.0 on Darwin 12.5
- MINIKUBE_LOCATION=14695
- KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube
* Using the docker driver based on user configuration
* Using Docker Desktop driver with root privileges
* Starting control plane node old-k8s-version-20220801172716-13911 in cluster old-k8s-version-20220801172716-13911
* Pulling base image ...
* Creating docker container (CPUs=2, Memory=2200MB) ...
* Preparing Kubernetes v1.16.0 on Docker 20.10.17 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0801 17:27:17.029215 29409 out.go:296] Setting OutFile to fd 1 ...
I0801 17:27:17.029453 29409 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0801 17:27:17.029459 29409 out.go:309] Setting ErrFile to fd 2...
I0801 17:27:17.029463 29409 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0801 17:27:17.029570 29409 root.go:333] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/bin
I0801 17:27:17.030101 29409 out.go:303] Setting JSON to false
I0801 17:27:17.046033 29409 start.go:115] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":8808,"bootTime":1659391229,"procs":380,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"12.5","kernelVersion":"21.6.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
W0801 17:27:17.046149 29409 start.go:123] gopshost.Virtualization returned error: not implemented yet
I0801 17:27:17.068097 29409 out.go:177] * [old-k8s-version-20220801172716-13911] minikube v1.26.0 on Darwin 12.5
I0801 17:27:17.110302 29409 notify.go:193] Checking for updates...
I0801 17:27:17.132222 29409 out.go:177] - MINIKUBE_LOCATION=14695
I0801 17:27:17.174206 29409 out.go:177] - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/kubeconfig
I0801 17:27:17.217018 29409 out.go:177] - MINIKUBE_BIN=out/minikube-darwin-amd64
I0801 17:27:17.252683 29409 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0801 17:27:17.350183 29409 out.go:177] - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube
I0801 17:27:17.388001 29409 config.go:180] Loaded profile config "kubenet-20220801171037-13911": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.24.3
I0801 17:27:17.388106 29409 driver.go:365] Setting default libvirt URI to qemu:///system
I0801 17:27:17.457362 29409 docker.go:137] docker version: linux-20.10.17
I0801 17:27:17.457498 29409 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0801 17:27:17.594455 29409 info.go:265] docker info: {ID:6EC6:JPLU:RBE2:YGXQ:7MKM:SZ2E:QGJY:D2A4:RMXP:2SNY:SIQG:GTNP Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:false NGoroutines:64 SystemTime:2022-08-02 00:27:17.5236131 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.104-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServe
rAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6232580096 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default
name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.1] map[Name:extension Path:/usr/local/lib/docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.7] map[Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
I0801 17:27:17.619267 29409 out.go:177] * Using the docker driver based on user configuration
I0801 17:27:17.640325 29409 start.go:284] selected driver: docker
I0801 17:27:17.640348 29409 start.go:808] validating driver "docker" against <nil>
I0801 17:27:17.640369 29409 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0801 17:27:17.642547 29409 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0801 17:27:17.778000 29409 info.go:265] docker info: {ID:6EC6:JPLU:RBE2:YGXQ:7MKM:SZ2E:QGJY:D2A4:RMXP:2SNY:SIQG:GTNP Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:48 OomKillDisable:false NGoroutines:59 SystemTime:2022-08-02 00:27:17.707239503 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.104-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexSer
verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6232580096 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 Expected:10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1} RuncCommit:{ID:v1.1.2-0-ga916309 Expected:v1.1.2-0-ga916309} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=defau
lt name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.1] map[Name:extension Path:/usr/local/lib/docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.7] map[Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
I0801 17:27:17.778123 29409 start_flags.go:296] no existing cluster config was found, will generate one from the flags
I0801 17:27:17.778276 29409 start_flags.go:853] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0801 17:27:17.806903 29409 out.go:177] * Using Docker Desktop driver with root privileges
I0801 17:27:17.827088 29409 cni.go:95] Creating CNI manager for ""
I0801 17:27:17.827125 29409 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I0801 17:27:17.827143 29409 start_flags.go:310] config:
{Name:old-k8s-version-20220801172716-13911 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1659115536-14579@sha256:73b259e144d926189cf169ae5b46bbec4e08e4e2f2bd87296054c3244f70feb8 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220801172716-13911 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSD
omain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
I0801 17:27:17.848819 29409 out.go:177] * Starting control plane node old-k8s-version-20220801172716-13911 in cluster old-k8s-version-20220801172716-13911
I0801 17:27:17.890936 29409 cache.go:120] Beginning downloading kic base image for docker with docker
I0801 17:27:17.927947 29409 out.go:177] * Pulling base image ...
I0801 17:27:17.985853 29409 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1659115536-14579@sha256:73b259e144d926189cf169ae5b46bbec4e08e4e2f2bd87296054c3244f70feb8 in local docker daemon
I0801 17:27:17.985857 29409 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0801 17:27:17.985933 29409 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4
I0801 17:27:17.985952 29409 cache.go:57] Caching tarball of preloaded images
I0801 17:27:17.986160 29409 preload.go:174] Found /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0801 17:27:17.986176 29409 cache.go:60] Finished verifying existence of preloaded tar for v1.16.0 on docker
I0801 17:27:17.987181 29409 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/config.json ...
I0801 17:27:17.987319 29409 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/config.json: {Name:mk3e29e0882b46e9c2d1f24ef99bd644b49cf327 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0801 17:27:18.050619 29409 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1659115536-14579@sha256:73b259e144d926189cf169ae5b46bbec4e08e4e2f2bd87296054c3244f70feb8 in local docker daemon, skipping pull
I0801 17:27:18.050637 29409 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1659115536-14579@sha256:73b259e144d926189cf169ae5b46bbec4e08e4e2f2bd87296054c3244f70feb8 exists in daemon, skipping load
I0801 17:27:18.050647 29409 cache.go:208] Successfully downloaded all kic artifacts
I0801 17:27:18.050686 29409 start.go:371] acquiring machines lock for old-k8s-version-20220801172716-13911: {Name:mkbe9b0aeba6b12111b317502f6798dbe4170df1 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0801 17:27:18.050818 29409 start.go:375] acquired machines lock for "old-k8s-version-20220801172716-13911" in 121.265µs
I0801 17:27:18.050844 29409 start.go:92] Provisioning new machine with config: &{Name:old-k8s-version-20220801172716-13911 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1659115536-14579@sha256:73b259e144d926189cf169ae5b46bbec4e08e4e2f2bd87296054c3244f70feb8 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220801172716-13911
Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMi
rror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0801 17:27:18.050911 29409 start.go:132] createHost starting for "" (driver="docker")
I0801 17:27:18.094594 29409 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0801 17:27:18.094950 29409 start.go:166] libmachine.API.Create for "old-k8s-version-20220801172716-13911" (driver="docker")
I0801 17:27:18.095002 29409 client.go:168] LocalClient.Create starting
I0801 17:27:18.095116 29409 main.go:134] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/ca.pem
I0801 17:27:18.095176 29409 main.go:134] libmachine: Decoding PEM data...
I0801 17:27:18.095202 29409 main.go:134] libmachine: Parsing certificate...
I0801 17:27:18.095283 29409 main.go:134] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/cert.pem
I0801 17:27:18.095337 29409 main.go:134] libmachine: Decoding PEM data...
I0801 17:27:18.095356 29409 main.go:134] libmachine: Parsing certificate...
I0801 17:27:18.096097 29409 cli_runner.go:164] Run: docker network inspect old-k8s-version-20220801172716-13911 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0801 17:27:18.161920 29409 cli_runner.go:211] docker network inspect old-k8s-version-20220801172716-13911 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0801 17:27:18.162012 29409 network_create.go:272] running [docker network inspect old-k8s-version-20220801172716-13911] to gather additional debugging logs...
I0801 17:27:18.162032 29409 cli_runner.go:164] Run: docker network inspect old-k8s-version-20220801172716-13911
W0801 17:27:18.226131 29409 cli_runner.go:211] docker network inspect old-k8s-version-20220801172716-13911 returned with exit code 1
I0801 17:27:18.226156 29409 network_create.go:275] error running [docker network inspect old-k8s-version-20220801172716-13911]: docker network inspect old-k8s-version-20220801172716-13911: exit status 1
stdout:
[]
stderr:
Error: No such network: old-k8s-version-20220801172716-13911
I0801 17:27:18.226181 29409 network_create.go:277] output of [docker network inspect old-k8s-version-20220801172716-13911]: -- stdout --
[]
-- /stdout --
** stderr **
Error: No such network: old-k8s-version-20220801172716-13911
** /stderr **
I0801 17:27:18.226252 29409 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0801 17:27:18.291213 29409 network.go:288] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc0004126b8] misses:0}
I0801 17:27:18.291253 29409 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0801 17:27:18.291270 29409 network_create.go:115] attempt to create docker network old-k8s-version-20220801172716-13911 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0801 17:27:18.291338 29409 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220801172716-13911 old-k8s-version-20220801172716-13911
W0801 17:27:18.360343 29409 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220801172716-13911 old-k8s-version-20220801172716-13911 returned with exit code 1
W0801 17:27:18.360380 29409 network_create.go:107] failed to create docker network old-k8s-version-20220801172716-13911 192.168.49.0/24, will retry: subnet is taken
I0801 17:27:18.360667 29409 network.go:279] skipping subnet 192.168.49.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc0004126b8] amended:false}} dirty:map[] misses:0}
I0801 17:27:18.360685 29409 network.go:238] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0801 17:27:18.360892 29409 network.go:288] reserving subnet 192.168.58.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc0004126b8] amended:true}} dirty:map[192.168.49.0:0xc0004126b8 192.168.58.0:0xc00040e3e8] misses:0}
I0801 17:27:18.360912 29409 network.go:235] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0801 17:27:18.360920 29409 network_create.go:115] attempt to create docker network old-k8s-version-20220801172716-13911 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ...
I0801 17:27:18.360984 29409 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220801172716-13911 old-k8s-version-20220801172716-13911
W0801 17:27:18.429710 29409 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220801172716-13911 old-k8s-version-20220801172716-13911 returned with exit code 1
W0801 17:27:18.429754 29409 network_create.go:107] failed to create docker network old-k8s-version-20220801172716-13911 192.168.58.0/24, will retry: subnet is taken
I0801 17:27:18.430039 29409 network.go:279] skipping subnet 192.168.58.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc0004126b8] amended:true}} dirty:map[192.168.49.0:0xc0004126b8 192.168.58.0:0xc00040e3e8] misses:1}
I0801 17:27:18.430057 29409 network.go:238] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0801 17:27:18.430292 29409 network.go:288] reserving subnet 192.168.67.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc0004126b8] amended:true}} dirty:map[192.168.49.0:0xc0004126b8 192.168.58.0:0xc00040e3e8 192.168.67.0:0xc000f284b0] misses:1}
I0801 17:27:18.430308 29409 network.go:235] using free private subnet 192.168.67.0/24: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0801 17:27:18.430317 29409 network_create.go:115] attempt to create docker network old-k8s-version-20220801172716-13911 192.168.67.0/24 with gateway 192.168.67.1 and MTU of 1500 ...
I0801 17:27:18.430384 29409 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220801172716-13911 old-k8s-version-20220801172716-13911
W0801 17:27:18.498528 29409 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220801172716-13911 old-k8s-version-20220801172716-13911 returned with exit code 1
W0801 17:27:18.498563 29409 network_create.go:107] failed to create docker network old-k8s-version-20220801172716-13911 192.168.67.0/24, will retry: subnet is taken
I0801 17:27:18.498828 29409 network.go:279] skipping subnet 192.168.67.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc0004126b8] amended:true}} dirty:map[192.168.49.0:0xc0004126b8 192.168.58.0:0xc00040e3e8 192.168.67.0:0xc000f284b0] misses:2}
I0801 17:27:18.498846 29409 network.go:238] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0801 17:27:18.499067 29409 network.go:288] reserving subnet 192.168.76.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc0004126b8] amended:true}} dirty:map[192.168.49.0:0xc0004126b8 192.168.58.0:0xc00040e3e8 192.168.67.0:0xc000f284b0 192.168.76.0:0xc000f284e8] misses:2}
I0801 17:27:18.499080 29409 network.go:235] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0801 17:27:18.499087 29409 network_create.go:115] attempt to create docker network old-k8s-version-20220801172716-13911 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I0801 17:27:18.499149 29409 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-20220801172716-13911 old-k8s-version-20220801172716-13911
I0801 17:27:18.611000 29409 network_create.go:99] docker network old-k8s-version-20220801172716-13911 192.168.76.0/24 created
I0801 17:27:18.611033 29409 kic.go:106] calculated static IP "192.168.76.2" for the "old-k8s-version-20220801172716-13911" container
I0801 17:27:18.611152 29409 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0801 17:27:18.680998 29409 cli_runner.go:164] Run: docker volume create old-k8s-version-20220801172716-13911 --label name.minikube.sigs.k8s.io=old-k8s-version-20220801172716-13911 --label created_by.minikube.sigs.k8s.io=true
I0801 17:27:18.753329 29409 oci.go:103] Successfully created a docker volume old-k8s-version-20220801172716-13911
I0801 17:27:18.753471 29409 cli_runner.go:164] Run: docker run --rm --name old-k8s-version-20220801172716-13911-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-20220801172716-13911 --entrypoint /usr/bin/test -v old-k8s-version-20220801172716-13911:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1659115536-14579@sha256:73b259e144d926189cf169ae5b46bbec4e08e4e2f2bd87296054c3244f70feb8 -d /var/lib
I0801 17:27:19.487702 29409 oci.go:107] Successfully prepared a docker volume old-k8s-version-20220801172716-13911
I0801 17:27:19.487747 29409 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0801 17:27:19.487762 29409 kic.go:179] Starting extracting preloaded images to volume ...
I0801 17:27:19.487853 29409 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-20220801172716-13911:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1659115536-14579@sha256:73b259e144d926189cf169ae5b46bbec4e08e4e2f2bd87296054c3244f70feb8 -I lz4 -xf /preloaded.tar -C /extractDir
I0801 17:27:24.301649 29409 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-20220801172716-13911:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1659115536-14579@sha256:73b259e144d926189cf169ae5b46bbec4e08e4e2f2bd87296054c3244f70feb8 -I lz4 -xf /preloaded.tar -C /extractDir: (4.813667506s)
I0801 17:27:24.301675 29409 kic.go:188] duration metric: took 4.813859 seconds to extract preloaded images to volume
I0801 17:27:24.301777 29409 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0801 17:27:24.440753 29409 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname old-k8s-version-20220801172716-13911 --name old-k8s-version-20220801172716-13911 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-20220801172716-13911 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=old-k8s-version-20220801172716-13911 --network old-k8s-version-20220801172716-13911 --ip 192.168.76.2 --volume old-k8s-version-20220801172716-13911:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=8443 --publish=22 --publish=2376 --publish=5000 --publish=32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1659115536-14579@sha256:73b259e144d926189cf169ae5b46bbec4e08e4e2f2bd87296054c3244f70feb8
I0801 17:27:24.984380 29409 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220801172716-13911 --format={{.State.Running}}
I0801 17:27:25.074414 29409 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220801172716-13911 --format={{.State.Status}}
I0801 17:27:25.162879 29409 cli_runner.go:164] Run: docker exec old-k8s-version-20220801172716-13911 stat /var/lib/dpkg/alternatives/iptables
I0801 17:27:25.301851 29409 oci.go:144] the created container "old-k8s-version-20220801172716-13911" has a running status.
I0801 17:27:25.301881 29409 kic.go:210] Creating ssh key for kic: /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/machines/old-k8s-version-20220801172716-13911/id_rsa...
I0801 17:27:25.345827 29409 kic_runner.go:191] docker (temp): /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/machines/old-k8s-version-20220801172716-13911/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0801 17:27:25.466060 29409 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220801172716-13911 --format={{.State.Status}}
I0801 17:27:25.541364 29409 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0801 17:27:25.541385 29409 kic_runner.go:114] Args: [docker exec --privileged old-k8s-version-20220801172716-13911 chown docker:docker /home/docker/.ssh/authorized_keys]
I0801 17:27:25.672815 29409 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220801172716-13911 --format={{.State.Status}}
I0801 17:27:25.745831 29409 machine.go:88] provisioning docker machine ...
I0801 17:27:25.745882 29409 ubuntu.go:169] provisioning hostname "old-k8s-version-20220801172716-13911"
I0801 17:27:25.745990 29409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220801172716-13911
I0801 17:27:25.817179 29409 main.go:134] libmachine: Using SSH client type: native
I0801 17:27:25.817379 29409 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2e20] 0x13d5e80 <nil> [] 0s} 127.0.0.1 50175 <nil> <nil>}
I0801 17:27:25.817395 29409 main.go:134] libmachine: About to run SSH command:
sudo hostname old-k8s-version-20220801172716-13911 && echo "old-k8s-version-20220801172716-13911" | sudo tee /etc/hostname
I0801 17:27:25.938824 29409 main.go:134] libmachine: SSH cmd err, output: <nil>: old-k8s-version-20220801172716-13911
I0801 17:27:25.938924 29409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220801172716-13911
I0801 17:27:26.010484 29409 main.go:134] libmachine: Using SSH client type: native
I0801 17:27:26.010636 29409 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2e20] 0x13d5e80 <nil> [] 0s} 127.0.0.1 50175 <nil> <nil>}
I0801 17:27:26.010665 29409 main.go:134] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-20220801172716-13911' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-20220801172716-13911/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-20220801172716-13911' | sudo tee -a /etc/hosts;
fi
fi
I0801 17:27:26.122370 29409 main.go:134] libmachine: SSH cmd err, output: <nil>:
I0801 17:27:26.122393 29409 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube CaCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/key.pem ServerCertRemotePath:/etc/doc
ker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube}
I0801 17:27:26.122417 29409 ubuntu.go:177] setting up certificates
I0801 17:27:26.122427 29409 provision.go:83] configureAuth start
I0801 17:27:26.122521 29409 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220801172716-13911
I0801 17:27:26.193894 29409 provision.go:138] copyHostCerts
I0801 17:27:26.193983 29409 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/ca.pem, removing ...
I0801 17:27:26.193993 29409 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/ca.pem
I0801 17:27:26.194093 29409 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/ca.pem (1082 bytes)
I0801 17:27:26.194284 29409 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/cert.pem, removing ...
I0801 17:27:26.194294 29409 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/cert.pem
I0801 17:27:26.194359 29409 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/cert.pem (1123 bytes)
I0801 17:27:26.194493 29409 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/key.pem, removing ...
I0801 17:27:26.194502 29409 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/key.pem
I0801 17:27:26.194569 29409 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/key.pem (1679 bytes)
I0801 17:27:26.194755 29409 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-20220801172716-13911 san=[192.168.76.2 127.0.0.1 localhost 127.0.0.1 minikube old-k8s-version-20220801172716-13911]
I0801 17:27:26.280243 29409 provision.go:172] copyRemoteCerts
I0801 17:27:26.280305 29409 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0801 17:27:26.280356 29409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220801172716-13911
I0801 17:27:26.351397 29409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50175 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/machines/old-k8s-version-20220801172716-13911/id_rsa Username:docker}
I0801 17:27:26.433446 29409 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0801 17:27:26.451661 29409 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/machines/server.pem --> /etc/docker/server.pem (1281 bytes)
I0801 17:27:26.468724 29409 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0801 17:27:26.486810 29409 provision.go:86] duration metric: configureAuth took 364.366498ms
I0801 17:27:26.486823 29409 ubuntu.go:193] setting minikube options for container-runtime
I0801 17:27:26.486959 29409 config.go:180] Loaded profile config "old-k8s-version-20220801172716-13911": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
I0801 17:27:26.487017 29409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220801172716-13911
I0801 17:27:26.558602 29409 main.go:134] libmachine: Using SSH client type: native
I0801 17:27:26.558769 29409 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2e20] 0x13d5e80 <nil> [] 0s} 127.0.0.1 50175 <nil> <nil>}
I0801 17:27:26.558790 29409 main.go:134] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0801 17:27:26.672406 29409 main.go:134] libmachine: SSH cmd err, output: <nil>: overlay
I0801 17:27:26.672418 29409 ubuntu.go:71] root file system type: overlay
I0801 17:27:26.672575 29409 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0801 17:27:26.672655 29409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220801172716-13911
I0801 17:27:26.745236 29409 main.go:134] libmachine: Using SSH client type: native
I0801 17:27:26.745389 29409 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2e20] 0x13d5e80 <nil> [] 0s} 127.0.0.1 50175 <nil> <nil>}
I0801 17:27:26.745442 29409 main.go:134] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0801 17:27:26.864739 29409 main.go:134] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0801 17:27:26.864817 29409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220801172716-13911
I0801 17:27:26.937160 29409 main.go:134] libmachine: Using SSH client type: native
I0801 17:27:26.937303 29409 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x13d2e20] 0x13d5e80 <nil> [] 0s} 127.0.0.1 50175 <nil> <nil>}
I0801 17:27:26.937316 29409 main.go:134] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0801 17:27:27.509244 29409 main.go:134] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2022-06-06 23:01:03.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2022-08-02 00:27:26.875596118 +0000
@@ -1,30 +1,32 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
Wants=network-online.target
-Requires=docker.socket containerd.service
+Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutSec=0
-RestartSec=2
-Restart=always
-
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
+Restart=on-failure
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
@@ -32,16 +34,16 @@
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0801 17:27:27.509275 29409 machine.go:91] provisioned docker machine in 1.763407147s
I0801 17:27:27.509284 29409 client.go:171] LocalClient.Create took 9.414172324s
I0801 17:27:27.509300 29409 start.go:174] duration metric: libmachine.API.Create for "old-k8s-version-20220801172716-13911" took 9.41424859s
I0801 17:27:27.509307 29409 start.go:307] post-start starting for "old-k8s-version-20220801172716-13911" (driver="docker")
I0801 17:27:27.509317 29409 start.go:335] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0801 17:27:27.509392 29409 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0801 17:27:27.509444 29409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220801172716-13911
I0801 17:27:27.581559 29409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50175 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/machines/old-k8s-version-20220801172716-13911/id_rsa Username:docker}
I0801 17:27:27.666159 29409 ssh_runner.go:195] Run: cat /etc/os-release
I0801 17:27:27.670192 29409 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0801 17:27:27.670209 29409 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0801 17:27:27.670216 29409 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0801 17:27:27.670221 29409 info.go:137] Remote host: Ubuntu 20.04.4 LTS
I0801 17:27:27.670231 29409 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/addons for local assets ...
I0801 17:27:27.670338 29409 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/files for local assets ...
I0801 17:27:27.670492 29409 filesync.go:149] local asset: /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/files/etc/ssl/certs/139112.pem -> 139112.pem in /etc/ssl/certs
I0801 17:27:27.670656 29409 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0801 17:27:27.678280 29409 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/files/etc/ssl/certs/139112.pem --> /etc/ssl/certs/139112.pem (1708 bytes)
I0801 17:27:27.696246 29409 start.go:310] post-start completed in 186.922845ms
I0801 17:27:27.696733 29409 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220801172716-13911
I0801 17:27:27.770173 29409 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/config.json ...
I0801 17:27:27.770576 29409 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0801 17:27:27.770627 29409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220801172716-13911
I0801 17:27:27.842767 29409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50175 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/machines/old-k8s-version-20220801172716-13911/id_rsa Username:docker}
I0801 17:27:27.922181 29409 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0801 17:27:27.926886 29409 start.go:135] duration metric: createHost completed in 9.875856711s
I0801 17:27:27.926905 29409 start.go:82] releasing machines lock for "old-k8s-version-20220801172716-13911", held for 9.875969627s
I0801 17:27:27.926987 29409 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20220801172716-13911
I0801 17:27:28.010549 29409 ssh_runner.go:195] Run: systemctl --version
I0801 17:27:28.010551 29409 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
I0801 17:27:28.010608 29409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220801172716-13911
I0801 17:27:28.010622 29409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220801172716-13911
I0801 17:27:28.091239 29409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50175 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/machines/old-k8s-version-20220801172716-13911/id_rsa Username:docker}
I0801 17:27:28.094898 29409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50175 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/machines/old-k8s-version-20220801172716-13911/id_rsa Username:docker}
I0801 17:27:28.366956 29409 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0801 17:27:28.380185 29409 cruntime.go:273] skipping containerd shutdown because we are bound to it
I0801 17:27:28.380248 29409 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0801 17:27:28.389386 29409 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
image-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0801 17:27:28.402198 29409 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0801 17:27:28.463877 29409 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0801 17:27:28.535480 29409 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0801 17:27:28.604990 29409 ssh_runner.go:195] Run: sudo systemctl restart docker
I0801 17:27:28.834418 29409 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0801 17:27:28.871116 29409 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0801 17:27:28.958158 29409 out.go:204] * Preparing Kubernetes v1.16.0 on Docker 20.10.17 ...
I0801 17:27:28.958280 29409 cli_runner.go:164] Run: docker exec -t old-k8s-version-20220801172716-13911 dig +short host.docker.internal
I0801 17:27:29.084993 29409 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2
I0801 17:27:29.085097 29409 ssh_runner.go:195] Run: grep 192.168.65.2 host.minikube.internal$ /etc/hosts
I0801 17:27:29.089395 29409 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0801 17:27:29.099279 29409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-20220801172716-13911
I0801 17:27:29.173199 29409 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0801 17:27:29.173263 29409 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0801 17:27:29.203744 29409 docker.go:611] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0801 17:27:29.203759 29409 docker.go:542] Images already preloaded, skipping extraction
I0801 17:27:29.203825 29409 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0801 17:27:29.235250 29409 docker.go:611] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0801 17:27:29.235274 29409 cache_images.go:84] Images are preloaded, skipping loading
I0801 17:27:29.235918 29409 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0801 17:27:29.321239 29409 cni.go:95] Creating CNI manager for ""
I0801 17:27:29.321252 29409 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I0801 17:27:29.321264 29409 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0801 17:27:29.321278 29409 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-20220801172716-13911 NodeName:old-k8s-version-20220801172716-13911 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.76.2 CgroupDriver:systemd Clien
tCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
I0801 17:27:29.321384 29409 kubeadm.go:162] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-20220801172716-13911"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-20220801172716-13911
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.76.2:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0801 17:27:29.321456 29409 kubeadm.go:961] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-20220801172716-13911 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220801172716-13911 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0801 17:27:29.321526 29409 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0801 17:27:29.338562 29409 binaries.go:44] Found k8s binaries, skipping transfer
I0801 17:27:29.338626 29409 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0801 17:27:29.347183 29409 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (362 bytes)
I0801 17:27:29.362835 29409 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0801 17:27:29.375372 29409 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2148 bytes)
I0801 17:27:29.389039 29409 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0801 17:27:29.392909 29409 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0801 17:27:29.403897 29409 certs.go:54] Setting up /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911 for IP: 192.168.76.2
I0801 17:27:29.403990 29409 certs.go:182] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/ca.key
I0801 17:27:29.404040 29409 certs.go:182] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/proxy-client-ca.key
I0801 17:27:29.404078 29409 certs.go:302] generating minikube-user signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/client.key
I0801 17:27:29.404092 29409 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/client.crt with IP's: []
I0801 17:27:29.660348 29409 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/client.crt ...
I0801 17:27:29.660362 29409 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/client.crt: {Name:mkcd0d7a89e25e76af33427ab28101c68b245d86 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0801 17:27:29.660749 29409 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/client.key ...
I0801 17:27:29.660760 29409 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/client.key: {Name:mk846509a4b47df78929254062f74e4623c87231 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0801 17:27:29.661006 29409 certs.go:302] generating minikube signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/apiserver.key.31bdca25
I0801 17:27:29.661024 29409 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/apiserver.crt.31bdca25 with IP's: [192.168.76.2 10.96.0.1 127.0.0.1 10.0.0.1]
I0801 17:27:29.698089 29409 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/apiserver.crt.31bdca25 ...
I0801 17:27:29.698100 29409 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/apiserver.crt.31bdca25: {Name:mk690d16d2b5b37369b51dfcd196d4a4c6ef9217 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0801 17:27:29.698376 29409 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/apiserver.key.31bdca25 ...
I0801 17:27:29.698384 29409 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/apiserver.key.31bdca25: {Name:mkc356c0aad5fd94b2857abcc304aefb71eb526e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0801 17:27:29.698581 29409 certs.go:320] copying /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/apiserver.crt.31bdca25 -> /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/apiserver.crt
I0801 17:27:29.698741 29409 certs.go:324] copying /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/apiserver.key.31bdca25 -> /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/apiserver.key
I0801 17:27:29.698917 29409 certs.go:302] generating aggregator signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/proxy-client.key
I0801 17:27:29.698935 29409 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/proxy-client.crt with IP's: []
I0801 17:27:29.824419 29409 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/proxy-client.crt ...
I0801 17:27:29.824442 29409 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/proxy-client.crt: {Name:mk75268efac535739c3374329bf9cfa043ea365d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0801 17:27:29.824868 29409 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/proxy-client.key ...
I0801 17:27:29.824887 29409 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/proxy-client.key: {Name:mkb8a1b43862fe08ddb9fffc0e6591f35327f0d3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0801 17:27:29.825433 29409 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/13911.pem (1338 bytes)
W0801 17:27:29.825474 29409 certs.go:384] ignoring /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/13911_empty.pem, impossibly tiny 0 bytes
I0801 17:27:29.825483 29409 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/ca-key.pem (1679 bytes)
I0801 17:27:29.825511 29409 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/ca.pem (1082 bytes)
I0801 17:27:29.825543 29409 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/cert.pem (1123 bytes)
I0801 17:27:29.825573 29409 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/key.pem (1679 bytes)
I0801 17:27:29.825636 29409 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/files/etc/ssl/certs/139112.pem (1708 bytes)
I0801 17:27:29.826051 29409 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0801 17:27:29.844868 29409 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0801 17:27:29.863258 29409 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0801 17:27:29.880990 29409 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/profiles/old-k8s-version-20220801172716-13911/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0801 17:27:29.898887 29409 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0801 17:27:29.916536 29409 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0801 17:27:29.935588 29409 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0801 17:27:29.954944 29409 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0801 17:27:29.974512 29409 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/files/etc/ssl/certs/139112.pem --> /usr/share/ca-certificates/139112.pem (1708 bytes)
I0801 17:27:29.994294 29409 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0801 17:27:30.014244 29409 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/.minikube/certs/13911.pem --> /usr/share/ca-certificates/13911.pem (1338 bytes)
I0801 17:27:30.035561 29409 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0801 17:27:30.049862 29409 ssh_runner.go:195] Run: openssl version
I0801 17:27:30.056165 29409 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/13911.pem && ln -fs /usr/share/ca-certificates/13911.pem /etc/ssl/certs/13911.pem"
I0801 17:27:30.064428 29409 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/13911.pem
I0801 17:27:30.068118 29409 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Aug 1 23:39 /usr/share/ca-certificates/13911.pem
I0801 17:27:30.068162 29409 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/13911.pem
I0801 17:27:30.073520 29409 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/13911.pem /etc/ssl/certs/51391683.0"
I0801 17:27:30.081928 29409 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/139112.pem && ln -fs /usr/share/ca-certificates/139112.pem /etc/ssl/certs/139112.pem"
I0801 17:27:30.090153 29409 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/139112.pem
I0801 17:27:30.094178 29409 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Aug 1 23:39 /usr/share/ca-certificates/139112.pem
I0801 17:27:30.094228 29409 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/139112.pem
I0801 17:27:30.099919 29409 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/139112.pem /etc/ssl/certs/3ec20f2e.0"
I0801 17:27:30.108017 29409 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0801 17:27:30.116357 29409 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0801 17:27:30.120503 29409 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Aug 1 23:36 /usr/share/ca-certificates/minikubeCA.pem
I0801 17:27:30.120546 29409 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0801 17:27:30.126162 29409 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0801 17:27:30.134391 29409 kubeadm.go:395] StartCluster: {Name:old-k8s-version-20220801172716-13911 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1659115536-14579@sha256:73b259e144d926189cf169ae5b46bbec4e08e4e2f2bd87296054c3244f70feb8 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-20220801172716-13911 Namespace:default API
ServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disa
bleOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
I0801 17:27:30.134487 29409 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0801 17:27:30.166487 29409 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0801 17:27:30.174293 29409 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0801 17:27:30.181983 29409 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I0801 17:27:30.182036 29409 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0801 17:27:30.189499 29409 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0801 17:27:30.189521 29409 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0801 17:27:31.024940 29409 out.go:204] - Generating certificates and keys ...
I0801 17:27:33.688442 29409 out.go:204] - Booting up control plane ...
W0801 17:29:28.628289 29409 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-20220801172716-13911 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-20220801172716-13911 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-20220801172716-13911 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-20220801172716-13911 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0801 17:29:28.628335 29409 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"
I0801 17:29:29.051888 29409 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0801 17:29:29.061714 29409 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I0801 17:29:29.061778 29409 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0801 17:29:29.071331 29409 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0801 17:29:29.071356 29409 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0801 17:29:29.852809 29409 out.go:204] - Generating certificates and keys ...
I0801 17:29:31.093651 29409 out.go:204] - Booting up control plane ...
I0801 17:31:26.010888 29409 kubeadm.go:397] StartCluster complete in 3m55.873905981s
I0801 17:31:26.010962 29409 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0801 17:31:26.041109 29409 logs.go:274] 0 containers: []
W0801 17:31:26.041122 29409 logs.go:276] No container was found matching "kube-apiserver"
I0801 17:31:26.041180 29409 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0801 17:31:26.069359 29409 logs.go:274] 0 containers: []
W0801 17:31:26.069372 29409 logs.go:276] No container was found matching "etcd"
I0801 17:31:26.069428 29409 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0801 17:31:26.097973 29409 logs.go:274] 0 containers: []
W0801 17:31:26.097985 29409 logs.go:276] No container was found matching "coredns"
I0801 17:31:26.098048 29409 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0801 17:31:26.126294 29409 logs.go:274] 0 containers: []
W0801 17:31:26.126307 29409 logs.go:276] No container was found matching "kube-scheduler"
I0801 17:31:26.126366 29409 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0801 17:31:26.155467 29409 logs.go:274] 0 containers: []
W0801 17:31:26.155480 29409 logs.go:276] No container was found matching "kube-proxy"
I0801 17:31:26.155537 29409 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0801 17:31:26.184624 29409 logs.go:274] 0 containers: []
W0801 17:31:26.184641 29409 logs.go:276] No container was found matching "kubernetes-dashboard"
I0801 17:31:26.184707 29409 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0801 17:31:26.214097 29409 logs.go:274] 0 containers: []
W0801 17:31:26.214108 29409 logs.go:276] No container was found matching "storage-provisioner"
I0801 17:31:26.214169 29409 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0801 17:31:26.242971 29409 logs.go:274] 0 containers: []
W0801 17:31:26.242983 29409 logs.go:276] No container was found matching "kube-controller-manager"
I0801 17:31:26.242995 29409 logs.go:123] Gathering logs for kubelet ...
I0801 17:31:26.243004 29409 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0801 17:31:26.281860 29409 logs.go:123] Gathering logs for dmesg ...
I0801 17:31:26.281875 29409 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0801 17:31:26.294257 29409 logs.go:123] Gathering logs for describe nodes ...
I0801 17:31:26.294271 29409 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0801 17:31:26.351249 29409 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0801 17:31:26.351263 29409 logs.go:123] Gathering logs for Docker ...
I0801 17:31:26.351270 29409 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400"
I0801 17:31:26.367391 29409 logs.go:123] Gathering logs for container status ...
I0801 17:31:26.367405 29409 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0801 17:31:28.420802 29409 ssh_runner.go:235] Completed: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": (2.053362663s)
W0801 17:31:28.420955 29409 out.go:369] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0801 17:31:28.420972 29409 out.go:239] *
*
W0801 17:31:28.421085 29409 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0801 17:31:28.421113 29409 out.go:239] *
*
W0801 17:31:28.421609 29409 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0801 17:31:28.485526 29409 out.go:177]
W0801 17:31:28.527438 29409 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Swap]: running with swap on is not supported. Please disable swap
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.17. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0801 17:31:28.527578 29409 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0801 17:31:28.527690 29409 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0801 17:31:28.586394 29409 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p old-k8s-version-20220801172716-13911 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.16.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-20220801172716-13911
helpers_test.go:235: (dbg) docker inspect old-k8s-version-20220801172716-13911:
-- stdout --
[
{
"Id": "dfb69a53356501367b36570fa5295eb3938cba435699a600a5f053a9987c8da6",
"Created": "2022-08-02T00:27:24.523444703Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 225285,
"ExitCode": 0,
"Error": "",
"StartedAt": "2022-08-02T00:27:24.983745258Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:b7ab23e982777465b97377a568e561067cf1b32ea520e8cd32f5ec0b95d538ab",
"ResolvConfPath": "/var/lib/docker/containers/dfb69a53356501367b36570fa5295eb3938cba435699a600a5f053a9987c8da6/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/dfb69a53356501367b36570fa5295eb3938cba435699a600a5f053a9987c8da6/hostname",
"HostsPath": "/var/lib/docker/containers/dfb69a53356501367b36570fa5295eb3938cba435699a600a5f053a9987c8da6/hosts",
"LogPath": "/var/lib/docker/containers/dfb69a53356501367b36570fa5295eb3938cba435699a600a5f053a9987c8da6/dfb69a53356501367b36570fa5295eb3938cba435699a600a5f053a9987c8da6-json.log",
"Name": "/old-k8s-version-20220801172716-13911",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-20220801172716-13911:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-20220801172716-13911",
"PortBindings": {
"22/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"2376/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"32443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"5000/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
],
"8443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "0"
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"ConsoleSize": [
0,
0
],
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": null,
"BlkioDeviceWriteBps": null,
"BlkioDeviceReadIOps": null,
"BlkioDeviceWriteIOps": null,
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"KernelMemory": 0,
"KernelMemoryTCP": 0,
"MemoryReservation": 0,
"MemorySwap": 2306867200,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": null,
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/16e7475a8db87a85da2e4c2cdbd8c60ad2dc372d0612a8d1bdd09d7a15b771ba-init/diff:/var/lib/docker/overlay2/be71a36154d4edc0752055d83a2e555b4962558d96f6429a0d41e4e68d05b63f/diff:/var/lib/docker/overlay2/ba7421c2975740268085547b1655aae5391d13c1075ebb4ba1f8117f463bd4c2/diff:/var/lib/docker/overlay2/465cf41fe65260bf7242026f69bda2df1b41f3c6cb1c2c4cebc85c67fd7a301a/diff:/var/lib/docker/overlay2/66adbc624e035a6faee6aa46768772cddc9bb74546970d2c2c0d6743e0829994/diff:/var/lib/docker/overlay2/09f000d5dd30f003d32767873ae37cc903ac89581a71d8886bc5aeb322aa3ab4/diff:/var/lib/docker/overlay2/be471f380264ec1eb9748d6553eede2d6edf02682634c67a08e204b723e2d20d/diff:/var/lib/docker/overlay2/80869be11aaeb74fb37405a1a24a672ee70ac196ca84d28c5c8302e8312d7d67/diff:/var/lib/docker/overlay2/94d33074056c62a8da7d87adaa9ab73ffd1c948aaa113278ba494a4f88646ddb/diff:/var/lib/docker/overlay2/d34b58bbf8e2ecb5714576ab502102b0acc61f22493fb57d3b14df7ec8419564/diff:/var/lib/docker/overlay2/d03e4e
c465b0cb9c7e09598748bcbb7474edb27c8668607ef946874593b50587/diff:/var/lib/docker/overlay2/e205c5560188b8cec4a1d9289cc3dd1c762cf262a85b104ff324f13ccfa313af/diff:/var/lib/docker/overlay2/2fadab3eaa886a1d31feac41bbcc407d35694df52fef8eb2d592447dbe023c4d/diff:/var/lib/docker/overlay2/4f3477d6c696a4b38462ce1c91ed04b16e03012bcfe21c0eb30fb83ae775607f/diff:/var/lib/docker/overlay2/96ac290d92c134fcfed82a6e4abf9392437b5cd36d6079838f8a4c624f8a54d2/diff:/var/lib/docker/overlay2/43819e42b77cf6affba5f7e88626f581e04b88e6704601938a854a66e926430b/diff:/var/lib/docker/overlay2/736ccb40af76df428b935706748e3603bc6c2d42df6d44f2acdd1c762acda416/diff:/var/lib/docker/overlay2/d634abf8480afd35a78f6b621b6230bfe5eea8ed58e89a88db0ad4f96dca3737/diff:/var/lib/docker/overlay2/375f400edfc97c07e9a24b17e81dfe325254b86653c7154904051371059d9de3/diff:/var/lib/docker/overlay2/c7b941645b851a8a313e0dc08724fd380a1d985a803de048050d2824e748d693/diff:/var/lib/docker/overlay2/20db6f1d248b30381ae84de894ba5e6dec30126e2deded7b864d3b73d0cf8d8b/diff:/var/lib/d
ocker/overlay2/5d21ba108b65674a68678a637f12ecd28ac924f9d1bbdc4efceb9990b42e7306/diff:/var/lib/docker/overlay2/23116ad74e7cb919e8fcd63553bc912de522d721afd3dfd94cebc493f48c9ed0/diff:/var/lib/docker/overlay2/192ee5faaac01c20f16a6adb373ec285276bd581a68273e58e18cbaa82b68e5f/diff:/var/lib/docker/overlay2/e4f0c7dd9dc509b456b365323a3239ec8f43a940eaf84d79ba412443526ea62a/diff:/var/lib/docker/overlay2/a0f3d7a9c7d29646e98f98b5cef53138548e68b89b10991f862bfd3b8e6e701e/diff:/var/lib/docker/overlay2/4e791dc0cf0bf0b4a4721985859a02f8262dbc612626048423f93c2095fd74a5/diff:/var/lib/docker/overlay2/ff33ea15b646cb4188c4598ceff2caa62dc99778f8c262ae7237001367fe9efa/diff:/var/lib/docker/overlay2/9fde99091a6ba3894a270c8a87f0b08a83d064aab1c289c4dc8898a2a7398c16/diff:/var/lib/docker/overlay2/09d8aeda2f2737d2e8f6c570f900a09028727e4281e8c78cd9c3c40e82e94b25/diff:/var/lib/docker/overlay2/57afb992e1473b91847c620cd5f4db3c83741a5147ddc56436a4b602d51f6ace/diff:/var/lib/docker/overlay2/8714e3633b5414b4d41bca8f718e7e777cef6d719b3990b1fa6b1fe8ffd
1a52a/diff:/var/lib/docker/overlay2/af6db37ea0e72105b606f634e174acb8122a35a91b0130533afb45bfbce82f18/diff:/var/lib/docker/overlay2/821fa7a594ba5e494d6ba1e650f3e00f3ca87444f5da095b2be780a56f53d3ae/diff:/var/lib/docker/overlay2/35fcd5785426a72cf1a42e850e5e46382e163669915e6f52656a7442242f570c/diff:/var/lib/docker/overlay2/226ffc769fcd00df0815916d6c9bf671db5f35974b5856c1c23218983f93cbd1/diff:/var/lib/docker/overlay2/29607f8d067ae0a92a8f4417c62b3dba3cea8ee95f1b49679b9b74e960b66e4c/diff:/var/lib/docker/overlay2/a35e15ba7f86a910793d725c33ea06a6da4e13469b63ee617578c5d3f95d70a1/diff:/var/lib/docker/overlay2/92405078febfdb1bcff4ce6f517da24989ea614c2a9150226bf1e18f71e0d77e/diff:/var/lib/docker/overlay2/5bb3f1544e56efddd074f9e35dec621d462e58813ff5669eaebabdb2c6f99924/diff:/var/lib/docker/overlay2/cfee9b1d30fb0331ef891ce98c552adcbe50e9e515fb92c3f7c9785322773b8a/diff:/var/lib/docker/overlay2/bf1b585fc239a7f0a8b5f944ece94e927686403328792ebc73eadf096967950d/diff",
"MergedDir": "/var/lib/docker/overlay2/16e7475a8db87a85da2e4c2cdbd8c60ad2dc372d0612a8d1bdd09d7a15b771ba/merged",
"UpperDir": "/var/lib/docker/overlay2/16e7475a8db87a85da2e4c2cdbd8c60ad2dc372d0612a8d1bdd09d7a15b771ba/diff",
"WorkDir": "/var/lib/docker/overlay2/16e7475a8db87a85da2e4c2cdbd8c60ad2dc372d0612a8d1bdd09d7a15b771ba/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-20220801172716-13911",
"Source": "/var/lib/docker/volumes/old-k8s-version-20220801172716-13911/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-20220801172716-13911",
"Domainname": "",
"User": "root",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1659115536-14579@sha256:73b259e144d926189cf169ae5b46bbec4e08e4e2f2bd87296054c3244f70feb8",
"Volumes": null,
"WorkingDir": "",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-20220801172716-13911",
"name.minikube.sigs.k8s.io": "old-k8s-version-20220801172716-13911",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "3ecaf857c193e9b64542789e55830af2f33d370d3507eb712b4c5e2e3a392eee",
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"Ports": {
"22/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "50175"
}
],
"2376/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "50176"
}
],
"32443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "50177"
}
],
"5000/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "50178"
}
],
"8443/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "50179"
}
]
},
"SandboxKey": "/var/run/docker/netns/3ecaf857c193",
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-20220801172716-13911": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": [
"dfb69a533565",
"old-k8s-version-20220801172716-13911"
],
"NetworkID": "947fc21b2e0fc27b09dd4dd43b477927d08a61d441a541fee2a6fa712bca71b9",
"EndpointID": "0db4f4af11e514d62e1769c067e1803817b13c3f9d4a871696f548a9f9ea058b",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"MacAddress": "02:42:c0:a8:4c:02",
"DriverOpts": null
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-20220801172716-13911 -n old-k8s-version-20220801172716-13911
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-20220801172716-13911 -n old-k8s-version-20220801172716-13911: exit status 6 (448.437009ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0801 17:31:29.192531 30150 status.go:413] kubeconfig endpoint: extract IP: "old-k8s-version-20220801172716-13911" does not appear in /Users/jenkins/minikube-integration/darwin-amd64-docker--14695-13048-16c8c96838ca145d17ecca8303180c41961a99dd/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-20220801172716-13911" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (252.22s)