Test Report: QEMU_macOS 19443

                    
                      8b84af123e21bffd183d137e5ca9151109c81e73:2024-08-14:35789
                    
                

Test fail (97/274)

Order failed test Duration
3 TestDownloadOnly/v1.20.0/json-events 15.94
7 TestDownloadOnly/v1.20.0/kubectl 0
22 TestOffline 9.99
46 TestCertOptions 10.39
47 TestCertExpiration 197.75
48 TestDockerFlags 12.28
49 TestForceSystemdFlag 10.08
50 TestForceSystemdEnv 10.24
95 TestFunctional/parallel/ServiceCmdConnect 31.79
167 TestMultiControlPlane/serial/StopSecondaryNode 214.15
168 TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop 102.83
169 TestMultiControlPlane/serial/RestartSecondaryNode 209.28
171 TestMultiControlPlane/serial/RestartClusterKeepsNodes 231.43
172 TestMultiControlPlane/serial/DeleteSecondaryNode 0.1
173 TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete 0.08
174 TestMultiControlPlane/serial/StopCluster 202.08
175 TestMultiControlPlane/serial/RestartCluster 5.26
176 TestMultiControlPlane/serial/DegradedAfterClusterRestart 0.08
177 TestMultiControlPlane/serial/AddSecondaryNode 0.08
181 TestImageBuild/serial/Setup 10.1
184 TestJSONOutput/start/Command 9.78
190 TestJSONOutput/pause/Command 0.08
196 TestJSONOutput/unpause/Command 0.05
213 TestMinikubeProfile 10.16
216 TestMountStart/serial/StartWithMountFirst 10.01
219 TestMultiNode/serial/FreshStart2Nodes 9.93
220 TestMultiNode/serial/DeployApp2Nodes 81.29
221 TestMultiNode/serial/PingHostFrom2Pods 0.09
222 TestMultiNode/serial/AddNode 0.07
223 TestMultiNode/serial/MultiNodeLabels 0.06
224 TestMultiNode/serial/ProfileList 0.08
225 TestMultiNode/serial/CopyFile 0.06
226 TestMultiNode/serial/StopNode 0.14
227 TestMultiNode/serial/StartAfterStop 47.14
228 TestMultiNode/serial/RestartKeepsNodes 7.15
229 TestMultiNode/serial/DeleteNode 0.1
230 TestMultiNode/serial/StopMultiNode 3.19
231 TestMultiNode/serial/RestartMultiNode 5.25
232 TestMultiNode/serial/ValidateNameConflict 20.97
236 TestPreload 10.01
238 TestScheduledStopUnix 9.96
239 TestSkaffold 12.35
242 TestRunningBinaryUpgrade 622.15
244 TestKubernetesUpgrade 18.62
258 TestStoppedBinaryUpgrade/Upgrade 591.08
268 TestPause/serial/Start 11.11
271 TestNoKubernetes/serial/StartWithK8s 9.9
272 TestNoKubernetes/serial/StartWithStopK8s 5.29
273 TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current 1.88
274 TestNoKubernetes/serial/Start 5.31
275 TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current 1.56
279 TestNoKubernetes/serial/StartNoArgs 5.38
281 TestNetworkPlugins/group/auto/Start 9.86
282 TestNetworkPlugins/group/calico/Start 9.9
283 TestNetworkPlugins/group/custom-flannel/Start 9.89
284 TestNetworkPlugins/group/false/Start 9.98
285 TestNetworkPlugins/group/kindnet/Start 9.83
286 TestNetworkPlugins/group/flannel/Start 9.86
287 TestNetworkPlugins/group/enable-default-cni/Start 9.84
288 TestNetworkPlugins/group/bridge/Start 9.84
289 TestNetworkPlugins/group/kubenet/Start 9.82
291 TestStartStop/group/old-k8s-version/serial/FirstStart 9.94
292 TestStartStop/group/old-k8s-version/serial/DeployApp 0.09
293 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 0.11
296 TestStartStop/group/old-k8s-version/serial/SecondStart 5.26
297 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 0.03
298 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 0.06
299 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.07
300 TestStartStop/group/old-k8s-version/serial/Pause 0.1
302 TestStartStop/group/no-preload/serial/FirstStart 9.94
303 TestStartStop/group/no-preload/serial/DeployApp 0.09
304 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 0.12
307 TestStartStop/group/no-preload/serial/SecondStart 5.25
308 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 0.03
309 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 0.06
310 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.07
311 TestStartStop/group/no-preload/serial/Pause 0.1
313 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 9.95
314 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 0.09
315 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 0.12
318 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 6.59
320 TestStartStop/group/newest-cni/serial/FirstStart 10.03
321 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 0.03
322 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 0.06
323 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.07
324 TestStartStop/group/default-k8s-diff-port/serial/Pause 0.1
326 TestStartStop/group/embed-certs/serial/FirstStart 9.93
331 TestStartStop/group/embed-certs/serial/DeployApp 0.09
332 TestStartStop/group/newest-cni/serial/SecondStart 5.29
333 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 0.16
336 TestStartStop/group/embed-certs/serial/SecondStart 5.26
339 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.07
340 TestStartStop/group/newest-cni/serial/Pause 0.1
341 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 0.03
342 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 0.06
343 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.07
344 TestStartStop/group/embed-certs/serial/Pause 0.1
x
+
TestDownloadOnly/v1.20.0/json-events (15.94s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-darwin-arm64 start -o=json --download-only -p download-only-599000 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=qemu2 
aaa_download_only_test.go:81: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -o=json --download-only -p download-only-599000 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=qemu2 : exit status 40 (15.940950125s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"b17ee47c-e7b8-4dd9-b164-1cdf6168895f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[download-only-599000] minikube v1.33.1 on Darwin 14.5 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"2f51d24f-88ec-458b-a1e6-4e2baa381141","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19443"}}
	{"specversion":"1.0","id":"7a9e0cb9-4d46-45e9-b191-7e6b09dc9742","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig"}}
	{"specversion":"1.0","id":"638f4b25-59ee-43e3-9d7c-90e9454f2fba","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-arm64"}}
	{"specversion":"1.0","id":"fd5c6a26-ad02-480c-aec0-a5289f0aba30","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"a96de005-7df8-4c8c-92aa-8b2bcddac6db","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube"}}
	{"specversion":"1.0","id":"8fdf20ce-c16b-4be8-b73d-c98286c74180","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.warning","datacontenttype":"application/json","data":{"message":"minikube skips various validations when --force is supplied; this may lead to unexpected behavior"}}
	{"specversion":"1.0","id":"00605664-5f09-4d05-bcc3-f494d45b1681","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the qemu2 driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"2208c590-5d7e-4b33-b90b-73130dc8a8d6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Automatically selected the socket_vmnet network"}}
	{"specversion":"1.0","id":"17e080da-a4dc-4eb8-9f9f-9f2518d52c44","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Downloading VM boot image ...","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"32d5ea0e-f285-4e9d-9611-4bf64230d13f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"download-only-599000\" primary control-plane node in \"download-only-599000\" cluster","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"f8127ce0-229f-4443-8c4e-076009d6293c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Downloading Kubernetes v1.20.0 preload ...","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"c83212d4-224c-422b-b847-5b474689f1e4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"40","issues":"","message":"Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256: getter: \u0026{Ctx:context.Background Src:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 Dst:/Users/jenkins/minikube-integration/19443-949/.minikube/cache/darwin/arm64/v1.20.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x1092a7940 0x1092a7940 0x1092a7940 0x1092a7940 0x1092a7940 0x1092a7940 0x1092a7940] Decompressors:map[bz2:0x140003e1290 gz:0x140003e1298 tar:0x140003e1230 tar.bz2:0x140003e1240 tar.gz:0x140003e1260 tar.xz:0x140003e1270 tar.zst:0x140003e1280 tbz2:0x140003e1240 tgz:0x140
003e1260 txz:0x140003e1270 tzst:0x140003e1280 xz:0x140003e12a0 zip:0x140003e12b0 zst:0x140003e12a8] Getters:map[file:0x14001826560 http:0x1400078c3c0 https:0x1400078c410] Dir:false ProgressListener:\u003cnil\u003e Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404","name":"INET_CACHE_KUBECTL","url":""}}
	{"specversion":"1.0","id":"45f4d9a7-2eb2-48ce-a890-a51d3c6b7940","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"╭───────────────────────────────────────────────────────────────────────────────────────────╮\n│                                                                                           │\n│    If the above advice does not help, please let us know:                                 │\n│    https://github.com/kubernetes/minikube/issues/new/choose                               │\n│                                                                                           │\n│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │\n│
│\n╰───────────────────────────────────────────────────────────────────────────────────────────╯"}}

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:04:31.832691    1406 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:04:31.832846    1406 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:04:31.832849    1406 out.go:304] Setting ErrFile to fd 2...
	I0814 17:04:31.832851    1406 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:04:31.832981    1406 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	W0814 17:04:31.833070    1406 root.go:314] Error reading config file at /Users/jenkins/minikube-integration/19443-949/.minikube/config/config.json: open /Users/jenkins/minikube-integration/19443-949/.minikube/config/config.json: no such file or directory
	I0814 17:04:31.834266    1406 out.go:298] Setting JSON to true
	I0814 17:04:31.851541    1406 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":234,"bootTime":1723680037,"procs":447,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:04:31.851614    1406 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:04:31.857253    1406 out.go:97] [download-only-599000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:04:31.857425    1406 notify.go:220] Checking for updates...
	W0814 17:04:31.857445    1406 preload.go:293] Failed to list preload files: open /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball: no such file or directory
	I0814 17:04:31.861146    1406 out.go:169] MINIKUBE_LOCATION=19443
	I0814 17:04:31.864233    1406 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:04:31.869217    1406 out.go:169] MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:04:31.872232    1406 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:04:31.875229    1406 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	W0814 17:04:31.881207    1406 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0814 17:04:31.881467    1406 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:04:31.886192    1406 out.go:97] Using the qemu2 driver based on user configuration
	I0814 17:04:31.886213    1406 start.go:297] selected driver: qemu2
	I0814 17:04:31.886226    1406 start.go:901] validating driver "qemu2" against <nil>
	I0814 17:04:31.886296    1406 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0814 17:04:31.890182    1406 out.go:169] Automatically selected the socket_vmnet network
	I0814 17:04:31.895643    1406 start_flags.go:393] Using suggested 4000MB memory alloc based on sys=16384MB, container=0MB
	I0814 17:04:31.895728    1406 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0814 17:04:31.895817    1406 cni.go:84] Creating CNI manager for ""
	I0814 17:04:31.895832    1406 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0814 17:04:31.895876    1406 start.go:340] cluster config:
	{Name:download-only-599000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:download-only-599000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Con
tainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSo
ck: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:04:31.901241    1406 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:04:31.905228    1406 out.go:97] Downloading VM boot image ...
	I0814 17:04:31.905247    1406 download.go:107] Downloading: https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso?checksum=file:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso.sha256 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso
	I0814 17:04:40.850305    1406 out.go:97] Starting "download-only-599000" primary control-plane node in "download-only-599000" cluster
	I0814 17:04:40.850322    1406 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0814 17:04:40.912267    1406 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4
	I0814 17:04:40.912290    1406 cache.go:56] Caching tarball of preloaded images
	I0814 17:04:40.912460    1406 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0814 17:04:40.918555    1406 out.go:97] Downloading Kubernetes v1.20.0 preload ...
	I0814 17:04:40.918562    1406 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...
	I0814 17:04:41.008110    1406 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4?checksum=md5:1a3e8f9b29e6affec63d76d0d3000942 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4
	I0814 17:04:46.620623    1406 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...
	I0814 17:04:46.620775    1406 preload.go:254] verifying checksum of /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...
	I0814 17:04:47.317013    1406 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I0814 17:04:47.317209    1406 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/download-only-599000/config.json ...
	I0814 17:04:47.317228    1406 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/download-only-599000/config.json: {Name:mk2ed7cb5d9ce47bee4571252d4a10ea822f3d07 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:04:47.317454    1406 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0814 17:04:47.317652    1406 download.go:107] Downloading: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/darwin/arm64/v1.20.0/kubectl
	I0814 17:04:47.699180    1406 out.go:169] 
	W0814 17:04:47.708167    1406 out_reason.go:110] Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256: getter: &{Ctx:context.Background Src:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 Dst:/Users/jenkins/minikube-integration/19443-949/.minikube/cache/darwin/arm64/v1.20.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x1092a7940 0x1092a7940 0x1092a7940 0x1092a7940 0x1092a7940 0x1092a7940 0x1092a7940] Decompressors:map[bz2:0x140003e1290 gz:0x140003e1298 tar:0x140003e1230 tar.bz2:0x140003e1240 tar.gz:0x140003e1260 tar.xz:0x140003e1270 tar.zst:0x140003e1280 tbz2:0x140003e1240 tgz:0x140003e1260 txz:0x140003e1270 tzst:0x140003e1280 xz:0x140003e12a0 zip:0x140003e12b0 zst:0x140003e12a8] Getters:map[file:0x14001826560 http:0x1400078c3c0 https:0x1400078c410] Dir:false ProgressListe
ner:<nil> Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404
	W0814 17:04:47.708192    1406 out_reason.go:110] 
	W0814 17:04:47.716154    1406 out.go:229] ╭───────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                           │
	│    If the above advice does not help, please let us know:                                 │
	│    https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                           │
	│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                           │
	╰───────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:04:47.719106    1406 out.go:169] 

                                                
                                                
** /stderr **
aaa_download_only_test.go:83: failed to download only. args: ["start" "-o=json" "--download-only" "-p" "download-only-599000" "--force" "--alsologtostderr" "--kubernetes-version=v1.20.0" "--container-runtime=docker" "--driver=qemu2" ""] exit status 40
--- FAIL: TestDownloadOnly/v1.20.0/json-events (15.94s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/kubectl
aaa_download_only_test.go:175: expected the file for binary exist at "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/darwin/arm64/v1.20.0/kubectl" but got error stat /Users/jenkins/minikube-integration/19443-949/.minikube/cache/darwin/arm64/v1.20.0/kubectl: no such file or directory
--- FAIL: TestDownloadOnly/v1.20.0/kubectl (0.00s)

                                                
                                    
x
+
TestOffline (9.99s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:55: (dbg) Run:  out/minikube-darwin-arm64 start -p offline-docker-487000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2 
aab_offline_test.go:55: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p offline-docker-487000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2 : exit status 80 (9.818152666s)

                                                
                                                
-- stdout --
	* [offline-docker-487000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "offline-docker-487000" primary control-plane node in "offline-docker-487000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "offline-docker-487000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:41:28.093171    3728 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:41:28.093300    3728 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:41:28.093303    3728 out.go:304] Setting ErrFile to fd 2...
	I0814 17:41:28.093306    3728 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:41:28.093430    3728 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:41:28.094516    3728 out.go:298] Setting JSON to false
	I0814 17:41:28.112072    3728 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2451,"bootTime":1723680037,"procs":461,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:41:28.112141    3728 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:41:28.116628    3728 out.go:177] * [offline-docker-487000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:41:28.123486    3728 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:41:28.123515    3728 notify.go:220] Checking for updates...
	I0814 17:41:28.131403    3728 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:41:28.134472    3728 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:41:28.137434    3728 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:41:28.138714    3728 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:41:28.141459    3728 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:41:28.144803    3728 config.go:182] Loaded profile config "multinode-628000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:41:28.144859    3728 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:41:28.148288    3728 out.go:177] * Using the qemu2 driver based on user configuration
	I0814 17:41:28.155433    3728 start.go:297] selected driver: qemu2
	I0814 17:41:28.155442    3728 start.go:901] validating driver "qemu2" against <nil>
	I0814 17:41:28.155450    3728 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:41:28.157359    3728 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0814 17:41:28.160537    3728 out.go:177] * Automatically selected the socket_vmnet network
	I0814 17:41:28.163448    3728 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0814 17:41:28.163467    3728 cni.go:84] Creating CNI manager for ""
	I0814 17:41:28.163476    3728 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:41:28.163482    3728 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0814 17:41:28.163528    3728 start.go:340] cluster config:
	{Name:offline-docker-487000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:offline-docker-487000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bi
n/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:41:28.167096    3728 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:41:28.173345    3728 out.go:177] * Starting "offline-docker-487000" primary control-plane node in "offline-docker-487000" cluster
	I0814 17:41:28.177416    3728 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:41:28.177446    3728 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:41:28.177457    3728 cache.go:56] Caching tarball of preloaded images
	I0814 17:41:28.177525    3728 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:41:28.177530    3728 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:41:28.177594    3728 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/offline-docker-487000/config.json ...
	I0814 17:41:28.177604    3728 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/offline-docker-487000/config.json: {Name:mka3d070644b973696194ac767fd78e5041892bd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:41:28.177928    3728 start.go:360] acquireMachinesLock for offline-docker-487000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:41:28.177961    3728 start.go:364] duration metric: took 24.542µs to acquireMachinesLock for "offline-docker-487000"
	I0814 17:41:28.177973    3728 start.go:93] Provisioning new machine with config: &{Name:offline-docker-487000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.31.0 ClusterName:offline-docker-487000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mou
ntOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:41:28.177997    3728 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:41:28.181408    3728 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0814 17:41:28.197032    3728 start.go:159] libmachine.API.Create for "offline-docker-487000" (driver="qemu2")
	I0814 17:41:28.197058    3728 client.go:168] LocalClient.Create starting
	I0814 17:41:28.197151    3728 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:41:28.197184    3728 main.go:141] libmachine: Decoding PEM data...
	I0814 17:41:28.197194    3728 main.go:141] libmachine: Parsing certificate...
	I0814 17:41:28.197235    3728 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:41:28.197258    3728 main.go:141] libmachine: Decoding PEM data...
	I0814 17:41:28.197267    3728 main.go:141] libmachine: Parsing certificate...
	I0814 17:41:28.197622    3728 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:41:28.346228    3728 main.go:141] libmachine: Creating SSH key...
	I0814 17:41:28.422422    3728 main.go:141] libmachine: Creating Disk image...
	I0814 17:41:28.422431    3728 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:41:28.422639    3728 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/offline-docker-487000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/offline-docker-487000/disk.qcow2
	I0814 17:41:28.433370    3728 main.go:141] libmachine: STDOUT: 
	I0814 17:41:28.433399    3728 main.go:141] libmachine: STDERR: 
	I0814 17:41:28.433465    3728 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/offline-docker-487000/disk.qcow2 +20000M
	I0814 17:41:28.443516    3728 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:41:28.443535    3728 main.go:141] libmachine: STDERR: 
	I0814 17:41:28.443561    3728 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/offline-docker-487000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/offline-docker-487000/disk.qcow2
	I0814 17:41:28.443567    3728 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:41:28.443579    3728 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:41:28.443606    3728 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/offline-docker-487000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/offline-docker-487000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/offline-docker-487000/qemu.pid -device virtio-net-pci,netdev=net0,mac=f6:fa:96:80:e6:67 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/offline-docker-487000/disk.qcow2
	I0814 17:41:28.445311    3728 main.go:141] libmachine: STDOUT: 
	I0814 17:41:28.445326    3728 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:41:28.445342    3728 client.go:171] duration metric: took 248.283209ms to LocalClient.Create
	I0814 17:41:30.447354    3728 start.go:128] duration metric: took 2.269400292s to createHost
	I0814 17:41:30.447365    3728 start.go:83] releasing machines lock for "offline-docker-487000", held for 2.2694465s
	W0814 17:41:30.447376    3728 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:41:30.459134    3728 out.go:177] * Deleting "offline-docker-487000" in qemu2 ...
	W0814 17:41:30.478687    3728 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:41:30.478696    3728 start.go:729] Will try again in 5 seconds ...
	I0814 17:41:35.480912    3728 start.go:360] acquireMachinesLock for offline-docker-487000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:41:35.481487    3728 start.go:364] duration metric: took 446.375µs to acquireMachinesLock for "offline-docker-487000"
	I0814 17:41:35.481655    3728 start.go:93] Provisioning new machine with config: &{Name:offline-docker-487000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.31.0 ClusterName:offline-docker-487000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mou
ntOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:41:35.481955    3728 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:41:35.499584    3728 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0814 17:41:35.549325    3728 start.go:159] libmachine.API.Create for "offline-docker-487000" (driver="qemu2")
	I0814 17:41:35.549381    3728 client.go:168] LocalClient.Create starting
	I0814 17:41:35.549494    3728 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:41:35.549553    3728 main.go:141] libmachine: Decoding PEM data...
	I0814 17:41:35.549567    3728 main.go:141] libmachine: Parsing certificate...
	I0814 17:41:35.549627    3728 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:41:35.549674    3728 main.go:141] libmachine: Decoding PEM data...
	I0814 17:41:35.549684    3728 main.go:141] libmachine: Parsing certificate...
	I0814 17:41:35.550219    3728 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:41:35.712956    3728 main.go:141] libmachine: Creating SSH key...
	I0814 17:41:35.801491    3728 main.go:141] libmachine: Creating Disk image...
	I0814 17:41:35.801500    3728 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:41:35.801669    3728 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/offline-docker-487000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/offline-docker-487000/disk.qcow2
	I0814 17:41:35.810922    3728 main.go:141] libmachine: STDOUT: 
	I0814 17:41:35.810936    3728 main.go:141] libmachine: STDERR: 
	I0814 17:41:35.810991    3728 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/offline-docker-487000/disk.qcow2 +20000M
	I0814 17:41:35.818754    3728 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:41:35.818773    3728 main.go:141] libmachine: STDERR: 
	I0814 17:41:35.818785    3728 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/offline-docker-487000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/offline-docker-487000/disk.qcow2
	I0814 17:41:35.818799    3728 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:41:35.818807    3728 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:41:35.818839    3728 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/offline-docker-487000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/offline-docker-487000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/offline-docker-487000/qemu.pid -device virtio-net-pci,netdev=net0,mac=6e:c3:98:ab:5b:01 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/offline-docker-487000/disk.qcow2
	I0814 17:41:35.820408    3728 main.go:141] libmachine: STDOUT: 
	I0814 17:41:35.820425    3728 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:41:35.820436    3728 client.go:171] duration metric: took 271.055083ms to LocalClient.Create
	I0814 17:41:37.822576    3728 start.go:128] duration metric: took 2.340640959s to createHost
	I0814 17:41:37.822638    3728 start.go:83] releasing machines lock for "offline-docker-487000", held for 2.341162875s
	W0814 17:41:37.822980    3728 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p offline-docker-487000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p offline-docker-487000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:41:37.836404    3728 out.go:177] 
	W0814 17:41:37.843679    3728 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:41:37.843707    3728 out.go:239] * 
	* 
	W0814 17:41:37.846335    3728 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:41:37.860365    3728 out.go:177] 

                                                
                                                
** /stderr **
aab_offline_test.go:58: out/minikube-darwin-arm64 start -p offline-docker-487000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2  failed: exit status 80
panic.go:626: *** TestOffline FAILED at 2024-08-14 17:41:37.884782 -0700 PDT m=+2226.193738834
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p offline-docker-487000 -n offline-docker-487000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p offline-docker-487000 -n offline-docker-487000: exit status 7 (64.692625ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "offline-docker-487000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "offline-docker-487000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p offline-docker-487000
--- FAIL: TestOffline (9.99s)

                                                
                                    
x
+
TestCertOptions (10.39s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-options-625000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 
cert_options_test.go:49: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-options-625000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 : exit status 80 (10.114713208s)

                                                
                                                
-- stdout --
	* [cert-options-625000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "cert-options-625000" primary control-plane node in "cert-options-625000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "cert-options-625000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p cert-options-625000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
cert_options_test.go:51: failed to start minikube with args: "out/minikube-darwin-arm64 start -p cert-options-625000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 " : exit status 80
cert_options_test.go:60: (dbg) Run:  out/minikube-darwin-arm64 -p cert-options-625000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:60: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p cert-options-625000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt": exit status 83 (83.2775ms)

                                                
                                                
-- stdout --
	* The control-plane node cert-options-625000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p cert-options-625000"

                                                
                                                
-- /stdout --
cert_options_test.go:62: failed to read apiserver cert inside minikube. args "out/minikube-darwin-arm64 -p cert-options-625000 ssh \"openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt\"": exit status 83
cert_options_test.go:69: apiserver cert does not include 127.0.0.1 in SAN.
cert_options_test.go:69: apiserver cert does not include 192.168.15.15 in SAN.
cert_options_test.go:69: apiserver cert does not include localhost in SAN.
cert_options_test.go:69: apiserver cert does not include www.google.com in SAN.
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-625000 config view
cert_options_test.go:93: Kubeconfig apiserver server port incorrect. Output of 
'kubectl config view' = "\n-- stdout --\n\tapiVersion: v1\n\tclusters: null\n\tcontexts: null\n\tcurrent-context: \"\"\n\tkind: Config\n\tpreferences: {}\n\tusers: null\n\n-- /stdout --"
cert_options_test.go:100: (dbg) Run:  out/minikube-darwin-arm64 ssh -p cert-options-625000 -- "sudo cat /etc/kubernetes/admin.conf"
cert_options_test.go:100: (dbg) Non-zero exit: out/minikube-darwin-arm64 ssh -p cert-options-625000 -- "sudo cat /etc/kubernetes/admin.conf": exit status 83 (40.026917ms)

                                                
                                                
-- stdout --
	* The control-plane node cert-options-625000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p cert-options-625000"

                                                
                                                
-- /stdout --
cert_options_test.go:102: failed to SSH to minikube with args: "out/minikube-darwin-arm64 ssh -p cert-options-625000 -- \"sudo cat /etc/kubernetes/admin.conf\"" : exit status 83
cert_options_test.go:106: Internal minikube kubeconfig (admin.conf) does not contains the right api port. 
-- stdout --
	* The control-plane node cert-options-625000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p cert-options-625000"

                                                
                                                
-- /stdout --
cert_options_test.go:109: *** TestCertOptions FAILED at 2024-08-14 17:53:13.145145 -0700 PDT m=+2921.496812168
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p cert-options-625000 -n cert-options-625000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p cert-options-625000 -n cert-options-625000: exit status 7 (30.365208ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "cert-options-625000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "cert-options-625000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p cert-options-625000
--- FAIL: TestCertOptions (10.39s)

                                                
                                    
x
+
TestCertExpiration (197.75s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-expiration-172000 --memory=2048 --cert-expiration=3m --driver=qemu2 
cert_options_test.go:123: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-expiration-172000 --memory=2048 --cert-expiration=3m --driver=qemu2 : exit status 80 (12.346933416s)

                                                
                                                
-- stdout --
	* [cert-expiration-172000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "cert-expiration-172000" primary control-plane node in "cert-expiration-172000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "cert-expiration-172000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-172000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
cert_options_test.go:125: failed to start minikube with args: "out/minikube-darwin-arm64 start -p cert-expiration-172000 --memory=2048 --cert-expiration=3m --driver=qemu2 " : exit status 80
E0814 17:52:58.394449    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
cert_options_test.go:131: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-expiration-172000 --memory=2048 --cert-expiration=8760h --driver=qemu2 
cert_options_test.go:131: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-expiration-172000 --memory=2048 --cert-expiration=8760h --driver=qemu2 : exit status 80 (5.245844291s)

                                                
                                                
-- stdout --
	* [cert-expiration-172000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting "cert-expiration-172000" primary control-plane node in "cert-expiration-172000" cluster
	* Restarting existing qemu2 VM for "cert-expiration-172000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "cert-expiration-172000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-172000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
cert_options_test.go:133: failed to start minikube after cert expiration: "out/minikube-darwin-arm64 start -p cert-expiration-172000 --memory=2048 --cert-expiration=8760h --driver=qemu2 " : exit status 80
cert_options_test.go:136: minikube start output did not warn about expired certs: 
-- stdout --
	* [cert-expiration-172000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting "cert-expiration-172000" primary control-plane node in "cert-expiration-172000" cluster
	* Restarting existing qemu2 VM for "cert-expiration-172000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "cert-expiration-172000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-172000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
cert_options_test.go:138: *** TestCertExpiration FAILED at 2024-08-14 17:55:58.043263 -0700 PDT m=+3086.399373543
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p cert-expiration-172000 -n cert-expiration-172000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p cert-expiration-172000 -n cert-expiration-172000: exit status 7 (65.790292ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "cert-expiration-172000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "cert-expiration-172000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p cert-expiration-172000
--- FAIL: TestCertExpiration (197.75s)

                                                
                                    
x
+
TestDockerFlags (12.28s)

                                                
                                                
=== RUN   TestDockerFlags
=== PAUSE TestDockerFlags

                                                
                                                

                                                
                                                
=== CONT  TestDockerFlags
docker_test.go:51: (dbg) Run:  out/minikube-darwin-arm64 start -p docker-flags-423000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 
docker_test.go:51: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p docker-flags-423000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (12.043066333s)

                                                
                                                
-- stdout --
	* [docker-flags-423000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "docker-flags-423000" primary control-plane node in "docker-flags-423000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "docker-flags-423000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:52:50.626528    4419 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:52:50.626665    4419 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:52:50.626671    4419 out.go:304] Setting ErrFile to fd 2...
	I0814 17:52:50.626673    4419 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:52:50.626820    4419 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:52:50.628170    4419 out.go:298] Setting JSON to false
	I0814 17:52:50.646222    4419 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3133,"bootTime":1723680037,"procs":461,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:52:50.646296    4419 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:52:50.654282    4419 out.go:177] * [docker-flags-423000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:52:50.663316    4419 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:52:50.663357    4419 notify.go:220] Checking for updates...
	I0814 17:52:50.672270    4419 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:52:50.675224    4419 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:52:50.678230    4419 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:52:50.681262    4419 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:52:50.682703    4419 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:52:50.686506    4419 config.go:182] Loaded profile config "cert-expiration-172000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:52:50.686571    4419 config.go:182] Loaded profile config "multinode-628000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:52:50.686611    4419 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:52:50.691226    4419 out.go:177] * Using the qemu2 driver based on user configuration
	I0814 17:52:50.696242    4419 start.go:297] selected driver: qemu2
	I0814 17:52:50.696248    4419 start.go:901] validating driver "qemu2" against <nil>
	I0814 17:52:50.696254    4419 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:52:50.698460    4419 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0814 17:52:50.701236    4419 out.go:177] * Automatically selected the socket_vmnet network
	I0814 17:52:50.704415    4419 start_flags.go:942] Waiting for no components: map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false]
	I0814 17:52:50.704430    4419 cni.go:84] Creating CNI manager for ""
	I0814 17:52:50.704439    4419 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:52:50.704442    4419 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0814 17:52:50.704463    4419 start.go:340] cluster config:
	{Name:docker-flags-423000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:docker-flags-423000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[]
DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMn
etClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:52:50.707850    4419 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:52:50.715306    4419 out.go:177] * Starting "docker-flags-423000" primary control-plane node in "docker-flags-423000" cluster
	I0814 17:52:50.719204    4419 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:52:50.719228    4419 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:52:50.719237    4419 cache.go:56] Caching tarball of preloaded images
	I0814 17:52:50.719295    4419 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:52:50.719300    4419 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:52:50.719352    4419 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/docker-flags-423000/config.json ...
	I0814 17:52:50.719361    4419 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/docker-flags-423000/config.json: {Name:mk83c17b5578417bc2a4195bd451465457dcb1a3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:52:50.719722    4419 start.go:360] acquireMachinesLock for docker-flags-423000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:52:52.760368    4419 start.go:364] duration metric: took 2.040653083s to acquireMachinesLock for "docker-flags-423000"
	I0814 17:52:52.760585    4419 start.go:93] Provisioning new machine with config: &{Name:docker-flags-423000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey
: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:docker-flags-423000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:dock
er MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:52:52.760822    4419 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:52:52.769046    4419 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0814 17:52:52.818817    4419 start.go:159] libmachine.API.Create for "docker-flags-423000" (driver="qemu2")
	I0814 17:52:52.818866    4419 client.go:168] LocalClient.Create starting
	I0814 17:52:52.819011    4419 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:52:52.819069    4419 main.go:141] libmachine: Decoding PEM data...
	I0814 17:52:52.819092    4419 main.go:141] libmachine: Parsing certificate...
	I0814 17:52:52.819161    4419 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:52:52.819205    4419 main.go:141] libmachine: Decoding PEM data...
	I0814 17:52:52.819218    4419 main.go:141] libmachine: Parsing certificate...
	I0814 17:52:52.819844    4419 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:52:52.990158    4419 main.go:141] libmachine: Creating SSH key...
	I0814 17:52:53.164047    4419 main.go:141] libmachine: Creating Disk image...
	I0814 17:52:53.164054    4419 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:52:53.164242    4419 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/docker-flags-423000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/docker-flags-423000/disk.qcow2
	I0814 17:52:53.173963    4419 main.go:141] libmachine: STDOUT: 
	I0814 17:52:53.173991    4419 main.go:141] libmachine: STDERR: 
	I0814 17:52:53.174043    4419 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/docker-flags-423000/disk.qcow2 +20000M
	I0814 17:52:53.182049    4419 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:52:53.182072    4419 main.go:141] libmachine: STDERR: 
	I0814 17:52:53.182084    4419 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/docker-flags-423000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/docker-flags-423000/disk.qcow2
	I0814 17:52:53.182089    4419 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:52:53.182099    4419 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:52:53.182140    4419 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/docker-flags-423000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/docker-flags-423000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/docker-flags-423000/qemu.pid -device virtio-net-pci,netdev=net0,mac=d2:b8:c4:18:2e:61 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/docker-flags-423000/disk.qcow2
	I0814 17:52:53.183881    4419 main.go:141] libmachine: STDOUT: 
	I0814 17:52:53.183902    4419 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:52:53.183919    4419 client.go:171] duration metric: took 365.057ms to LocalClient.Create
	I0814 17:52:55.186089    4419 start.go:128] duration metric: took 2.425301834s to createHost
	I0814 17:52:55.186184    4419 start.go:83] releasing machines lock for "docker-flags-423000", held for 2.425805541s
	W0814 17:52:55.186228    4419 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:52:55.198533    4419 out.go:177] * Deleting "docker-flags-423000" in qemu2 ...
	W0814 17:52:55.232145    4419 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:52:55.232184    4419 start.go:729] Will try again in 5 seconds ...
	I0814 17:53:00.234334    4419 start.go:360] acquireMachinesLock for docker-flags-423000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:53:00.234749    4419 start.go:364] duration metric: took 331.542µs to acquireMachinesLock for "docker-flags-423000"
	I0814 17:53:00.234879    4419 start.go:93] Provisioning new machine with config: &{Name:docker-flags-423000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey
: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:docker-flags-423000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:dock
er MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:53:00.235304    4419 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:53:00.242030    4419 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0814 17:53:00.294586    4419 start.go:159] libmachine.API.Create for "docker-flags-423000" (driver="qemu2")
	I0814 17:53:00.294635    4419 client.go:168] LocalClient.Create starting
	I0814 17:53:00.294748    4419 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:53:00.294813    4419 main.go:141] libmachine: Decoding PEM data...
	I0814 17:53:00.294832    4419 main.go:141] libmachine: Parsing certificate...
	I0814 17:53:00.294893    4419 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:53:00.294937    4419 main.go:141] libmachine: Decoding PEM data...
	I0814 17:53:00.294950    4419 main.go:141] libmachine: Parsing certificate...
	I0814 17:53:00.295617    4419 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:53:00.455801    4419 main.go:141] libmachine: Creating SSH key...
	I0814 17:53:00.575139    4419 main.go:141] libmachine: Creating Disk image...
	I0814 17:53:00.575149    4419 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:53:00.575329    4419 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/docker-flags-423000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/docker-flags-423000/disk.qcow2
	I0814 17:53:00.584488    4419 main.go:141] libmachine: STDOUT: 
	I0814 17:53:00.584509    4419 main.go:141] libmachine: STDERR: 
	I0814 17:53:00.584550    4419 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/docker-flags-423000/disk.qcow2 +20000M
	I0814 17:53:00.592442    4419 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:53:00.592468    4419 main.go:141] libmachine: STDERR: 
	I0814 17:53:00.592484    4419 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/docker-flags-423000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/docker-flags-423000/disk.qcow2
	I0814 17:53:00.592498    4419 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:53:00.592507    4419 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:53:00.592543    4419 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/docker-flags-423000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/docker-flags-423000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/docker-flags-423000/qemu.pid -device virtio-net-pci,netdev=net0,mac=fa:95:96:58:c3:ef -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/docker-flags-423000/disk.qcow2
	I0814 17:53:00.594235    4419 main.go:141] libmachine: STDOUT: 
	I0814 17:53:00.594250    4419 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:53:00.594263    4419 client.go:171] duration metric: took 299.629833ms to LocalClient.Create
	I0814 17:53:02.596579    4419 start.go:128] duration metric: took 2.36123975s to createHost
	I0814 17:53:02.596726    4419 start.go:83] releasing machines lock for "docker-flags-423000", held for 2.362013542s
	W0814 17:53:02.597220    4419 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p docker-flags-423000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p docker-flags-423000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:53:02.606779    4419 out.go:177] 
	W0814 17:53:02.613849    4419 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:53:02.613888    4419 out.go:239] * 
	* 
	W0814 17:53:02.616617    4419 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:53:02.624738    4419 out.go:177] 

                                                
                                                
** /stderr **
docker_test.go:53: failed to start minikube with args: "out/minikube-darwin-arm64 start -p docker-flags-423000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 " : exit status 80
docker_test.go:56: (dbg) Run:  out/minikube-darwin-arm64 -p docker-flags-423000 ssh "sudo systemctl show docker --property=Environment --no-pager"
docker_test.go:56: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p docker-flags-423000 ssh "sudo systemctl show docker --property=Environment --no-pager": exit status 83 (78.667625ms)

                                                
                                                
-- stdout --
	* The control-plane node docker-flags-423000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p docker-flags-423000"

                                                
                                                
-- /stdout --
docker_test.go:58: failed to 'systemctl show docker' inside minikube. args "out/minikube-darwin-arm64 -p docker-flags-423000 ssh \"sudo systemctl show docker --property=Environment --no-pager\"": exit status 83
docker_test.go:63: expected env key/value "FOO=BAR" to be passed to minikube's docker and be included in: *"* The control-plane node docker-flags-423000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-423000\"\n"*.
docker_test.go:63: expected env key/value "BAZ=BAT" to be passed to minikube's docker and be included in: *"* The control-plane node docker-flags-423000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-423000\"\n"*.
docker_test.go:67: (dbg) Run:  out/minikube-darwin-arm64 -p docker-flags-423000 ssh "sudo systemctl show docker --property=ExecStart --no-pager"
docker_test.go:67: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p docker-flags-423000 ssh "sudo systemctl show docker --property=ExecStart --no-pager": exit status 83 (42.794ms)

                                                
                                                
-- stdout --
	* The control-plane node docker-flags-423000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p docker-flags-423000"

                                                
                                                
-- /stdout --
docker_test.go:69: failed on the second 'systemctl show docker' inside minikube. args "out/minikube-darwin-arm64 -p docker-flags-423000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"": exit status 83
docker_test.go:73: expected "out/minikube-darwin-arm64 -p docker-flags-423000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"" output to have include *--debug* . output: "* The control-plane node docker-flags-423000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-423000\"\n"
panic.go:626: *** TestDockerFlags FAILED at 2024-08-14 17:53:02.764681 -0700 PDT m=+2911.116067918
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p docker-flags-423000 -n docker-flags-423000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p docker-flags-423000 -n docker-flags-423000: exit status 7 (30.566458ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "docker-flags-423000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "docker-flags-423000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p docker-flags-423000
--- FAIL: TestDockerFlags (12.28s)

                                                
                                    
x
+
TestForceSystemdFlag (10.08s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-darwin-arm64 start -p force-systemd-flag-604000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 
docker_test.go:91: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p force-systemd-flag-604000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (9.89003225s)

                                                
                                                
-- stdout --
	* [force-systemd-flag-604000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "force-systemd-flag-604000" primary control-plane node in "force-systemd-flag-604000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "force-systemd-flag-604000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:52:16.216497    4261 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:52:16.216654    4261 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:52:16.216659    4261 out.go:304] Setting ErrFile to fd 2...
	I0814 17:52:16.216661    4261 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:52:16.216813    4261 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:52:16.217907    4261 out.go:298] Setting JSON to false
	I0814 17:52:16.234077    4261 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3099,"bootTime":1723680037,"procs":469,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:52:16.234151    4261 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:52:16.238682    4261 out.go:177] * [force-systemd-flag-604000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:52:16.245615    4261 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:52:16.245679    4261 notify.go:220] Checking for updates...
	I0814 17:52:16.252625    4261 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:52:16.255608    4261 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:52:16.258642    4261 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:52:16.261613    4261 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:52:16.263011    4261 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:52:16.266951    4261 config.go:182] Loaded profile config "NoKubernetes-707000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:52:16.267019    4261 config.go:182] Loaded profile config "multinode-628000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:52:16.267065    4261 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:52:16.271613    4261 out.go:177] * Using the qemu2 driver based on user configuration
	I0814 17:52:16.277512    4261 start.go:297] selected driver: qemu2
	I0814 17:52:16.277517    4261 start.go:901] validating driver "qemu2" against <nil>
	I0814 17:52:16.277522    4261 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:52:16.279645    4261 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0814 17:52:16.282678    4261 out.go:177] * Automatically selected the socket_vmnet network
	I0814 17:52:16.285729    4261 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0814 17:52:16.285753    4261 cni.go:84] Creating CNI manager for ""
	I0814 17:52:16.285762    4261 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:52:16.285767    4261 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0814 17:52:16.285802    4261 start.go:340] cluster config:
	{Name:force-systemd-flag-604000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-flag-604000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster
.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet Static
IP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:52:16.289705    4261 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:52:16.297591    4261 out.go:177] * Starting "force-systemd-flag-604000" primary control-plane node in "force-systemd-flag-604000" cluster
	I0814 17:52:16.301563    4261 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:52:16.301578    4261 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:52:16.301589    4261 cache.go:56] Caching tarball of preloaded images
	I0814 17:52:16.301648    4261 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:52:16.301655    4261 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:52:16.301715    4261 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/force-systemd-flag-604000/config.json ...
	I0814 17:52:16.301726    4261 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/force-systemd-flag-604000/config.json: {Name:mk210f9e579eaeaa0c41e5d487f27ec4e67e556f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:52:16.301957    4261 start.go:360] acquireMachinesLock for force-systemd-flag-604000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:52:16.301993    4261 start.go:364] duration metric: took 29.459µs to acquireMachinesLock for "force-systemd-flag-604000"
	I0814 17:52:16.302007    4261 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-604000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes
Config:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-flag-604000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror
: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:52:16.302033    4261 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:52:16.310573    4261 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0814 17:52:16.328512    4261 start.go:159] libmachine.API.Create for "force-systemd-flag-604000" (driver="qemu2")
	I0814 17:52:16.328536    4261 client.go:168] LocalClient.Create starting
	I0814 17:52:16.328607    4261 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:52:16.328640    4261 main.go:141] libmachine: Decoding PEM data...
	I0814 17:52:16.328655    4261 main.go:141] libmachine: Parsing certificate...
	I0814 17:52:16.328697    4261 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:52:16.328720    4261 main.go:141] libmachine: Decoding PEM data...
	I0814 17:52:16.328730    4261 main.go:141] libmachine: Parsing certificate...
	I0814 17:52:16.329148    4261 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:52:16.485610    4261 main.go:141] libmachine: Creating SSH key...
	I0814 17:52:16.541536    4261 main.go:141] libmachine: Creating Disk image...
	I0814 17:52:16.541541    4261 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:52:16.541712    4261 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-flag-604000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-flag-604000/disk.qcow2
	I0814 17:52:16.550812    4261 main.go:141] libmachine: STDOUT: 
	I0814 17:52:16.550830    4261 main.go:141] libmachine: STDERR: 
	I0814 17:52:16.550884    4261 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-flag-604000/disk.qcow2 +20000M
	I0814 17:52:16.558922    4261 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:52:16.558938    4261 main.go:141] libmachine: STDERR: 
	I0814 17:52:16.558950    4261 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-flag-604000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-flag-604000/disk.qcow2
	I0814 17:52:16.558956    4261 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:52:16.558978    4261 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:52:16.559006    4261 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-flag-604000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-flag-604000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-flag-604000/qemu.pid -device virtio-net-pci,netdev=net0,mac=1a:86:cc:f9:97:d1 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-flag-604000/disk.qcow2
	I0814 17:52:16.560618    4261 main.go:141] libmachine: STDOUT: 
	I0814 17:52:16.560641    4261 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:52:16.560658    4261 client.go:171] duration metric: took 232.124583ms to LocalClient.Create
	I0814 17:52:18.562858    4261 start.go:128] duration metric: took 2.260858375s to createHost
	I0814 17:52:18.562903    4261 start.go:83] releasing machines lock for "force-systemd-flag-604000", held for 2.260960333s
	W0814 17:52:18.562954    4261 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:52:18.573980    4261 out.go:177] * Deleting "force-systemd-flag-604000" in qemu2 ...
	W0814 17:52:18.609936    4261 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:52:18.609970    4261 start.go:729] Will try again in 5 seconds ...
	I0814 17:52:23.612013    4261 start.go:360] acquireMachinesLock for force-systemd-flag-604000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:52:23.612535    4261 start.go:364] duration metric: took 399.333µs to acquireMachinesLock for "force-systemd-flag-604000"
	I0814 17:52:23.612661    4261 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-604000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes
Config:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-flag-604000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror
: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:52:23.612985    4261 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:52:23.622480    4261 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0814 17:52:23.671379    4261 start.go:159] libmachine.API.Create for "force-systemd-flag-604000" (driver="qemu2")
	I0814 17:52:23.671425    4261 client.go:168] LocalClient.Create starting
	I0814 17:52:23.671519    4261 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:52:23.671578    4261 main.go:141] libmachine: Decoding PEM data...
	I0814 17:52:23.671593    4261 main.go:141] libmachine: Parsing certificate...
	I0814 17:52:23.671647    4261 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:52:23.671677    4261 main.go:141] libmachine: Decoding PEM data...
	I0814 17:52:23.671694    4261 main.go:141] libmachine: Parsing certificate...
	I0814 17:52:23.672416    4261 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:52:23.831098    4261 main.go:141] libmachine: Creating SSH key...
	I0814 17:52:24.007330    4261 main.go:141] libmachine: Creating Disk image...
	I0814 17:52:24.007340    4261 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:52:24.007531    4261 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-flag-604000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-flag-604000/disk.qcow2
	I0814 17:52:24.017156    4261 main.go:141] libmachine: STDOUT: 
	I0814 17:52:24.017175    4261 main.go:141] libmachine: STDERR: 
	I0814 17:52:24.017252    4261 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-flag-604000/disk.qcow2 +20000M
	I0814 17:52:24.025219    4261 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:52:24.025233    4261 main.go:141] libmachine: STDERR: 
	I0814 17:52:24.025245    4261 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-flag-604000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-flag-604000/disk.qcow2
	I0814 17:52:24.025249    4261 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:52:24.025281    4261 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:52:24.025311    4261 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-flag-604000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-flag-604000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-flag-604000/qemu.pid -device virtio-net-pci,netdev=net0,mac=92:e3:aa:ad:75:b7 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-flag-604000/disk.qcow2
	I0814 17:52:24.026932    4261 main.go:141] libmachine: STDOUT: 
	I0814 17:52:24.026947    4261 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:52:24.026965    4261 client.go:171] duration metric: took 355.543833ms to LocalClient.Create
	I0814 17:52:26.029080    4261 start.go:128] duration metric: took 2.416132791s to createHost
	I0814 17:52:26.029141    4261 start.go:83] releasing machines lock for "force-systemd-flag-604000", held for 2.41664725s
	W0814 17:52:26.029467    4261 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p force-systemd-flag-604000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p force-systemd-flag-604000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:52:26.043950    4261 out.go:177] 
	W0814 17:52:26.048232    4261 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:52:26.048259    4261 out.go:239] * 
	* 
	W0814 17:52:26.050806    4261 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:52:26.064088    4261 out.go:177] 

                                                
                                                
** /stderr **
docker_test.go:93: failed to start minikube with args: "out/minikube-darwin-arm64 start -p force-systemd-flag-604000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 " : exit status 80
docker_test.go:110: (dbg) Run:  out/minikube-darwin-arm64 -p force-systemd-flag-604000 ssh "docker info --format {{.CgroupDriver}}"
docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p force-systemd-flag-604000 ssh "docker info --format {{.CgroupDriver}}": exit status 83 (77.203667ms)

                                                
                                                
-- stdout --
	* The control-plane node force-systemd-flag-604000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p force-systemd-flag-604000"

                                                
                                                
-- /stdout --
docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-arm64 -p force-systemd-flag-604000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 83
docker_test.go:106: *** TestForceSystemdFlag FAILED at 2024-08-14 17:52:26.159233 -0700 PDT m=+2874.509634043
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-flag-604000 -n force-systemd-flag-604000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-flag-604000 -n force-systemd-flag-604000: exit status 7 (33.861958ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "force-systemd-flag-604000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "force-systemd-flag-604000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p force-systemd-flag-604000
--- FAIL: TestForceSystemdFlag (10.08s)

                                                
                                    
x
+
TestForceSystemdEnv (10.24s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-darwin-arm64 start -p force-systemd-env-178000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 
docker_test.go:155: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p force-systemd-env-178000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (10.019065458s)

                                                
                                                
-- stdout --
	* [force-systemd-env-178000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=true
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "force-systemd-env-178000" primary control-plane node in "force-systemd-env-178000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "force-systemd-env-178000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:52:40.387698    4382 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:52:40.387844    4382 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:52:40.387847    4382 out.go:304] Setting ErrFile to fd 2...
	I0814 17:52:40.387850    4382 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:52:40.388009    4382 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:52:40.391384    4382 out.go:298] Setting JSON to false
	I0814 17:52:40.408748    4382 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3123,"bootTime":1723680037,"procs":471,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:52:40.408827    4382 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:52:40.429477    4382 out.go:177] * [force-systemd-env-178000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:52:40.433361    4382 notify.go:220] Checking for updates...
	I0814 17:52:40.437232    4382 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:52:40.445218    4382 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:52:40.451237    4382 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:52:40.457214    4382 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:52:40.461257    4382 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:52:40.464238    4382 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=true
	I0814 17:52:40.468552    4382 config.go:182] Loaded profile config "multinode-628000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:52:40.468595    4382 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:52:40.472237    4382 out.go:177] * Using the qemu2 driver based on user configuration
	I0814 17:52:40.479235    4382 start.go:297] selected driver: qemu2
	I0814 17:52:40.479245    4382 start.go:901] validating driver "qemu2" against <nil>
	I0814 17:52:40.479257    4382 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:52:40.481472    4382 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0814 17:52:40.484304    4382 out.go:177] * Automatically selected the socket_vmnet network
	I0814 17:52:40.485448    4382 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0814 17:52:40.485476    4382 cni.go:84] Creating CNI manager for ""
	I0814 17:52:40.485482    4382 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:52:40.485493    4382 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0814 17:52:40.485521    4382 start.go:340] cluster config:
	{Name:force-systemd-env-178000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-env-178000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.l
ocal ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP
: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:52:40.488903    4382 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:52:40.493283    4382 out.go:177] * Starting "force-systemd-env-178000" primary control-plane node in "force-systemd-env-178000" cluster
	I0814 17:52:40.501228    4382 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:52:40.501241    4382 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:52:40.501250    4382 cache.go:56] Caching tarball of preloaded images
	I0814 17:52:40.501304    4382 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:52:40.501308    4382 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:52:40.501363    4382 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/force-systemd-env-178000/config.json ...
	I0814 17:52:40.501373    4382 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/force-systemd-env-178000/config.json: {Name:mk54c99712367084cb025a62bbc7ddd10e7f6a07 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:52:40.509751    4382 start.go:360] acquireMachinesLock for force-systemd-env-178000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:52:40.509789    4382 start.go:364] duration metric: took 29.333µs to acquireMachinesLock for "force-systemd-env-178000"
	I0814 17:52:40.509801    4382 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-178000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-env-178000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:
DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:52:40.509829    4382 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:52:40.521097    4382 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0814 17:52:40.536710    4382 start.go:159] libmachine.API.Create for "force-systemd-env-178000" (driver="qemu2")
	I0814 17:52:40.536734    4382 client.go:168] LocalClient.Create starting
	I0814 17:52:40.536798    4382 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:52:40.536826    4382 main.go:141] libmachine: Decoding PEM data...
	I0814 17:52:40.536836    4382 main.go:141] libmachine: Parsing certificate...
	I0814 17:52:40.536877    4382 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:52:40.536900    4382 main.go:141] libmachine: Decoding PEM data...
	I0814 17:52:40.536909    4382 main.go:141] libmachine: Parsing certificate...
	I0814 17:52:40.539958    4382 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:52:40.776935    4382 main.go:141] libmachine: Creating SSH key...
	I0814 17:52:40.917143    4382 main.go:141] libmachine: Creating Disk image...
	I0814 17:52:40.917150    4382 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:52:40.917329    4382 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-env-178000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-env-178000/disk.qcow2
	I0814 17:52:40.926975    4382 main.go:141] libmachine: STDOUT: 
	I0814 17:52:40.926993    4382 main.go:141] libmachine: STDERR: 
	I0814 17:52:40.927042    4382 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-env-178000/disk.qcow2 +20000M
	I0814 17:52:40.934974    4382 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:52:40.934992    4382 main.go:141] libmachine: STDERR: 
	I0814 17:52:40.935012    4382 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-env-178000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-env-178000/disk.qcow2
	I0814 17:52:40.935017    4382 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:52:40.935029    4382 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:52:40.935059    4382 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-env-178000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-env-178000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-env-178000/qemu.pid -device virtio-net-pci,netdev=net0,mac=6e:39:7b:1d:f4:dd -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-env-178000/disk.qcow2
	I0814 17:52:40.936755    4382 main.go:141] libmachine: STDOUT: 
	I0814 17:52:40.936772    4382 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:52:40.936792    4382 client.go:171] duration metric: took 400.064125ms to LocalClient.Create
	I0814 17:52:42.938923    4382 start.go:128] duration metric: took 2.429138292s to createHost
	I0814 17:52:42.938966    4382 start.go:83] releasing machines lock for "force-systemd-env-178000", held for 2.4292335s
	W0814 17:52:42.939030    4382 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:52:42.958115    4382 out.go:177] * Deleting "force-systemd-env-178000" in qemu2 ...
	W0814 17:52:42.982639    4382 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:52:42.982673    4382 start.go:729] Will try again in 5 seconds ...
	I0814 17:52:47.984709    4382 start.go:360] acquireMachinesLock for force-systemd-env-178000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:52:47.985141    4382 start.go:364] duration metric: took 349.333µs to acquireMachinesLock for "force-systemd-env-178000"
	I0814 17:52:47.985320    4382 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-178000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-env-178000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:
DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:52:47.985678    4382 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:52:47.994072    4382 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0814 17:52:48.044660    4382 start.go:159] libmachine.API.Create for "force-systemd-env-178000" (driver="qemu2")
	I0814 17:52:48.044703    4382 client.go:168] LocalClient.Create starting
	I0814 17:52:48.044811    4382 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:52:48.044871    4382 main.go:141] libmachine: Decoding PEM data...
	I0814 17:52:48.044891    4382 main.go:141] libmachine: Parsing certificate...
	I0814 17:52:48.044950    4382 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:52:48.044993    4382 main.go:141] libmachine: Decoding PEM data...
	I0814 17:52:48.045014    4382 main.go:141] libmachine: Parsing certificate...
	I0814 17:52:48.045560    4382 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:52:48.204915    4382 main.go:141] libmachine: Creating SSH key...
	I0814 17:52:48.306226    4382 main.go:141] libmachine: Creating Disk image...
	I0814 17:52:48.306231    4382 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:52:48.306403    4382 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-env-178000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-env-178000/disk.qcow2
	I0814 17:52:48.315526    4382 main.go:141] libmachine: STDOUT: 
	I0814 17:52:48.315544    4382 main.go:141] libmachine: STDERR: 
	I0814 17:52:48.315589    4382 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-env-178000/disk.qcow2 +20000M
	I0814 17:52:48.323461    4382 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:52:48.323477    4382 main.go:141] libmachine: STDERR: 
	I0814 17:52:48.323488    4382 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-env-178000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-env-178000/disk.qcow2
	I0814 17:52:48.323492    4382 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:52:48.323504    4382 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:52:48.323548    4382 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-env-178000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-env-178000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-env-178000/qemu.pid -device virtio-net-pci,netdev=net0,mac=56:54:65:99:5c:40 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/force-systemd-env-178000/disk.qcow2
	I0814 17:52:48.325134    4382 main.go:141] libmachine: STDOUT: 
	I0814 17:52:48.325150    4382 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:52:48.325173    4382 client.go:171] duration metric: took 280.471125ms to LocalClient.Create
	I0814 17:52:50.327297    4382 start.go:128] duration metric: took 2.3416355s to createHost
	I0814 17:52:50.327348    4382 start.go:83] releasing machines lock for "force-systemd-env-178000", held for 2.34222225s
	W0814 17:52:50.327712    4382 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p force-systemd-env-178000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p force-systemd-env-178000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:52:50.342314    4382 out.go:177] 
	W0814 17:52:50.346345    4382 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:52:50.346393    4382 out.go:239] * 
	* 
	W0814 17:52:50.349207    4382 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:52:50.363362    4382 out.go:177] 

                                                
                                                
** /stderr **
docker_test.go:157: failed to start minikube with args: "out/minikube-darwin-arm64 start -p force-systemd-env-178000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 " : exit status 80
docker_test.go:110: (dbg) Run:  out/minikube-darwin-arm64 -p force-systemd-env-178000 ssh "docker info --format {{.CgroupDriver}}"
docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p force-systemd-env-178000 ssh "docker info --format {{.CgroupDriver}}": exit status 83 (83.845125ms)

                                                
                                                
-- stdout --
	* The control-plane node force-systemd-env-178000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p force-systemd-env-178000"

                                                
                                                
-- /stdout --
docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-arm64 -p force-systemd-env-178000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 83
docker_test.go:166: *** TestForceSystemdEnv FAILED at 2024-08-14 17:52:50.462503 -0700 PDT m=+2898.813559043
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-env-178000 -n force-systemd-env-178000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-env-178000 -n force-systemd-env-178000: exit status 7 (36.574875ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "force-systemd-env-178000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "force-systemd-env-178000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p force-systemd-env-178000
--- FAIL: TestForceSystemdEnv (10.24s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (31.79s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1627: (dbg) Run:  kubectl --context functional-248000 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1635: (dbg) Run:  kubectl --context functional-248000 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1640: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:344: "hello-node-connect-65d86f57f4-wdz9m" [013db01b-b84f-487a-9252-a991ceea9ab3] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-connect-65d86f57f4-wdz9m" [013db01b-b84f-487a-9252-a991ceea9ab3] Running / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
functional_test.go:1640: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 10.0041865s
functional_test.go:1649: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 service hello-node-connect --url
functional_test.go:1655: found endpoint for hello-node-connect: http://192.168.105.4:32142
functional_test.go:1661: error fetching http://192.168.105.4:32142: Get "http://192.168.105.4:32142": dial tcp 192.168.105.4:32142: connect: connection refused
functional_test.go:1661: error fetching http://192.168.105.4:32142: Get "http://192.168.105.4:32142": dial tcp 192.168.105.4:32142: connect: connection refused
functional_test.go:1661: error fetching http://192.168.105.4:32142: Get "http://192.168.105.4:32142": dial tcp 192.168.105.4:32142: connect: connection refused
functional_test.go:1661: error fetching http://192.168.105.4:32142: Get "http://192.168.105.4:32142": dial tcp 192.168.105.4:32142: connect: connection refused
functional_test.go:1661: error fetching http://192.168.105.4:32142: Get "http://192.168.105.4:32142": dial tcp 192.168.105.4:32142: connect: connection refused
functional_test.go:1661: error fetching http://192.168.105.4:32142: Get "http://192.168.105.4:32142": dial tcp 192.168.105.4:32142: connect: connection refused
functional_test.go:1661: error fetching http://192.168.105.4:32142: Get "http://192.168.105.4:32142": dial tcp 192.168.105.4:32142: connect: connection refused
functional_test.go:1681: failed to fetch http://192.168.105.4:32142: Get "http://192.168.105.4:32142": dial tcp 192.168.105.4:32142: connect: connection refused
functional_test.go:1598: service test failed - dumping debug information
functional_test.go:1599: -----------------------service failure post-mortem--------------------------------
functional_test.go:1602: (dbg) Run:  kubectl --context functional-248000 describe po hello-node-connect
functional_test.go:1606: hello-node pod describe:
Name:             hello-node-connect-65d86f57f4-wdz9m
Namespace:        default
Priority:         0
Service Account:  default
Node:             functional-248000/192.168.105.4
Start Time:       Wed, 14 Aug 2024 17:15:06 -0700
Labels:           app=hello-node-connect
pod-template-hash=65d86f57f4
Annotations:      <none>
Status:           Running
IP:               10.244.0.8
IPs:
IP:           10.244.0.8
Controlled By:  ReplicaSet/hello-node-connect-65d86f57f4
Containers:
echoserver-arm:
Container ID:   docker://ac13f8bbc528605a08c709ad3f6882e9d030688c0154a0435a55e523ead1835f
Image:          registry.k8s.io/echoserver-arm:1.8
Image ID:       docker-pullable://registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5
Port:           <none>
Host Port:      <none>
State:          Terminated
Reason:       Error
Exit Code:    1
Started:      Wed, 14 Aug 2024 17:15:23 -0700
Finished:     Wed, 14 Aug 2024 17:15:23 -0700
Last State:     Terminated
Reason:       Error
Exit Code:    1
Started:      Wed, 14 Aug 2024 17:15:11 -0700
Finished:     Wed, 14 Aug 2024 17:15:11 -0700
Ready:          False
Restart Count:  2
Environment:    <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-pl7lj (ro)
Conditions:
Type                        Status
PodReadyToStartContainers   True 
Initialized                 True 
Ready                       False 
ContainersReady             False 
PodScheduled                True 
Volumes:
kube-api-access-pl7lj:
Type:                    Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds:  3607
ConfigMapName:           kube-root-ca.crt
ConfigMapOptional:       <nil>
DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type     Reason     Age                From               Message
----     ------     ----               ----               -------
Normal   Scheduled  30s                default-scheduler  Successfully assigned default/hello-node-connect-65d86f57f4-wdz9m to functional-248000
Normal   Pulling    30s                kubelet            Pulling image "registry.k8s.io/echoserver-arm:1.8"
Normal   Pulled     27s                kubelet            Successfully pulled image "registry.k8s.io/echoserver-arm:1.8" in 3.557s (3.557s including waiting). Image size: 84957542 bytes.
Normal   Created    14s (x3 over 27s)  kubelet            Created container echoserver-arm
Normal   Started    14s (x3 over 27s)  kubelet            Started container echoserver-arm
Normal   Pulled     14s (x2 over 26s)  kubelet            Container image "registry.k8s.io/echoserver-arm:1.8" already present on machine
Warning  BackOff    13s (x3 over 25s)  kubelet            Back-off restarting failed container echoserver-arm in pod hello-node-connect-65d86f57f4-wdz9m_default(013db01b-b84f-487a-9252-a991ceea9ab3)

                                                
                                                
functional_test.go:1608: (dbg) Run:  kubectl --context functional-248000 logs -l app=hello-node-connect
functional_test.go:1612: hello-node logs:
exec /usr/sbin/nginx: exec format error
functional_test.go:1614: (dbg) Run:  kubectl --context functional-248000 describe svc hello-node-connect
functional_test.go:1618: hello-node svc describe:
Name:                     hello-node-connect
Namespace:                default
Labels:                   app=hello-node-connect
Annotations:              <none>
Selector:                 app=hello-node-connect
Type:                     NodePort
IP Family Policy:         SingleStack
IP Families:              IPv4
IP:                       10.106.55.117
IPs:                      10.106.55.117
Port:                     <unset>  8080/TCP
TargetPort:               8080/TCP
NodePort:                 <unset>  32142/TCP
Endpoints:                
Session Affinity:         None
External Traffic Policy:  Cluster
Events:                   <none>
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-248000 -n functional-248000
helpers_test.go:244: <<< TestFunctional/parallel/ServiceCmdConnect FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestFunctional/parallel/ServiceCmdConnect]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 logs -n 25
helpers_test.go:252: TestFunctional/parallel/ServiceCmdConnect logs: 
-- stdout --
	
	==> Audit <==
	|-----------|----------------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|
	|  Command  |                                                         Args                                                         |      Profile      |  User   | Version |     Start Time      |      End Time       |
	|-----------|----------------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|
	| mount     | -p functional-248000                                                                                                 | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT |                     |
	|           | /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdany-port3664838828/001:/mount-9p      |                   |         |         |                     |                     |
	|           | --alsologtostderr -v=1                                                                                               |                   |         |         |                     |                     |
	| ssh       | functional-248000 ssh findmnt                                                                                        | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT |                     |
	|           | -T /mount-9p | grep 9p                                                                                               |                   |         |         |                     |                     |
	| ssh       | functional-248000 ssh findmnt                                                                                        | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT | 14 Aug 24 17:15 PDT |
	|           | -T /mount-9p | grep 9p                                                                                               |                   |         |         |                     |                     |
	| ssh       | functional-248000 ssh -- ls                                                                                          | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT | 14 Aug 24 17:15 PDT |
	|           | -la /mount-9p                                                                                                        |                   |         |         |                     |                     |
	| ssh       | functional-248000 ssh cat                                                                                            | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT | 14 Aug 24 17:15 PDT |
	|           | /mount-9p/test-1723680926675188000                                                                                   |                   |         |         |                     |                     |
	| ssh       | functional-248000 ssh stat                                                                                           | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT | 14 Aug 24 17:15 PDT |
	|           | /mount-9p/created-by-test                                                                                            |                   |         |         |                     |                     |
	| ssh       | functional-248000 ssh stat                                                                                           | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT | 14 Aug 24 17:15 PDT |
	|           | /mount-9p/created-by-pod                                                                                             |                   |         |         |                     |                     |
	| ssh       | functional-248000 ssh sudo                                                                                           | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT | 14 Aug 24 17:15 PDT |
	|           | umount -f /mount-9p                                                                                                  |                   |         |         |                     |                     |
	| mount     | -p functional-248000                                                                                                 | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT |                     |
	|           | /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdspecific-port3301669921/001:/mount-9p |                   |         |         |                     |                     |
	|           | --alsologtostderr -v=1 --port 46464                                                                                  |                   |         |         |                     |                     |
	| ssh       | functional-248000 ssh findmnt                                                                                        | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT |                     |
	|           | -T /mount-9p | grep 9p                                                                                               |                   |         |         |                     |                     |
	| ssh       | functional-248000 ssh findmnt                                                                                        | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT | 14 Aug 24 17:15 PDT |
	|           | -T /mount-9p | grep 9p                                                                                               |                   |         |         |                     |                     |
	| ssh       | functional-248000 ssh -- ls                                                                                          | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT | 14 Aug 24 17:15 PDT |
	|           | -la /mount-9p                                                                                                        |                   |         |         |                     |                     |
	| ssh       | functional-248000 ssh sudo                                                                                           | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT |                     |
	|           | umount -f /mount-9p                                                                                                  |                   |         |         |                     |                     |
	| mount     | -p functional-248000                                                                                                 | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT |                     |
	|           | /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdVerifyCleanup1206242887/001:/mount2   |                   |         |         |                     |                     |
	|           | --alsologtostderr -v=1                                                                                               |                   |         |         |                     |                     |
	| mount     | -p functional-248000                                                                                                 | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT |                     |
	|           | /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdVerifyCleanup1206242887/001:/mount1   |                   |         |         |                     |                     |
	|           | --alsologtostderr -v=1                                                                                               |                   |         |         |                     |                     |
	| mount     | -p functional-248000                                                                                                 | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT |                     |
	|           | /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdVerifyCleanup1206242887/001:/mount3   |                   |         |         |                     |                     |
	|           | --alsologtostderr -v=1                                                                                               |                   |         |         |                     |                     |
	| ssh       | functional-248000 ssh findmnt                                                                                        | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT |                     |
	|           | -T /mount1                                                                                                           |                   |         |         |                     |                     |
	| ssh       | functional-248000 ssh findmnt                                                                                        | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT | 14 Aug 24 17:15 PDT |
	|           | -T /mount1                                                                                                           |                   |         |         |                     |                     |
	| ssh       | functional-248000 ssh findmnt                                                                                        | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT | 14 Aug 24 17:15 PDT |
	|           | -T /mount2                                                                                                           |                   |         |         |                     |                     |
	| ssh       | functional-248000 ssh findmnt                                                                                        | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT | 14 Aug 24 17:15 PDT |
	|           | -T /mount3                                                                                                           |                   |         |         |                     |                     |
	| mount     | -p functional-248000                                                                                                 | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT |                     |
	|           | --kill=true                                                                                                          |                   |         |         |                     |                     |
	| start     | -p functional-248000                                                                                                 | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT |                     |
	|           | --dry-run --memory                                                                                                   |                   |         |         |                     |                     |
	|           | 250MB --alsologtostderr                                                                                              |                   |         |         |                     |                     |
	|           | --driver=qemu2                                                                                                       |                   |         |         |                     |                     |
	| start     | -p functional-248000                                                                                                 | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT |                     |
	|           | --dry-run --memory                                                                                                   |                   |         |         |                     |                     |
	|           | 250MB --alsologtostderr                                                                                              |                   |         |         |                     |                     |
	|           | --driver=qemu2                                                                                                       |                   |         |         |                     |                     |
	| start     | -p functional-248000 --dry-run                                                                                       | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT |                     |
	|           | --alsologtostderr -v=1                                                                                               |                   |         |         |                     |                     |
	|           | --driver=qemu2                                                                                                       |                   |         |         |                     |                     |
	| dashboard | --url --port 36195                                                                                                   | functional-248000 | jenkins | v1.33.1 | 14 Aug 24 17:15 PDT |                     |
	|           | -p functional-248000                                                                                                 |                   |         |         |                     |                     |
	|           | --alsologtostderr -v=1                                                                                               |                   |         |         |                     |                     |
	|-----------|----------------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/08/14 17:15:35
	Running on machine: MacOS-M1-Agent-2
	Binary: Built with gc go1.22.5 for darwin/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0814 17:15:35.557037    2090 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:15:35.557180    2090 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:15:35.557184    2090 out.go:304] Setting ErrFile to fd 2...
	I0814 17:15:35.557186    2090 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:15:35.557340    2090 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:15:35.558507    2090 out.go:298] Setting JSON to false
	I0814 17:15:35.575056    2090 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":898,"bootTime":1723680037,"procs":454,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:15:35.575126    2090 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:15:35.578478    2090 out.go:177] * [functional-248000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:15:35.586441    2090 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:15:35.586531    2090 notify.go:220] Checking for updates...
	I0814 17:15:35.593442    2090 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:15:35.596467    2090 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:15:35.599466    2090 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:15:35.602434    2090 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:15:35.605472    2090 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:15:35.608688    2090 config.go:182] Loaded profile config "functional-248000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:15:35.608923    2090 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:15:35.613419    2090 out.go:177] * Using the qemu2 driver based on existing profile
	I0814 17:15:35.620472    2090 start.go:297] selected driver: qemu2
	I0814 17:15:35.620481    2090 start.go:901] validating driver "qemu2" against &{Name:functional-248000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.0 ClusterName:functional-248000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpirat
ion:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:15:35.620541    2090 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:15:35.622757    2090 cni.go:84] Creating CNI manager for ""
	I0814 17:15:35.622774    2090 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:15:35.622819    2090 start.go:340] cluster config:
	{Name:functional-248000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:functional-248000 Namespace:default APIServe
rHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2
000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:15:35.633276    2090 out.go:177] * dry-run validation complete!
	
	
	==> Docker <==
	Aug 15 00:15:30 functional-248000 dockerd[5764]: time="2024-08-15T00:15:30.459864576Z" level=warning msg="cleaning up after shim disconnected" id=68b9884e824a3a52f5744e45e43c187fc54b1c9dd1b4f9d2e1c4c3e824dba0d4 namespace=moby
	Aug 15 00:15:30 functional-248000 dockerd[5764]: time="2024-08-15T00:15:30.459869701Z" level=info msg="cleaning up dead shim" namespace=moby
	Aug 15 00:15:31 functional-248000 dockerd[5758]: time="2024-08-15T00:15:31.616640701Z" level=info msg="ignoring event" container=5ddab35989d23d4e60c3a7b4a33a5acbf9925f790a345c7c31dce1e9ff8dee0a module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Aug 15 00:15:31 functional-248000 dockerd[5764]: time="2024-08-15T00:15:31.616934298Z" level=info msg="shim disconnected" id=5ddab35989d23d4e60c3a7b4a33a5acbf9925f790a345c7c31dce1e9ff8dee0a namespace=moby
	Aug 15 00:15:31 functional-248000 dockerd[5764]: time="2024-08-15T00:15:31.616968753Z" level=warning msg="cleaning up after shim disconnected" id=5ddab35989d23d4e60c3a7b4a33a5acbf9925f790a345c7c31dce1e9ff8dee0a namespace=moby
	Aug 15 00:15:31 functional-248000 dockerd[5764]: time="2024-08-15T00:15:31.616974503Z" level=info msg="cleaning up dead shim" namespace=moby
	Aug 15 00:15:36 functional-248000 dockerd[5764]: time="2024-08-15T00:15:36.477488580Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
	Aug 15 00:15:36 functional-248000 dockerd[5764]: time="2024-08-15T00:15:36.477529909Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
	Aug 15 00:15:36 functional-248000 dockerd[5764]: time="2024-08-15T00:15:36.477562906Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Aug 15 00:15:36 functional-248000 dockerd[5764]: time="2024-08-15T00:15:36.477597778Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Aug 15 00:15:36 functional-248000 dockerd[5764]: time="2024-08-15T00:15:36.484826402Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
	Aug 15 00:15:36 functional-248000 dockerd[5764]: time="2024-08-15T00:15:36.485659866Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
	Aug 15 00:15:36 functional-248000 dockerd[5764]: time="2024-08-15T00:15:36.485698321Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Aug 15 00:15:36 functional-248000 dockerd[5764]: time="2024-08-15T00:15:36.485751441Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Aug 15 00:15:36 functional-248000 cri-dockerd[6032]: time="2024-08-15T00:15:36Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/97ae1b3ebcf57fce2ab1a93c00b11bbfb0b6468c9c95569b9347c498784f188e/resolv.conf as [nameserver 10.96.0.10 search kubernetes-dashboard.svc.cluster.local svc.cluster.local cluster.local options ndots:5]"
	Aug 15 00:15:36 functional-248000 cri-dockerd[6032]: time="2024-08-15T00:15:36Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/3e66b0d5925817b84c1d6df4143eba3f9074234b7e9f2288c295e8961b941c95/resolv.conf as [nameserver 10.96.0.10 search kubernetes-dashboard.svc.cluster.local svc.cluster.local cluster.local options ndots:5]"
	Aug 15 00:15:36 functional-248000 dockerd[5764]: time="2024-08-15T00:15:36.616162101Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
	Aug 15 00:15:36 functional-248000 dockerd[5764]: time="2024-08-15T00:15:36.616560564Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
	Aug 15 00:15:36 functional-248000 dockerd[5764]: time="2024-08-15T00:15:36.616573771Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Aug 15 00:15:36 functional-248000 dockerd[5764]: time="2024-08-15T00:15:36.616633933Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Aug 15 00:15:36 functional-248000 dockerd[5758]: time="2024-08-15T00:15:36.650616126Z" level=info msg="ignoring event" container=dbfe47233bcc92841debe0b49bfbc69edbbb0b08a612d05da82e7d7bfd67da62 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Aug 15 00:15:36 functional-248000 dockerd[5764]: time="2024-08-15T00:15:36.650827690Z" level=info msg="shim disconnected" id=dbfe47233bcc92841debe0b49bfbc69edbbb0b08a612d05da82e7d7bfd67da62 namespace=moby
	Aug 15 00:15:36 functional-248000 dockerd[5764]: time="2024-08-15T00:15:36.650893934Z" level=warning msg="cleaning up after shim disconnected" id=dbfe47233bcc92841debe0b49bfbc69edbbb0b08a612d05da82e7d7bfd67da62 namespace=moby
	Aug 15 00:15:36 functional-248000 dockerd[5764]: time="2024-08-15T00:15:36.650905016Z" level=info msg="cleaning up dead shim" namespace=moby
	Aug 15 00:15:36 functional-248000 dockerd[5758]: time="2024-08-15T00:15:36.779190915Z" level=warning msg="reference for unknown type: " digest="sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c" remote="docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c"
	
	
	==> container status <==
	CONTAINER           IMAGE                                                                                                 CREATED              STATE               NAME                      ATTEMPT             POD ID              POD
	dbfe47233bcc9       72565bf5bbedf                                                                                         1 second ago         Exited              echoserver-arm            2                   b2f3007117587       hello-node-64b4f8f9ff-pcth6
	68b9884e824a3       gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e   7 seconds ago        Exited              mount-munger              0                   5ddab35989d23       busybox-mount
	ac13f8bbc5286       72565bf5bbedf                                                                                         14 seconds ago       Exited              echoserver-arm            2                   4acb4ce7cea51       hello-node-connect-65d86f57f4-wdz9m
	92662e3620eb4       nginx@sha256:98f8ec75657d21b924fe4f69b6b9bff2f6550ea48838af479d8894a852000e40                         24 seconds ago       Running             myfrontend                0                   f54f556974873       sp-pod
	e8e87c9aa36c8       nginx@sha256:208b70eefac13ee9be00e486f79c695b15cef861c680527171a27d253d834be9                         38 seconds ago       Running             nginx                     0                   35f30deb7a469       nginx-svc
	f7b3df5b53916       2437cf7621777                                                                                         About a minute ago   Running             coredns                   2                   f37921f36e823       coredns-6f6b679f8f-gm79c
	5ede1765a8b62       ba04bb24b9575                                                                                         About a minute ago   Running             storage-provisioner       2                   63d1edfc733db       storage-provisioner
	25ed962e889da       71d55d66fd4ee                                                                                         About a minute ago   Running             kube-proxy                2                   0606de067fc75       kube-proxy-7rngp
	836ae7f99518b       27e3830e14027                                                                                         About a minute ago   Running             etcd                      2                   58a87f7ef3420       etcd-functional-248000
	c345c3da97163       fcb0683e6bdbd                                                                                         About a minute ago   Running             kube-controller-manager   2                   87de47669d3cb       kube-controller-manager-functional-248000
	8d717f4758816       cd0f0ae0ec9e0                                                                                         About a minute ago   Running             kube-apiserver            0                   3888aa2d79657       kube-apiserver-functional-248000
	591886a64a5f5       fbbbd428abb4d                                                                                         About a minute ago   Running             kube-scheduler            2                   946db27a1a4ba       kube-scheduler-functional-248000
	0a9a55a8b0dd4       2437cf7621777                                                                                         About a minute ago   Exited              coredns                   1                   eab75d9aec4a6       coredns-6f6b679f8f-gm79c
	35c95e702fd4f       ba04bb24b9575                                                                                         About a minute ago   Exited              storage-provisioner       1                   b6aa5c67718fe       storage-provisioner
	ed2dbc6f677a6       71d55d66fd4ee                                                                                         About a minute ago   Exited              kube-proxy                1                   71873608254d9       kube-proxy-7rngp
	b02e39d1126f7       27e3830e14027                                                                                         About a minute ago   Exited              etcd                      1                   eb289510409f0       etcd-functional-248000
	288580365d03a       fbbbd428abb4d                                                                                         About a minute ago   Exited              kube-scheduler            1                   dc3240b0de054       kube-scheduler-functional-248000
	489fac343e996       fcb0683e6bdbd                                                                                         About a minute ago   Exited              kube-controller-manager   1                   c1c709efff341       kube-controller-manager-functional-248000
	
	
	==> coredns [0a9a55a8b0dd] <==
	.:53
	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b
	CoreDNS-1.11.1
	linux/arm64, go1.20.7, ae2bbc2
	[INFO] 127.0.0.1:38631 - 35124 "HINFO IN 602471718740618429.2757176507849883654. udp 56 false 512" NXDOMAIN qr,rd,ra 131 0.004639544s
	[INFO] SIGTERM: Shutting down servers then terminating
	[INFO] plugin/health: Going into lameduck mode for 5s
	
	
	==> coredns [f7b3df5b5391] <==
	.:53
	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b
	CoreDNS-1.11.1
	linux/arm64, go1.20.7, ae2bbc2
	[INFO] 127.0.0.1:50033 - 41023 "HINFO IN 2934527367757662921.8585549852215959217. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.011269001s
	[INFO] 10.244.0.1:1227 - 20310 "A IN nginx-svc.default.svc.cluster.local. udp 64 false 4096" NOERROR qr,aa,rd 104 0.000109781s
	[INFO] 10.244.0.1:22984 - 50868 "AAAA IN nginx-svc.default.svc.cluster.local. udp 53 false 512" NOERROR qr,aa,rd 146 0.000103824s
	[INFO] 10.244.0.1:46980 - 7225 "A IN nginx-svc.default.svc.cluster.local. udp 53 false 512" NOERROR qr,aa,rd 104 0.000031872s
	[INFO] 10.244.0.1:57665 - 6506 "SVCB IN _dns.resolver.arpa. udp 36 false 512" NXDOMAIN qr,rd,ra 116 0.001098102s
	[INFO] 10.244.0.1:12553 - 46092 "A IN nginx-svc.default.svc.cluster.local. udp 64 false 1232" NOERROR qr,aa,rd 104 0.000093866s
	[INFO] 10.244.0.1:36561 - 14670 "AAAA IN nginx-svc.default.svc.cluster.local. udp 64 false 1232" NOERROR qr,aa,rd 146 0.000053036s
	
	
	==> describe nodes <==
	Name:               functional-248000
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=functional-248000
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=a560a51f794134545edbbeb49e1ab4a0b1355168
	                    minikube.k8s.io/name=functional-248000
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2024_08_14T17_13_15_0700
	                    minikube.k8s.io/version=v1.33.1
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 15 Aug 2024 00:13:12 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  functional-248000
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 15 Aug 2024 00:15:30 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 15 Aug 2024 00:15:30 +0000   Thu, 15 Aug 2024 00:13:12 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 15 Aug 2024 00:15:30 +0000   Thu, 15 Aug 2024 00:13:12 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 15 Aug 2024 00:15:30 +0000   Thu, 15 Aug 2024 00:13:12 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 15 Aug 2024 00:15:30 +0000   Thu, 15 Aug 2024 00:13:18 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.105.4
	  Hostname:    functional-248000
	Capacity:
	  cpu:                2
	  ephemeral-storage:  17734596Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             3904744Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  17734596Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             3904744Ki
	  pods:               110
	System Info:
	  Machine ID:                 cfdf800fd3c141d399f186a6f20adcbd
	  System UUID:                cfdf800fd3c141d399f186a6f20adcbd
	  Boot ID:                    b40e05c9-a9e3-49d0-9b09-bbb741ea8ec8
	  Kernel Version:             5.10.207
	  OS Image:                   Buildroot 2023.02.9
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  docker://27.1.2
	  Kubelet Version:            v1.31.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (13 in total)
	  Namespace                   Name                                         CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                         ------------  ----------  ---------------  -------------  ---
	  default                     hello-node-64b4f8f9ff-pcth6                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         18s
	  default                     hello-node-connect-65d86f57f4-wdz9m          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         31s
	  default                     nginx-svc                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         41s
	  default                     sp-pod                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         25s
	  kube-system                 coredns-6f6b679f8f-gm79c                     100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (1%!)(MISSING)        170Mi (4%!)(MISSING)     2m17s
	  kube-system                 etcd-functional-248000                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (2%!)(MISSING)       0 (0%!)(MISSING)         2m23s
	  kube-system                 kube-apiserver-functional-248000             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         68s
	  kube-system                 kube-controller-manager-functional-248000    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m22s
	  kube-system                 kube-proxy-7rngp                             0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m17s
	  kube-system                 kube-scheduler-functional-248000             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m22s
	  kube-system                 storage-provisioner                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m17s
	  kubernetes-dashboard        dashboard-metrics-scraper-c5db448b4-bg7g7    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         1s
	  kubernetes-dashboard        kubernetes-dashboard-695b96c756-xqk57        0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         1s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (37%!)(MISSING)  0 (0%!)(MISSING)
	  memory             170Mi (4%!)(MISSING)  170Mi (4%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                  From             Message
	  ----    ------                   ----                 ----             -------
	  Normal  Starting                 2m17s                kube-proxy       
	  Normal  Starting                 67s                  kube-proxy       
	  Normal  Starting                 109s                 kube-proxy       
	  Normal  Starting                 2m23s                kubelet          Starting kubelet.
	  Normal  NodeAllocatableEnforced  2m23s                kubelet          Updated Node Allocatable limit across pods
	  Normal  NodeHasSufficientMemory  2m22s                kubelet          Node functional-248000 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    2m22s                kubelet          Node functional-248000 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     2m22s                kubelet          Node functional-248000 status is now: NodeHasSufficientPID
	  Normal  NodeReady                2m19s                kubelet          Node functional-248000 status is now: NodeReady
	  Normal  RegisteredNode           2m18s                node-controller  Node functional-248000 event: Registered Node functional-248000 in Controller
	  Normal  NodeAllocatableEnforced  112s                 kubelet          Updated Node Allocatable limit across pods
	  Normal  NodeHasSufficientMemory  112s (x8 over 112s)  kubelet          Node functional-248000 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    112s (x8 over 112s)  kubelet          Node functional-248000 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     112s (x7 over 112s)  kubelet          Node functional-248000 status is now: NodeHasSufficientPID
	  Normal  Starting                 112s                 kubelet          Starting kubelet.
	  Normal  RegisteredNode           106s                 node-controller  Node functional-248000 event: Registered Node functional-248000 in Controller
	  Normal  Starting                 71s                  kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  71s (x8 over 71s)    kubelet          Node functional-248000 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    71s (x8 over 71s)    kubelet          Node functional-248000 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     71s (x7 over 71s)    kubelet          Node functional-248000 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  71s                  kubelet          Updated Node Allocatable limit across pods
	  Normal  RegisteredNode           65s                  node-controller  Node functional-248000 event: Registered Node functional-248000 in Controller
	
	
	==> dmesg <==
	[  +3.407607] kauditd_printk_skb: 198 callbacks suppressed
	[  +5.876113] kauditd_printk_skb: 33 callbacks suppressed
	[Aug15 00:14] systemd-fstab-generator[4846]: Ignoring "noauto" option for root device
	[ +10.830269] systemd-fstab-generator[5273]: Ignoring "noauto" option for root device
	[  +0.054151] kauditd_printk_skb: 12 callbacks suppressed
	[  +0.097872] systemd-fstab-generator[5308]: Ignoring "noauto" option for root device
	[  +0.083342] systemd-fstab-generator[5320]: Ignoring "noauto" option for root device
	[  +0.094704] systemd-fstab-generator[5334]: Ignoring "noauto" option for root device
	[  +5.108393] kauditd_printk_skb: 89 callbacks suppressed
	[  +7.358811] systemd-fstab-generator[5980]: Ignoring "noauto" option for root device
	[  +0.084733] systemd-fstab-generator[5992]: Ignoring "noauto" option for root device
	[  +0.087756] systemd-fstab-generator[6004]: Ignoring "noauto" option for root device
	[  +0.099247] systemd-fstab-generator[6019]: Ignoring "noauto" option for root device
	[  +0.229358] systemd-fstab-generator[6188]: Ignoring "noauto" option for root device
	[  +1.089548] systemd-fstab-generator[6312]: Ignoring "noauto" option for root device
	[  +3.416066] kauditd_printk_skb: 199 callbacks suppressed
	[  +6.264953] kauditd_printk_skb: 35 callbacks suppressed
	[  +9.814225] systemd-fstab-generator[7355]: Ignoring "noauto" option for root device
	[  +5.137146] kauditd_printk_skb: 16 callbacks suppressed
	[  +5.235560] kauditd_printk_skb: 15 callbacks suppressed
	[Aug15 00:15] kauditd_printk_skb: 25 callbacks suppressed
	[ +10.488247] kauditd_printk_skb: 20 callbacks suppressed
	[  +7.616276] kauditd_printk_skb: 15 callbacks suppressed
	[  +9.473737] kauditd_printk_skb: 26 callbacks suppressed
	[  +7.244122] kauditd_printk_skb: 15 callbacks suppressed
	
	
	==> etcd [836ae7f99518] <==
	{"level":"info","ts":"2024-08-15T00:14:27.409019Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 switched to configuration voters=(527499358918876438)"}
	{"level":"info","ts":"2024-08-15T00:14:27.409069Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"80e92d98c466b02f","local-member-id":"7520ddf439b1d16","added-peer-id":"7520ddf439b1d16","added-peer-peer-urls":["https://192.168.105.4:2380"]}
	{"level":"info","ts":"2024-08-15T00:14:27.409132Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"80e92d98c466b02f","local-member-id":"7520ddf439b1d16","cluster-version":"3.5"}
	{"level":"info","ts":"2024-08-15T00:14:27.409162Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2024-08-15T00:14:27.410565Z","caller":"embed/etcd.go:728","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
	{"level":"info","ts":"2024-08-15T00:14:27.410675Z","caller":"embed/etcd.go:599","msg":"serving peer traffic","address":"192.168.105.4:2380"}
	{"level":"info","ts":"2024-08-15T00:14:27.410698Z","caller":"embed/etcd.go:571","msg":"cmux::serve","address":"192.168.105.4:2380"}
	{"level":"info","ts":"2024-08-15T00:14:27.411210Z","caller":"embed/etcd.go:279","msg":"now serving peer/client/metrics","local-member-id":"7520ddf439b1d16","initial-advertise-peer-urls":["https://192.168.105.4:2380"],"listen-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.105.4:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
	{"level":"info","ts":"2024-08-15T00:14:27.411239Z","caller":"embed/etcd.go:870","msg":"serving metrics","address":"http://127.0.0.1:2381"}
	{"level":"info","ts":"2024-08-15T00:14:28.756724Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 is starting a new election at term 3"}
	{"level":"info","ts":"2024-08-15T00:14:28.756873Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became pre-candidate at term 3"}
	{"level":"info","ts":"2024-08-15T00:14:28.756959Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgPreVoteResp from 7520ddf439b1d16 at term 3"}
	{"level":"info","ts":"2024-08-15T00:14:28.757004Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became candidate at term 4"}
	{"level":"info","ts":"2024-08-15T00:14:28.757021Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgVoteResp from 7520ddf439b1d16 at term 4"}
	{"level":"info","ts":"2024-08-15T00:14:28.757047Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became leader at term 4"}
	{"level":"info","ts":"2024-08-15T00:14:28.757066Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 7520ddf439b1d16 elected leader 7520ddf439b1d16 at term 4"}
	{"level":"info","ts":"2024-08-15T00:14:28.761803Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
	{"level":"info","ts":"2024-08-15T00:14:28.762200Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2024-08-15T00:14:28.762252Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	{"level":"info","ts":"2024-08-15T00:14:28.761801Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"7520ddf439b1d16","local-member-attributes":"{Name:functional-248000 ClientURLs:[https://192.168.105.4:2379]}","request-path":"/0/members/7520ddf439b1d16/attributes","cluster-id":"80e92d98c466b02f","publish-timeout":"7s"}
	{"level":"info","ts":"2024-08-15T00:14:28.761865Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
	{"level":"info","ts":"2024-08-15T00:14:28.764674Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
	{"level":"info","ts":"2024-08-15T00:14:28.764674Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
	{"level":"info","ts":"2024-08-15T00:14:28.766859Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2024-08-15T00:14:28.768655Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.4:2379"}
	
	
	==> etcd [b02e39d1126f] <==
	{"level":"info","ts":"2024-08-15T00:13:47.247050Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became pre-candidate at term 2"}
	{"level":"info","ts":"2024-08-15T00:13:47.247134Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgPreVoteResp from 7520ddf439b1d16 at term 2"}
	{"level":"info","ts":"2024-08-15T00:13:47.247214Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became candidate at term 3"}
	{"level":"info","ts":"2024-08-15T00:13:47.247257Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgVoteResp from 7520ddf439b1d16 at term 3"}
	{"level":"info","ts":"2024-08-15T00:13:47.247302Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became leader at term 3"}
	{"level":"info","ts":"2024-08-15T00:13:47.247353Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 7520ddf439b1d16 elected leader 7520ddf439b1d16 at term 3"}
	{"level":"info","ts":"2024-08-15T00:13:47.251965Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"7520ddf439b1d16","local-member-attributes":"{Name:functional-248000 ClientURLs:[https://192.168.105.4:2379]}","request-path":"/0/members/7520ddf439b1d16/attributes","cluster-id":"80e92d98c466b02f","publish-timeout":"7s"}
	{"level":"info","ts":"2024-08-15T00:13:47.252374Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
	{"level":"info","ts":"2024-08-15T00:13:47.252540Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2024-08-15T00:13:47.252581Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	{"level":"info","ts":"2024-08-15T00:13:47.252619Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
	{"level":"info","ts":"2024-08-15T00:13:47.254643Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
	{"level":"info","ts":"2024-08-15T00:13:47.254643Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
	{"level":"info","ts":"2024-08-15T00:13:47.257026Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2024-08-15T00:13:47.257843Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.4:2379"}
	{"level":"info","ts":"2024-08-15T00:14:12.539540Z","caller":"osutil/interrupt_unix.go:64","msg":"received signal; shutting down","signal":"terminated"}
	{"level":"info","ts":"2024-08-15T00:14:12.539577Z","caller":"embed/etcd.go:377","msg":"closing etcd server","name":"functional-248000","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"]}
	{"level":"warn","ts":"2024-08-15T00:14:12.539617Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}
	{"level":"warn","ts":"2024-08-15T00:14:12.539661Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}
	{"level":"warn","ts":"2024-08-15T00:14:12.548115Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 192.168.105.4:2379: use of closed network connection"}
	{"level":"warn","ts":"2024-08-15T00:14:12.548158Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 192.168.105.4:2379: use of closed network connection"}
	{"level":"info","ts":"2024-08-15T00:14:12.548181Z","caller":"etcdserver/server.go:1521","msg":"skipped leadership transfer for single voting member cluster","local-member-id":"7520ddf439b1d16","current-leader-member-id":"7520ddf439b1d16"}
	{"level":"info","ts":"2024-08-15T00:14:12.549789Z","caller":"embed/etcd.go:581","msg":"stopping serving peer traffic","address":"192.168.105.4:2380"}
	{"level":"info","ts":"2024-08-15T00:14:12.549828Z","caller":"embed/etcd.go:586","msg":"stopped serving peer traffic","address":"192.168.105.4:2380"}
	{"level":"info","ts":"2024-08-15T00:14:12.549834Z","caller":"embed/etcd.go:379","msg":"closed etcd server","name":"functional-248000","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"]}
	
	
	==> kernel <==
	 00:15:38 up 2 min,  0 users,  load average: 0.72, 0.44, 0.18
	Linux functional-248000 5.10.207 #1 SMP PREEMPT Wed Aug 14 17:13:54 UTC 2024 aarch64 GNU/Linux
	PRETTY_NAME="Buildroot 2023.02.9"
	
	
	==> kube-apiserver [8d717f475881] <==
	I0815 00:14:29.399926       1 aggregator.go:171] initial CRD sync complete...
	I0815 00:14:29.400096       1 autoregister_controller.go:144] Starting autoregister controller
	I0815 00:14:29.400099       1 cache.go:32] Waiting for caches to sync for autoregister controller
	I0815 00:14:29.400102       1 cache.go:39] Caches are synced for autoregister controller
	I0815 00:14:29.421716       1 shared_informer.go:320] Caches are synced for *generic.policySource[*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicy,*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicyBinding,k8s.io/apiserver/pkg/admission/plugin/policy/validating.Validator]
	I0815 00:14:29.421768       1 policy_source.go:224] refreshing policies
	I0815 00:14:29.421748       1 shared_informer.go:320] Caches are synced for node_authorizer
	I0815 00:14:29.424057       1 controller.go:615] quota admission added evaluator for: leases.coordination.k8s.io
	I0815 00:14:30.268796       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
	W0815 00:14:30.372788       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.105.4]
	I0815 00:14:30.373357       1 controller.go:615] quota admission added evaluator for: endpoints
	I0815 00:14:30.375146       1 controller.go:615] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I0815 00:14:30.672760       1 controller.go:615] quota admission added evaluator for: serviceaccounts
	I0815 00:14:30.676529       1 controller.go:615] quota admission added evaluator for: deployments.apps
	I0815 00:14:30.696195       1 controller.go:615] quota admission added evaluator for: daemonsets.apps
	I0815 00:14:30.709893       1 controller.go:615] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0815 00:14:30.712908       1 controller.go:615] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	I0815 00:14:50.440818       1 alloc.go:330] "allocated clusterIPs" service="default/invalid-svc" clusterIPs={"IPv4":"10.99.87.59"}
	I0815 00:14:56.345819       1 alloc.go:330] "allocated clusterIPs" service="default/nginx-svc" clusterIPs={"IPv4":"10.107.179.204"}
	I0815 00:15:06.714353       1 controller.go:615] quota admission added evaluator for: replicasets.apps
	I0815 00:15:06.756829       1 alloc.go:330] "allocated clusterIPs" service="default/hello-node-connect" clusterIPs={"IPv4":"10.106.55.117"}
	I0815 00:15:19.460659       1 alloc.go:330] "allocated clusterIPs" service="default/hello-node" clusterIPs={"IPv4":"10.110.242.161"}
	I0815 00:15:36.086397       1 controller.go:615] quota admission added evaluator for: namespaces
	I0815 00:15:36.176046       1 alloc.go:330] "allocated clusterIPs" service="kubernetes-dashboard/kubernetes-dashboard" clusterIPs={"IPv4":"10.103.171.16"}
	I0815 00:15:36.184647       1 alloc.go:330] "allocated clusterIPs" service="kubernetes-dashboard/dashboard-metrics-scraper" clusterIPs={"IPv4":"10.111.244.19"}
	
	
	==> kube-controller-manager [489fac343e99] <==
	I0815 00:13:51.284099       1 actual_state_of_world.go:540] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"functional-248000\" does not exist"
	I0815 00:13:51.285649       1 shared_informer.go:320] Caches are synced for taint-eviction-controller
	I0815 00:13:51.285676       1 shared_informer.go:320] Caches are synced for TTL
	I0815 00:13:51.286765       1 shared_informer.go:320] Caches are synced for endpoint_slice
	I0815 00:13:51.315637       1 shared_informer.go:320] Caches are synced for node
	I0815 00:13:51.315673       1 shared_informer.go:320] Caches are synced for taint
	I0815 00:13:51.315726       1 range_allocator.go:171] "Sending events to api server" logger="node-ipam-controller"
	I0815 00:13:51.315761       1 range_allocator.go:177] "Starting range CIDR allocator" logger="node-ipam-controller"
	I0815 00:13:51.315807       1 shared_informer.go:313] Waiting for caches to sync for cidrallocator
	I0815 00:13:51.315830       1 shared_informer.go:320] Caches are synced for cidrallocator
	I0815 00:13:51.315895       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="functional-248000"
	I0815 00:13:51.315842       1 node_lifecycle_controller.go:1232] "Initializing eviction metric for zone" logger="node-lifecycle-controller" zone=""
	I0815 00:13:51.315983       1 node_lifecycle_controller.go:884] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="functional-248000"
	I0815 00:13:51.316029       1 node_lifecycle_controller.go:1078] "Controller detected that zone is now in new state" logger="node-lifecycle-controller" zone="" newState="Normal"
	I0815 00:13:51.331424       1 shared_informer.go:320] Caches are synced for daemon sets
	I0815 00:13:51.331469       1 shared_informer.go:320] Caches are synced for attach detach
	I0815 00:13:51.333471       1 shared_informer.go:320] Caches are synced for GC
	I0815 00:13:51.383804       1 shared_informer.go:320] Caches are synced for persistent volume
	I0815 00:13:51.385377       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="255.383207ms"
	I0815 00:13:51.385484       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="32.029µs"
	I0815 00:13:51.741715       1 shared_informer.go:320] Caches are synced for garbage collector
	I0815 00:13:51.796821       1 shared_informer.go:320] Caches are synced for garbage collector
	I0815 00:13:51.796873       1 garbagecollector.go:157] "All resource monitors have synced. Proceeding to collect garbage" logger="garbage-collector-controller"
	I0815 00:13:54.498460       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="9.683051ms"
	I0815 00:13:54.498561       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="64.477µs"
	
	
	==> kube-controller-manager [c345c3da9716] <==
	I0815 00:15:19.433021       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="22.456µs"
	I0815 00:15:19.436868       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="11.999µs"
	I0815 00:15:20.353999       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="29.497µs"
	I0815 00:15:21.376424       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="71.368µs"
	I0815 00:15:24.450733       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="64.786µs"
	I0815 00:15:30.525740       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="functional-248000"
	I0815 00:15:36.114720       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="10.61906ms"
	E0815 00:15:36.114738       1 replica_set.go:560] "Unhandled Error" err="sync \"kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4\" failed with pods \"dashboard-metrics-scraper-c5db448b4-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"
	I0815 00:15:36.121265       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="5.132776ms"
	E0815 00:15:36.121284       1 replica_set.go:560] "Unhandled Error" err="sync \"kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4\" failed with pods \"dashboard-metrics-scraper-c5db448b4-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"
	I0815 00:15:36.125467       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="12.311238ms"
	E0815 00:15:36.125605       1 replica_set.go:560] "Unhandled Error" err="sync \"kubernetes-dashboard/kubernetes-dashboard-695b96c756\" failed with pods \"kubernetes-dashboard-695b96c756-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"
	I0815 00:15:36.125971       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="3.509551ms"
	E0815 00:15:36.126019       1 replica_set.go:560] "Unhandled Error" err="sync \"kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4\" failed with pods \"dashboard-metrics-scraper-c5db448b4-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"
	I0815 00:15:36.134757       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="7.476684ms"
	E0815 00:15:36.134775       1 replica_set.go:560] "Unhandled Error" err="sync \"kubernetes-dashboard/kubernetes-dashboard-695b96c756\" failed with pods \"kubernetes-dashboard-695b96c756-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"
	I0815 00:15:36.154941       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="20.821618ms"
	I0815 00:15:36.159126       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="20.719628ms"
	I0815 00:15:36.164875       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="9.244562ms"
	I0815 00:15:36.165189       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="42.787µs"
	I0815 00:15:36.172307       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="13.086666ms"
	I0815 00:15:36.172338       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="14.207µs"
	I0815 00:15:36.596428       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="25.039µs"
	I0815 00:15:37.596537       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="25.747µs"
	I0815 00:15:37.628941       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="23.831µs"
	
	
	==> kube-proxy [25ed962e889d] <==
		add table ip kube-proxy
		^^^^^^^^^^^^^^^^^^^^^^^^
	 >
	E0815 00:14:30.104418       1 proxier.go:734] "Error cleaning up nftables rules" err=<
		could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported
		add table ip6 kube-proxy
		^^^^^^^^^^^^^^^^^^^^^^^^^
	 >
	I0815 00:14:30.111798       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.105.4"]
	E0815 00:14:30.111827       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
	I0815 00:14:30.127544       1 server_linux.go:146] "No iptables support for family" ipFamily="IPv6"
	I0815 00:14:30.127566       1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"
	I0815 00:14:30.127581       1 server_linux.go:169] "Using iptables Proxier"
	I0815 00:14:30.128194       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
	I0815 00:14:30.128311       1 server.go:483] "Version info" version="v1.31.0"
	I0815 00:14:30.128379       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0815 00:14:30.128849       1 config.go:197] "Starting service config controller"
	I0815 00:14:30.128865       1 shared_informer.go:313] Waiting for caches to sync for service config
	I0815 00:14:30.128873       1 config.go:104] "Starting endpoint slice config controller"
	I0815 00:14:30.128875       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
	I0815 00:14:30.129145       1 config.go:326] "Starting node config controller"
	I0815 00:14:30.129148       1 shared_informer.go:313] Waiting for caches to sync for node config
	I0815 00:14:30.229249       1 shared_informer.go:320] Caches are synced for node config
	I0815 00:14:30.229298       1 shared_informer.go:320] Caches are synced for service config
	I0815 00:14:30.229308       1 shared_informer.go:320] Caches are synced for endpoint slice config
	
	
	==> kube-proxy [ed2dbc6f677a] <==
		add table ip kube-proxy
		^^^^^^^^^^^^^^^^^^^^^^^^
	 >
	E0815 00:13:48.872326       1 proxier.go:734] "Error cleaning up nftables rules" err=<
		could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported
		add table ip6 kube-proxy
		^^^^^^^^^^^^^^^^^^^^^^^^^
	 >
	I0815 00:13:48.875263       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.105.4"]
	E0815 00:13:48.875336       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
	I0815 00:13:48.885021       1 server_linux.go:146] "No iptables support for family" ipFamily="IPv6"
	I0815 00:13:48.885037       1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"
	I0815 00:13:48.885050       1 server_linux.go:169] "Using iptables Proxier"
	I0815 00:13:48.885949       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
	I0815 00:13:48.886046       1 server.go:483] "Version info" version="v1.31.0"
	I0815 00:13:48.886050       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0815 00:13:48.886684       1 config.go:197] "Starting service config controller"
	I0815 00:13:48.886690       1 shared_informer.go:313] Waiting for caches to sync for service config
	I0815 00:13:48.886699       1 config.go:104] "Starting endpoint slice config controller"
	I0815 00:13:48.886701       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
	I0815 00:13:48.886855       1 config.go:326] "Starting node config controller"
	I0815 00:13:48.886857       1 shared_informer.go:313] Waiting for caches to sync for node config
	I0815 00:13:48.987277       1 shared_informer.go:320] Caches are synced for node config
	I0815 00:13:48.987277       1 shared_informer.go:320] Caches are synced for service config
	I0815 00:13:48.987289       1 shared_informer.go:320] Caches are synced for endpoint slice config
	
	
	==> kube-scheduler [288580365d03] <==
	I0815 00:13:46.379060       1 serving.go:386] Generated self-signed cert in-memory
	W0815 00:13:47.775119       1 requestheader_controller.go:196] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
	W0815 00:13:47.775186       1 authentication.go:370] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
	W0815 00:13:47.775205       1 authentication.go:371] Continuing without authentication configuration. This may treat all requests as anonymous.
	W0815 00:13:47.775236       1 authentication.go:372] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
	I0815 00:13:47.812713       1 server.go:167] "Starting Kubernetes Scheduler" version="v1.31.0"
	I0815 00:13:47.812728       1 server.go:169] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0815 00:13:47.813645       1 secure_serving.go:213] Serving securely on 127.0.0.1:10259
	I0815 00:13:47.813688       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	I0815 00:13:47.813714       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0815 00:13:47.813725       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
	I0815 00:13:47.915692       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0815 00:14:12.525480       1 secure_serving.go:258] Stopped listening on 127.0.0.1:10259
	I0815 00:14:12.525517       1 tlsconfig.go:258] "Shutting down DynamicServingCertificateController"
	E0815 00:14:12.525586       1 run.go:72] "command failed" err="finished without leader elect"
	
	
	==> kube-scheduler [591886a64a5f] <==
	I0815 00:14:27.709758       1 serving.go:386] Generated self-signed cert in-memory
	W0815 00:14:29.283546       1 requestheader_controller.go:196] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
	W0815 00:14:29.283564       1 authentication.go:370] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
	W0815 00:14:29.283569       1 authentication.go:371] Continuing without authentication configuration. This may treat all requests as anonymous.
	W0815 00:14:29.283573       1 authentication.go:372] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
	I0815 00:14:29.327528       1 server.go:167] "Starting Kubernetes Scheduler" version="v1.31.0"
	I0815 00:14:29.327542       1 server.go:169] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0815 00:14:29.328479       1 secure_serving.go:213] Serving securely on 127.0.0.1:10259
	I0815 00:14:29.328536       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	I0815 00:14:29.328555       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0815 00:14:29.328571       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
	I0815 00:14:29.428753       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	
	==> kubelet <==
	Aug 15 00:15:26 functional-248000 kubelet[6319]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
	Aug 15 00:15:26 functional-248000 kubelet[6319]:         Perhaps ip6tables or your kernel needs to be upgraded.
	Aug 15 00:15:26 functional-248000 kubelet[6319]:  > table="nat" chain="KUBE-KUBELET-CANARY"
	Aug 15 00:15:26 functional-248000 kubelet[6319]: I0815 00:15:26.656432    6319 scope.go:117] "RemoveContainer" containerID="33b07d1ca8e8890d72bab8543bd363ce97ceac52b5b160d05a1dc0edffc9fe9a"
	Aug 15 00:15:28 functional-248000 kubelet[6319]: I0815 00:15:28.770549    6319 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wrdn\" (UniqueName: \"kubernetes.io/projected/77aa892c-c14f-47c0-b8c5-db04d74dcc65-kube-api-access-7wrdn\") pod \"busybox-mount\" (UID: \"77aa892c-c14f-47c0-b8c5-db04d74dcc65\") " pod="default/busybox-mount"
	Aug 15 00:15:28 functional-248000 kubelet[6319]: I0815 00:15:28.770606    6319 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-volume\" (UniqueName: \"kubernetes.io/host-path/77aa892c-c14f-47c0-b8c5-db04d74dcc65-test-volume\") pod \"busybox-mount\" (UID: \"77aa892c-c14f-47c0-b8c5-db04d74dcc65\") " pod="default/busybox-mount"
	Aug 15 00:15:31 functional-248000 kubelet[6319]: I0815 00:15:31.796964    6319 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"test-volume\" (UniqueName: \"kubernetes.io/host-path/77aa892c-c14f-47c0-b8c5-db04d74dcc65-test-volume\") pod \"77aa892c-c14f-47c0-b8c5-db04d74dcc65\" (UID: \"77aa892c-c14f-47c0-b8c5-db04d74dcc65\") "
	Aug 15 00:15:31 functional-248000 kubelet[6319]: I0815 00:15:31.797002    6319 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wrdn\" (UniqueName: \"kubernetes.io/projected/77aa892c-c14f-47c0-b8c5-db04d74dcc65-kube-api-access-7wrdn\") pod \"77aa892c-c14f-47c0-b8c5-db04d74dcc65\" (UID: \"77aa892c-c14f-47c0-b8c5-db04d74dcc65\") "
	Aug 15 00:15:31 functional-248000 kubelet[6319]: I0815 00:15:31.797216    6319 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/77aa892c-c14f-47c0-b8c5-db04d74dcc65-test-volume" (OuterVolumeSpecName: "test-volume") pod "77aa892c-c14f-47c0-b8c5-db04d74dcc65" (UID: "77aa892c-c14f-47c0-b8c5-db04d74dcc65"). InnerVolumeSpecName "test-volume". PluginName "kubernetes.io/host-path", VolumeGidValue ""
	Aug 15 00:15:31 functional-248000 kubelet[6319]: I0815 00:15:31.798734    6319 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77aa892c-c14f-47c0-b8c5-db04d74dcc65-kube-api-access-7wrdn" (OuterVolumeSpecName: "kube-api-access-7wrdn") pod "77aa892c-c14f-47c0-b8c5-db04d74dcc65" (UID: "77aa892c-c14f-47c0-b8c5-db04d74dcc65"). InnerVolumeSpecName "kube-api-access-7wrdn". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Aug 15 00:15:31 functional-248000 kubelet[6319]: I0815 00:15:31.899232    6319 reconciler_common.go:288] "Volume detached for volume \"test-volume\" (UniqueName: \"kubernetes.io/host-path/77aa892c-c14f-47c0-b8c5-db04d74dcc65-test-volume\") on node \"functional-248000\" DevicePath \"\""
	Aug 15 00:15:31 functional-248000 kubelet[6319]: I0815 00:15:31.899245    6319 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-7wrdn\" (UniqueName: \"kubernetes.io/projected/77aa892c-c14f-47c0-b8c5-db04d74dcc65-kube-api-access-7wrdn\") on node \"functional-248000\" DevicePath \"\""
	Aug 15 00:15:32 functional-248000 kubelet[6319]: I0815 00:15:32.560384    6319 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ddab35989d23d4e60c3a7b4a33a5acbf9925f790a345c7c31dce1e9ff8dee0a"
	Aug 15 00:15:36 functional-248000 kubelet[6319]: E0815 00:15:36.143592    6319 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="77aa892c-c14f-47c0-b8c5-db04d74dcc65" containerName="mount-munger"
	Aug 15 00:15:36 functional-248000 kubelet[6319]: I0815 00:15:36.143620    6319 memory_manager.go:354] "RemoveStaleState removing state" podUID="77aa892c-c14f-47c0-b8c5-db04d74dcc65" containerName="mount-munger"
	Aug 15 00:15:36 functional-248000 kubelet[6319]: I0815 00:15:36.149919    6319 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-volume\" (UniqueName: \"kubernetes.io/empty-dir/eef9cde1-6719-4518-8077-7381a62a1da1-tmp-volume\") pod \"dashboard-metrics-scraper-c5db448b4-bg7g7\" (UID: \"eef9cde1-6719-4518-8077-7381a62a1da1\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4-bg7g7"
	Aug 15 00:15:36 functional-248000 kubelet[6319]: I0815 00:15:36.149935    6319 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d5de7a4-974a-437f-b3c5-638e98f71a34-tmp-volume\") pod \"kubernetes-dashboard-695b96c756-xqk57\" (UID: \"1d5de7a4-974a-437f-b3c5-638e98f71a34\") " pod="kubernetes-dashboard/kubernetes-dashboard-695b96c756-xqk57"
	Aug 15 00:15:36 functional-248000 kubelet[6319]: I0815 00:15:36.149947    6319 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt2tv\" (UniqueName: \"kubernetes.io/projected/eef9cde1-6719-4518-8077-7381a62a1da1-kube-api-access-jt2tv\") pod \"dashboard-metrics-scraper-c5db448b4-bg7g7\" (UID: \"eef9cde1-6719-4518-8077-7381a62a1da1\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4-bg7g7"
	Aug 15 00:15:36 functional-248000 kubelet[6319]: I0815 00:15:36.149955    6319 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfrs9\" (UniqueName: \"kubernetes.io/projected/1d5de7a4-974a-437f-b3c5-638e98f71a34-kube-api-access-wfrs9\") pod \"kubernetes-dashboard-695b96c756-xqk57\" (UID: \"1d5de7a4-974a-437f-b3c5-638e98f71a34\") " pod="kubernetes-dashboard/kubernetes-dashboard-695b96c756-xqk57"
	Aug 15 00:15:36 functional-248000 kubelet[6319]: I0815 00:15:36.592615    6319 scope.go:117] "RemoveContainer" containerID="44b2d6ca07a6ab74e925aa5a7a250aa79f917f9cab4d67ed2c15ec45181ada85"
	Aug 15 00:15:37 functional-248000 kubelet[6319]: I0815 00:15:37.592602    6319 scope.go:117] "RemoveContainer" containerID="ac13f8bbc528605a08c709ad3f6882e9d030688c0154a0435a55e523ead1835f"
	Aug 15 00:15:37 functional-248000 kubelet[6319]: E0815 00:15:37.595168    6319 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 20s restarting failed container=echoserver-arm pod=hello-node-connect-65d86f57f4-wdz9m_default(013db01b-b84f-487a-9252-a991ceea9ab3)\"" pod="default/hello-node-connect-65d86f57f4-wdz9m" podUID="013db01b-b84f-487a-9252-a991ceea9ab3"
	Aug 15 00:15:37 functional-248000 kubelet[6319]: I0815 00:15:37.620561    6319 scope.go:117] "RemoveContainer" containerID="44b2d6ca07a6ab74e925aa5a7a250aa79f917f9cab4d67ed2c15ec45181ada85"
	Aug 15 00:15:37 functional-248000 kubelet[6319]: I0815 00:15:37.620714    6319 scope.go:117] "RemoveContainer" containerID="dbfe47233bcc92841debe0b49bfbc69edbbb0b08a612d05da82e7d7bfd67da62"
	Aug 15 00:15:37 functional-248000 kubelet[6319]: E0815 00:15:37.620777    6319 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 20s restarting failed container=echoserver-arm pod=hello-node-64b4f8f9ff-pcth6_default(b965467d-be4f-41e6-b4b1-61f6a55c96d8)\"" pod="default/hello-node-64b4f8f9ff-pcth6" podUID="b965467d-be4f-41e6-b4b1-61f6a55c96d8"
	
	
	==> storage-provisioner [35c95e702fd4] <==
	I0815 00:13:48.818964       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0815 00:13:48.830767       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0815 00:13:48.830790       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0815 00:14:06.266776       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0815 00:14:06.267804       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"cdf3a578-e8e5-4929-8519-f4c112534eee", APIVersion:"v1", ResourceVersion:"494", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-248000_0f172b67-1cd4-473c-8d1e-96a4244aec82 became leader
	I0815 00:14:06.267950       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-248000_0f172b67-1cd4-473c-8d1e-96a4244aec82!
	I0815 00:14:06.368472       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-248000_0f172b67-1cd4-473c-8d1e-96a4244aec82!
	
	
	==> storage-provisioner [5ede1765a8b6] <==
	I0815 00:14:30.055506       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0815 00:14:30.066581       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0815 00:14:30.066599       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0815 00:14:47.478846       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0815 00:14:47.479063       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"cdf3a578-e8e5-4929-8519-f4c112534eee", APIVersion:"v1", ResourceVersion:"600", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-248000_f035cc11-a502-43ab-8556-a62c1b8eb7ec became leader
	I0815 00:14:47.479416       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-248000_f035cc11-a502-43ab-8556-a62c1b8eb7ec!
	I0815 00:14:47.583720       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-248000_f035cc11-a502-43ab-8556-a62c1b8eb7ec!
	I0815 00:15:00.567715       1 controller.go:1332] provision "default/myclaim" class "standard": started
	I0815 00:15:00.568390       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"eaaaa79b-f123-4b96-84f3-5cb9f7f639fd", APIVersion:"v1", ResourceVersion:"661", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/myclaim"
	I0815 00:15:00.567757       1 storage_provisioner.go:61] Provisioning volume {&StorageClass{ObjectMeta:{standard    91e3b202-3fc1-46b7-bfb1-0a6ea8084b37 336 0 2024-08-15 00:13:20 +0000 UTC <nil> <nil> map[addonmanager.kubernetes.io/mode:EnsureExists] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"storage.k8s.io/v1","kind":"StorageClass","metadata":{"annotations":{"storageclass.kubernetes.io/is-default-class":"true"},"labels":{"addonmanager.kubernetes.io/mode":"EnsureExists"},"name":"standard"},"provisioner":"k8s.io/minikube-hostpath"}
	 storageclass.kubernetes.io/is-default-class:true] [] []  [{kubectl-client-side-apply Update storage.k8s.io/v1 2024-08-15 00:13:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{},"f:storageclass.kubernetes.io/is-default-class":{}},"f:labels":{".":{},"f:addonmanager.kubernetes.io/mode":{}}},"f:provisioner":{},"f:reclaimPolicy":{},"f:volumeBindingMode":{}}}]},Provisioner:k8s.io/minikube-hostpath,Parameters:map[string]string{},ReclaimPolicy:*Delete,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*Immediate,AllowedTopologies:[]TopologySelectorTerm{},} pvc-eaaaa79b-f123-4b96-84f3-5cb9f7f639fd &PersistentVolumeClaim{ObjectMeta:{myclaim  default  eaaaa79b-f123-4b96-84f3-5cb9f7f639fd 661 0 2024-08-15 00:15:00 +0000 UTC <nil> <nil> map[] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"myclaim","namespace":"default"},"spec":{"accessModes":["Rea
dWriteOnce"],"resources":{"requests":{"storage":"500Mi"}},"volumeMode":"Filesystem"}}
	 volume.beta.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath volume.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath] [] [kubernetes.io/pvc-protection]  [{kube-controller-manager Update v1 2024-08-15 00:15:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}}}} {kubectl-client-side-apply Update v1 2024-08-15 00:15:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}}}]},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{524288000 0} {<nil>} 500Mi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*standard,VolumeMode:*Filesystem,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:
ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},} nil} to /tmp/hostpath-provisioner/default/myclaim
	I0815 00:15:00.568705       1 controller.go:1439] provision "default/myclaim" class "standard": volume "pvc-eaaaa79b-f123-4b96-84f3-5cb9f7f639fd" provisioned
	I0815 00:15:00.568717       1 controller.go:1456] provision "default/myclaim" class "standard": succeeded
	I0815 00:15:00.568720       1 volume_store.go:212] Trying to save persistentvolume "pvc-eaaaa79b-f123-4b96-84f3-5cb9f7f639fd"
	I0815 00:15:00.574163       1 volume_store.go:219] persistentvolume "pvc-eaaaa79b-f123-4b96-84f3-5cb9f7f639fd" saved
	I0815 00:15:00.575800       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"eaaaa79b-f123-4b96-84f3-5cb9f7f639fd", APIVersion:"v1", ResourceVersion:"661", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-eaaaa79b-f123-4b96-84f3-5cb9f7f639fd
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p functional-248000 -n functional-248000
helpers_test.go:261: (dbg) Run:  kubectl --context functional-248000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: busybox-mount dashboard-metrics-scraper-c5db448b4-bg7g7 kubernetes-dashboard-695b96c756-xqk57
helpers_test.go:274: ======> post-mortem[TestFunctional/parallel/ServiceCmdConnect]: describe non-running pods <======
helpers_test.go:277: (dbg) Run:  kubectl --context functional-248000 describe pod busybox-mount dashboard-metrics-scraper-c5db448b4-bg7g7 kubernetes-dashboard-695b96c756-xqk57
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context functional-248000 describe pod busybox-mount dashboard-metrics-scraper-c5db448b4-bg7g7 kubernetes-dashboard-695b96c756-xqk57: exit status 1 (41.292167ms)

                                                
                                                
-- stdout --
	Name:             busybox-mount
	Namespace:        default
	Priority:         0
	Service Account:  default
	Node:             functional-248000/192.168.105.4
	Start Time:       Wed, 14 Aug 2024 17:15:28 -0700
	Labels:           integration-test=busybox-mount
	Annotations:      <none>
	Status:           Succeeded
	IP:               10.244.0.11
	IPs:
	  IP:  10.244.0.11
	Containers:
	  mount-munger:
	    Container ID:  docker://68b9884e824a3a52f5744e45e43c187fc54b1c9dd1b4f9d2e1c4c3e824dba0d4
	    Image:         gcr.io/k8s-minikube/busybox:1.28.4-glibc
	    Image ID:      docker-pullable://gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e
	    Port:          <none>
	    Host Port:     <none>
	    Command:
	      /bin/sh
	      -c
	      --
	    Args:
	      cat /mount-9p/created-by-test; echo test > /mount-9p/created-by-pod; rm /mount-9p/created-by-test-removed-by-pod; echo test > /mount-9p/created-by-pod-removed-by-test date >> /mount-9p/pod-dates
	    State:          Terminated
	      Reason:       Completed
	      Exit Code:    0
	      Started:      Wed, 14 Aug 2024 17:15:30 -0700
	      Finished:     Wed, 14 Aug 2024 17:15:30 -0700
	    Ready:          False
	    Restart Count:  0
	    Environment:    <none>
	    Mounts:
	      /mount-9p from test-volume (rw)
	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-7wrdn (ro)
	Conditions:
	  Type                        Status
	  PodReadyToStartContainers   False 
	  Initialized                 True 
	  Ready                       False 
	  ContainersReady             False 
	  PodScheduled                True 
	Volumes:
	  test-volume:
	    Type:          HostPath (bare host directory volume)
	    Path:          /mount-9p
	    HostPathType:  
	  kube-api-access-7wrdn:
	    Type:                    Projected (a volume that contains injected data from multiple sources)
	    TokenExpirationSeconds:  3607
	    ConfigMapName:           kube-root-ca.crt
	    ConfigMapOptional:       <nil>
	    DownwardAPI:             true
	QoS Class:                   BestEffort
	Node-Selectors:              <none>
	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
	Events:
	  Type    Reason     Age   From               Message
	  ----    ------     ----  ----               -------
	  Normal  Scheduled  9s    default-scheduler  Successfully assigned default/busybox-mount to functional-248000
	  Normal  Pulling    10s   kubelet            Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"
	  Normal  Pulled     8s    kubelet            Successfully pulled image "gcr.io/k8s-minikube/busybox:1.28.4-glibc" in 1.409s (1.409s including waiting). Image size: 3547125 bytes.
	  Normal  Created    8s    kubelet            Created container mount-munger
	  Normal  Started    8s    kubelet            Started container mount-munger

                                                
                                                
-- /stdout --
** stderr ** 
	Error from server (NotFound): pods "dashboard-metrics-scraper-c5db448b4-bg7g7" not found
	Error from server (NotFound): pods "kubernetes-dashboard-695b96c756-xqk57" not found

                                                
                                                
** /stderr **
helpers_test.go:279: kubectl --context functional-248000 describe pod busybox-mount dashboard-metrics-scraper-c5db448b4-bg7g7 kubernetes-dashboard-695b96c756-xqk57: exit status 1
--- FAIL: TestFunctional/parallel/ServiceCmdConnect (31.79s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StopSecondaryNode (214.15s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StopSecondaryNode
ha_test.go:363: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 node stop m02 -v=7 --alsologtostderr
E0814 17:19:55.385647    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:19:55.393255    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:19:55.406684    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:19:55.429780    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:19:55.473133    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:19:55.556493    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:19:55.719930    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:19:56.043357    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:19:56.686769    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:19:57.970207    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:20:00.533088    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:363: (dbg) Done: out/minikube-darwin-arm64 -p ha-512000 node stop m02 -v=7 --alsologtostderr: (12.195514666s)
ha_test.go:369: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 status -v=7 --alsologtostderr
E0814 17:20:05.655610    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:20:15.898145    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:20:36.381296    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:21:17.344010    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:22:39.259499    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:369: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-512000 status -v=7 --alsologtostderr: exit status 7 (2m55.989400958s)

                                                
                                                
-- stdout --
	ha-512000
	type: Control Plane
	host: Error
	kubelet: Nonexistent
	apiserver: Nonexistent
	kubeconfig: Configured
	
	ha-512000-m02
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-512000-m03
	type: Control Plane
	host: Error
	kubelet: Nonexistent
	apiserver: Nonexistent
	kubeconfig: Configured
	
	ha-512000-m04
	type: Worker
	host: Error
	kubelet: Nonexistent
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:20:02.495743    2519 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:20:02.495939    2519 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:20:02.495943    2519 out.go:304] Setting ErrFile to fd 2...
	I0814 17:20:02.495946    2519 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:20:02.496104    2519 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:20:02.496240    2519 out.go:298] Setting JSON to false
	I0814 17:20:02.496254    2519 mustload.go:65] Loading cluster: ha-512000
	I0814 17:20:02.496293    2519 notify.go:220] Checking for updates...
	I0814 17:20:02.496521    2519 config.go:182] Loaded profile config "ha-512000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:20:02.496528    2519 status.go:255] checking status of ha-512000 ...
	I0814 17:20:02.497471    2519 status.go:330] ha-512000 host status = "Running" (err=<nil>)
	I0814 17:20:02.497492    2519 host.go:66] Checking if "ha-512000" exists ...
	I0814 17:20:02.497642    2519 host.go:66] Checking if "ha-512000" exists ...
	I0814 17:20:02.497770    2519 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0814 17:20:02.497783    2519 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000/id_rsa Username:docker}
	W0814 17:20:28.420575    2519 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: operation timed out
	W0814 17:20:28.420719    2519 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out
	E0814 17:20:28.420755    2519 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out
	I0814 17:20:28.420781    2519 status.go:257] ha-512000 status: &{Name:ha-512000 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	E0814 17:20:28.420808    2519 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out
	I0814 17:20:28.420818    2519 status.go:255] checking status of ha-512000-m02 ...
	I0814 17:20:28.421053    2519 status.go:330] ha-512000-m02 host status = "Stopped" (err=<nil>)
	I0814 17:20:28.421060    2519 status.go:343] host is not running, skipping remaining checks
	I0814 17:20:28.421062    2519 status.go:257] ha-512000-m02 status: &{Name:ha-512000-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0814 17:20:28.421067    2519 status.go:255] checking status of ha-512000-m03 ...
	I0814 17:20:28.422034    2519 status.go:330] ha-512000-m03 host status = "Running" (err=<nil>)
	I0814 17:20:28.422047    2519 host.go:66] Checking if "ha-512000-m03" exists ...
	I0814 17:20:28.422345    2519 host.go:66] Checking if "ha-512000-m03" exists ...
	I0814 17:20:28.422625    2519 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0814 17:20:28.422642    2519 sshutil.go:53] new ssh client: &{IP:192.168.105.7 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000-m03/id_rsa Username:docker}
	W0814 17:21:43.424025    2519 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.7:22: connect: operation timed out
	W0814 17:21:43.424120    2519 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out
	E0814 17:21:43.424138    2519 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out
	I0814 17:21:43.424148    2519 status.go:257] ha-512000-m03 status: &{Name:ha-512000-m03 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	E0814 17:21:43.424198    2519 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out
	I0814 17:21:43.424208    2519 status.go:255] checking status of ha-512000-m04 ...
	I0814 17:21:43.425918    2519 status.go:330] ha-512000-m04 host status = "Running" (err=<nil>)
	I0814 17:21:43.425935    2519 host.go:66] Checking if "ha-512000-m04" exists ...
	I0814 17:21:43.426200    2519 host.go:66] Checking if "ha-512000-m04" exists ...
	I0814 17:21:43.426514    2519 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0814 17:21:43.426532    2519 sshutil.go:53] new ssh client: &{IP:192.168.105.8 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000-m04/id_rsa Username:docker}
	W0814 17:22:58.413322    2519 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.8:22: connect: operation timed out
	W0814 17:22:58.413370    2519 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out
	E0814 17:22:58.413380    2519 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out
	I0814 17:22:58.413383    2519 status.go:257] ha-512000-m04 status: &{Name:ha-512000-m04 Host:Error Kubelet:Nonexistent APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
	E0814 17:22:58.413393    2519 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

                                                
                                                
** /stderr **
ha_test.go:378: status says not three hosts are running: args "out/minikube-darwin-arm64 -p ha-512000 status -v=7 --alsologtostderr": ha-512000
type: Control Plane
host: Error
kubelet: Nonexistent
apiserver: Nonexistent
kubeconfig: Configured

                                                
                                                
ha-512000-m02
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha-512000-m03
type: Control Plane
host: Error
kubelet: Nonexistent
apiserver: Nonexistent
kubeconfig: Configured

                                                
                                                
ha-512000-m04
type: Worker
host: Error
kubelet: Nonexistent

                                                
                                                
ha_test.go:381: status says not three kubelets are running: args "out/minikube-darwin-arm64 -p ha-512000 status -v=7 --alsologtostderr": ha-512000
type: Control Plane
host: Error
kubelet: Nonexistent
apiserver: Nonexistent
kubeconfig: Configured

                                                
                                                
ha-512000-m02
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha-512000-m03
type: Control Plane
host: Error
kubelet: Nonexistent
apiserver: Nonexistent
kubeconfig: Configured

                                                
                                                
ha-512000-m04
type: Worker
host: Error
kubelet: Nonexistent

                                                
                                                
ha_test.go:384: status says not two apiservers are running: args "out/minikube-darwin-arm64 -p ha-512000 status -v=7 --alsologtostderr": ha-512000
type: Control Plane
host: Error
kubelet: Nonexistent
apiserver: Nonexistent
kubeconfig: Configured

                                                
                                                
ha-512000-m02
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha-512000-m03
type: Control Plane
host: Error
kubelet: Nonexistent
apiserver: Nonexistent
kubeconfig: Configured

                                                
                                                
ha-512000-m04
type: Worker
host: Error
kubelet: Nonexistent

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-512000 -n ha-512000
E0814 17:23:21.384810    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-512000 -n ha-512000: exit status 3 (25.959849584s)

                                                
                                                
-- stdout --
	Error

                                                
                                                
-- /stdout --
** stderr ** 
	E0814 17:23:24.370544    2552 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out
	E0814 17:23:24.370551    2552 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

                                                
                                                
** /stderr **
helpers_test.go:239: status error: exit status 3 (may be ok)
helpers_test.go:241: "ha-512000" host is not running, skipping log retrieval (state="Error")
--- FAIL: TestMultiControlPlane/serial/StopSecondaryNode (214.15s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (102.83s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop
ha_test.go:390: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json
ha_test.go:390: (dbg) Done: out/minikube-darwin-arm64 profile list --output json: (1m16.867542791s)
ha_test.go:413: expected profile "ha-512000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-512000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-512000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"
:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.0\",\"ClusterName\":\"ha-512000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.168.105.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.168.105.5\",\"Port\":8443,\"K
ubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m02\",\"IP\":\"192.168.105.6\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m03\",\"IP\":\"192.168.105.7\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"192.168.105.8\",\"Port\":0,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"helm-tiller\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kubevirt\
":false,\"logviewer\":false,\"metallb\":false,\"metrics-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\"registry\":false,\"registry-aliases\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-gluster\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docke
r\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":true}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-512000 -n ha-512000
E0814 17:24:55.364317    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-512000 -n ha-512000: exit status 3 (25.964000958s)

                                                
                                                
-- stdout --
	Error

                                                
                                                
-- /stdout --
** stderr ** 
	E0814 17:25:07.195889    2578 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out
	E0814 17:25:07.195947    2578 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

                                                
                                                
** /stderr **
helpers_test.go:239: status error: exit status 3 (may be ok)
helpers_test.go:241: "ha-512000" host is not running, skipping log retrieval (state="Error")
--- FAIL: TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (102.83s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartSecondaryNode (209.28s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartSecondaryNode
ha_test.go:420: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 node start m02 -v=7 --alsologtostderr
ha_test.go:420: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-512000 node start m02 -v=7 --alsologtostderr: exit status 80 (5.123301375s)

                                                
                                                
-- stdout --
	* Starting "ha-512000-m02" control-plane node in "ha-512000" cluster
	* Restarting existing qemu2 VM for "ha-512000-m02" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "ha-512000-m02" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:25:07.270854    2589 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:25:07.271133    2589 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:25:07.271138    2589 out.go:304] Setting ErrFile to fd 2...
	I0814 17:25:07.271141    2589 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:25:07.271305    2589 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:25:07.271634    2589 mustload.go:65] Loading cluster: ha-512000
	I0814 17:25:07.271978    2589 config.go:182] Loaded profile config "ha-512000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	W0814 17:25:07.272275    2589 host.go:58] "ha-512000-m02" host status: Stopped
	I0814 17:25:07.275741    2589 out.go:177] * Starting "ha-512000-m02" control-plane node in "ha-512000" cluster
	I0814 17:25:07.279659    2589 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:25:07.279683    2589 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:25:07.279696    2589 cache.go:56] Caching tarball of preloaded images
	I0814 17:25:07.279802    2589 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:25:07.279809    2589 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:25:07.279890    2589 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/ha-512000/config.json ...
	I0814 17:25:07.280331    2589 start.go:360] acquireMachinesLock for ha-512000-m02: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:25:07.280390    2589 start.go:364] duration metric: took 42.375µs to acquireMachinesLock for "ha-512000-m02"
	I0814 17:25:07.280405    2589 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:25:07.280409    2589 fix.go:54] fixHost starting: m02
	I0814 17:25:07.280590    2589 fix.go:112] recreateIfNeeded on ha-512000-m02: state=Stopped err=<nil>
	W0814 17:25:07.280598    2589 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:25:07.284597    2589 out.go:177] * Restarting existing qemu2 VM for "ha-512000-m02" ...
	I0814 17:25:07.288677    2589 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:25:07.288757    2589 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000-m02/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000-m02/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000-m02/qemu.pid -device virtio-net-pci,netdev=net0,mac=62:12:a9:a8:36:96 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000-m02/disk.qcow2
	I0814 17:25:07.292045    2589 main.go:141] libmachine: STDOUT: 
	I0814 17:25:07.292070    2589 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:25:07.292097    2589 fix.go:56] duration metric: took 11.6865ms for fixHost
	I0814 17:25:07.292102    2589 start.go:83] releasing machines lock for "ha-512000-m02", held for 11.703041ms
	W0814 17:25:07.292107    2589 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:25:07.292138    2589 out.go:239] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:25:07.292144    2589 start.go:729] Will try again in 5 seconds ...
	I0814 17:25:12.294156    2589 start.go:360] acquireMachinesLock for ha-512000-m02: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:25:12.294318    2589 start.go:364] duration metric: took 108.208µs to acquireMachinesLock for "ha-512000-m02"
	I0814 17:25:12.294351    2589 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:25:12.294355    2589 fix.go:54] fixHost starting: m02
	I0814 17:25:12.294510    2589 fix.go:112] recreateIfNeeded on ha-512000-m02: state=Stopped err=<nil>
	W0814 17:25:12.294515    2589 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:25:12.299039    2589 out.go:177] * Restarting existing qemu2 VM for "ha-512000-m02" ...
	I0814 17:25:12.303083    2589 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:25:12.303171    2589 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000-m02/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000-m02/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000-m02/qemu.pid -device virtio-net-pci,netdev=net0,mac=62:12:a9:a8:36:96 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000-m02/disk.qcow2
	I0814 17:25:12.305507    2589 main.go:141] libmachine: STDOUT: 
	I0814 17:25:12.305531    2589 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:25:12.305552    2589 fix.go:56] duration metric: took 11.197583ms for fixHost
	I0814 17:25:12.305556    2589 start.go:83] releasing machines lock for "ha-512000-m02", held for 11.233625ms
	W0814 17:25:12.305613    2589 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p ha-512000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p ha-512000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:25:12.310012    2589 out.go:177] 
	W0814 17:25:12.314070    2589 out.go:239] X Exiting due to GUEST_NODE_PROVISION: provisioning host for node: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_NODE_PROVISION: provisioning host for node: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:25:12.314083    2589 out.go:239] * 
	* 
	W0814 17:25:12.315805    2589 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:25:12.320007    2589 out.go:177] 

                                                
                                                
** /stderr **
ha_test.go:422: I0814 17:25:07.270854    2589 out.go:291] Setting OutFile to fd 1 ...
I0814 17:25:07.271133    2589 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0814 17:25:07.271138    2589 out.go:304] Setting ErrFile to fd 2...
I0814 17:25:07.271141    2589 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0814 17:25:07.271305    2589 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
I0814 17:25:07.271634    2589 mustload.go:65] Loading cluster: ha-512000
I0814 17:25:07.271978    2589 config.go:182] Loaded profile config "ha-512000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
W0814 17:25:07.272275    2589 host.go:58] "ha-512000-m02" host status: Stopped
I0814 17:25:07.275741    2589 out.go:177] * Starting "ha-512000-m02" control-plane node in "ha-512000" cluster
I0814 17:25:07.279659    2589 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
I0814 17:25:07.279683    2589 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
I0814 17:25:07.279696    2589 cache.go:56] Caching tarball of preloaded images
I0814 17:25:07.279802    2589 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
I0814 17:25:07.279809    2589 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
I0814 17:25:07.279890    2589 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/ha-512000/config.json ...
I0814 17:25:07.280331    2589 start.go:360] acquireMachinesLock for ha-512000-m02: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0814 17:25:07.280390    2589 start.go:364] duration metric: took 42.375µs to acquireMachinesLock for "ha-512000-m02"
I0814 17:25:07.280405    2589 start.go:96] Skipping create...Using existing machine configuration
I0814 17:25:07.280409    2589 fix.go:54] fixHost starting: m02
I0814 17:25:07.280590    2589 fix.go:112] recreateIfNeeded on ha-512000-m02: state=Stopped err=<nil>
W0814 17:25:07.280598    2589 fix.go:138] unexpected machine state, will restart: <nil>
I0814 17:25:07.284597    2589 out.go:177] * Restarting existing qemu2 VM for "ha-512000-m02" ...
I0814 17:25:07.288677    2589 qemu.go:418] Using hvf for hardware acceleration
I0814 17:25:07.288757    2589 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000-m02/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000-m02/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000-m02/qemu.pid -device virtio-net-pci,netdev=net0,mac=62:12:a9:a8:36:96 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000-m02/disk.qcow2
I0814 17:25:07.292045    2589 main.go:141] libmachine: STDOUT: 
I0814 17:25:07.292070    2589 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

                                                
                                                
I0814 17:25:07.292097    2589 fix.go:56] duration metric: took 11.6865ms for fixHost
I0814 17:25:07.292102    2589 start.go:83] releasing machines lock for "ha-512000-m02", held for 11.703041ms
W0814 17:25:07.292107    2589 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
W0814 17:25:07.292138    2589 out.go:239] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
I0814 17:25:07.292144    2589 start.go:729] Will try again in 5 seconds ...
I0814 17:25:12.294156    2589 start.go:360] acquireMachinesLock for ha-512000-m02: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0814 17:25:12.294318    2589 start.go:364] duration metric: took 108.208µs to acquireMachinesLock for "ha-512000-m02"
I0814 17:25:12.294351    2589 start.go:96] Skipping create...Using existing machine configuration
I0814 17:25:12.294355    2589 fix.go:54] fixHost starting: m02
I0814 17:25:12.294510    2589 fix.go:112] recreateIfNeeded on ha-512000-m02: state=Stopped err=<nil>
W0814 17:25:12.294515    2589 fix.go:138] unexpected machine state, will restart: <nil>
I0814 17:25:12.299039    2589 out.go:177] * Restarting existing qemu2 VM for "ha-512000-m02" ...
I0814 17:25:12.303083    2589 qemu.go:418] Using hvf for hardware acceleration
I0814 17:25:12.303171    2589 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000-m02/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000-m02/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000-m02/qemu.pid -device virtio-net-pci,netdev=net0,mac=62:12:a9:a8:36:96 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000-m02/disk.qcow2
I0814 17:25:12.305507    2589 main.go:141] libmachine: STDOUT: 
I0814 17:25:12.305531    2589 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

                                                
                                                
I0814 17:25:12.305552    2589 fix.go:56] duration metric: took 11.197583ms for fixHost
I0814 17:25:12.305556    2589 start.go:83] releasing machines lock for "ha-512000-m02", held for 11.233625ms
W0814 17:25:12.305613    2589 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p ha-512000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
* Failed to start qemu2 VM. Running "minikube delete -p ha-512000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
I0814 17:25:12.310012    2589 out.go:177] 
W0814 17:25:12.314070    2589 out.go:239] X Exiting due to GUEST_NODE_PROVISION: provisioning host for node: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
X Exiting due to GUEST_NODE_PROVISION: provisioning host for node: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
W0814 17:25:12.314083    2589 out.go:239] * 
* 
W0814 17:25:12.315805    2589 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
I0814 17:25:12.320007    2589 out.go:177] 
ha_test.go:423: secondary control-plane node start returned an error. args "out/minikube-darwin-arm64 -p ha-512000 node start m02 -v=7 --alsologtostderr": exit status 80
ha_test.go:428: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 status -v=7 --alsologtostderr
E0814 17:25:23.089885    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-512000 status -v=7 --alsologtostderr: exit status 7 (2m58.202037125s)

                                                
                                                
-- stdout --
	ha-512000
	type: Control Plane
	host: Error
	kubelet: Nonexistent
	apiserver: Nonexistent
	kubeconfig: Configured
	
	ha-512000-m02
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-512000-m03
	type: Control Plane
	host: Error
	kubelet: Nonexistent
	apiserver: Nonexistent
	kubeconfig: Configured
	
	ha-512000-m04
	type: Worker
	host: Error
	kubelet: Nonexistent
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:25:12.359773    2593 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:25:12.359934    2593 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:25:12.359939    2593 out.go:304] Setting ErrFile to fd 2...
	I0814 17:25:12.359941    2593 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:25:12.360113    2593 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:25:12.360246    2593 out.go:298] Setting JSON to false
	I0814 17:25:12.360263    2593 mustload.go:65] Loading cluster: ha-512000
	I0814 17:25:12.360339    2593 notify.go:220] Checking for updates...
	I0814 17:25:12.360527    2593 config.go:182] Loaded profile config "ha-512000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:25:12.360534    2593 status.go:255] checking status of ha-512000 ...
	I0814 17:25:12.361394    2593 status.go:330] ha-512000 host status = "Running" (err=<nil>)
	I0814 17:25:12.361404    2593 host.go:66] Checking if "ha-512000" exists ...
	I0814 17:25:12.361501    2593 host.go:66] Checking if "ha-512000" exists ...
	I0814 17:25:12.361620    2593 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0814 17:25:12.361631    2593 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000/id_rsa Username:docker}
	W0814 17:25:12.361827    2593 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down
	I0814 17:25:12.361847    2593 retry.go:31] will retry after 330.158095ms: dial tcp 192.168.105.5:22: connect: host is down
	W0814 17:25:12.694194    2593 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down
	I0814 17:25:12.694216    2593 retry.go:31] will retry after 192.997423ms: dial tcp 192.168.105.5:22: connect: host is down
	W0814 17:25:12.889386    2593 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down
	I0814 17:25:12.889420    2593 retry.go:31] will retry after 751.767148ms: dial tcp 192.168.105.5:22: connect: host is down
	W0814 17:25:13.643346    2593 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down
	I0814 17:25:13.643368    2593 retry.go:31] will retry after 510.821012ms: dial tcp 192.168.105.5:22: connect: host is down
	W0814 17:25:14.156352    2593 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down
	I0814 17:25:14.156389    2593 retry.go:31] will retry after 167.937627ms: new client: new client: dial tcp 192.168.105.5:22: connect: host is down
	I0814 17:25:14.326377    2593 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000/id_rsa Username:docker}
	W0814 17:25:14.326661    2593 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down
	I0814 17:25:14.326672    2593 retry.go:31] will retry after 264.546583ms: dial tcp 192.168.105.5:22: connect: host is down
	W0814 17:25:40.519556    2593 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: operation timed out
	W0814 17:25:40.519629    2593 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out
	E0814 17:25:40.519638    2593 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out
	I0814 17:25:40.519642    2593 status.go:257] ha-512000 status: &{Name:ha-512000 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	E0814 17:25:40.519651    2593 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out
	I0814 17:25:40.519656    2593 status.go:255] checking status of ha-512000-m02 ...
	I0814 17:25:40.519851    2593 status.go:330] ha-512000-m02 host status = "Stopped" (err=<nil>)
	I0814 17:25:40.519857    2593 status.go:343] host is not running, skipping remaining checks
	I0814 17:25:40.519859    2593 status.go:257] ha-512000-m02 status: &{Name:ha-512000-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0814 17:25:40.519864    2593 status.go:255] checking status of ha-512000-m03 ...
	I0814 17:25:40.520530    2593 status.go:330] ha-512000-m03 host status = "Running" (err=<nil>)
	I0814 17:25:40.520537    2593 host.go:66] Checking if "ha-512000-m03" exists ...
	I0814 17:25:40.520624    2593 host.go:66] Checking if "ha-512000-m03" exists ...
	I0814 17:25:40.520736    2593 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0814 17:25:40.520743    2593 sshutil.go:53] new ssh client: &{IP:192.168.105.7 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000-m03/id_rsa Username:docker}
	W0814 17:26:55.520420    2593 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.7:22: connect: operation timed out
	W0814 17:26:55.520462    2593 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out
	E0814 17:26:55.520475    2593 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out
	I0814 17:26:55.520478    2593 status.go:257] ha-512000-m03 status: &{Name:ha-512000-m03 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	E0814 17:26:55.520491    2593 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out
	I0814 17:26:55.520495    2593 status.go:255] checking status of ha-512000-m04 ...
	I0814 17:26:55.521215    2593 status.go:330] ha-512000-m04 host status = "Running" (err=<nil>)
	I0814 17:26:55.521222    2593 host.go:66] Checking if "ha-512000-m04" exists ...
	I0814 17:26:55.521315    2593 host.go:66] Checking if "ha-512000-m04" exists ...
	I0814 17:26:55.521438    2593 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0814 17:26:55.521443    2593 sshutil.go:53] new ssh client: &{IP:192.168.105.8 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000-m04/id_rsa Username:docker}
	W0814 17:28:10.522339    2593 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.8:22: connect: operation timed out
	W0814 17:28:10.522385    2593 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out
	E0814 17:28:10.522393    2593 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out
	I0814 17:28:10.522397    2593 status.go:257] ha-512000-m04 status: &{Name:ha-512000-m04 Host:Error Kubelet:Nonexistent APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
	E0814 17:28:10.522407    2593 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

                                                
                                                
** /stderr **
ha_test.go:432: failed to run minikube status. args "out/minikube-darwin-arm64 -p ha-512000 status -v=7 --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-512000 -n ha-512000
E0814 17:28:21.377869    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-512000 -n ha-512000: exit status 3 (25.953692291s)

                                                
                                                
-- stdout --
	Error

                                                
                                                
-- /stdout --
** stderr ** 
	E0814 17:28:36.475869    2648 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out
	E0814 17:28:36.475877    2648 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

                                                
                                                
** /stderr **
helpers_test.go:239: status error: exit status 3 (may be ok)
helpers_test.go:241: "ha-512000" host is not running, skipping log retrieval (state="Error")
--- FAIL: TestMultiControlPlane/serial/RestartSecondaryNode (209.28s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartClusterKeepsNodes (231.43s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartClusterKeepsNodes
ha_test.go:456: (dbg) Run:  out/minikube-darwin-arm64 node list -p ha-512000 -v=7 --alsologtostderr
ha_test.go:462: (dbg) Run:  out/minikube-darwin-arm64 stop -p ha-512000 -v=7 --alsologtostderr
E0814 17:33:21.371481    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:462: (dbg) Done: out/minikube-darwin-arm64 stop -p ha-512000 -v=7 --alsologtostderr: (3m46.013860416s)
ha_test.go:467: (dbg) Run:  out/minikube-darwin-arm64 start -p ha-512000 --wait=true -v=7 --alsologtostderr
ha_test.go:467: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p ha-512000 --wait=true -v=7 --alsologtostderr: exit status 80 (5.236932041s)

                                                
                                                
-- stdout --
	* [ha-512000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting "ha-512000" primary control-plane node in "ha-512000" cluster
	* Restarting existing qemu2 VM for "ha-512000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "ha-512000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:33:42.350261    3094 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:33:42.350423    3094 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:33:42.350427    3094 out.go:304] Setting ErrFile to fd 2...
	I0814 17:33:42.350430    3094 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:33:42.350605    3094 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:33:42.351889    3094 out.go:298] Setting JSON to false
	I0814 17:33:42.371703    3094 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":1985,"bootTime":1723680037,"procs":457,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:33:42.371793    3094 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:33:42.376591    3094 out.go:177] * [ha-512000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:33:42.384456    3094 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:33:42.384491    3094 notify.go:220] Checking for updates...
	I0814 17:33:42.392405    3094 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:33:42.396278    3094 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:33:42.399350    3094 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:33:42.402416    3094 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:33:42.405448    3094 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:33:42.408741    3094 config.go:182] Loaded profile config "ha-512000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:33:42.408809    3094 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:33:42.413379    3094 out.go:177] * Using the qemu2 driver based on existing profile
	I0814 17:33:42.420404    3094 start.go:297] selected driver: qemu2
	I0814 17:33:42.420413    3094 start.go:901] validating driver "qemu2" against &{Name:ha-512000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesV
ersion:v1.31.0 ClusterName:ha-512000 Namespace:default APIServerHAVIP:192.168.105.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.105.6 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.105.7 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.105.8 Port:0 KubernetesVersion:v1.31.0 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:
false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mou
nt9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:33:42.420509    3094 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:33:42.423177    3094 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0814 17:33:42.423226    3094 cni.go:84] Creating CNI manager for ""
	I0814 17:33:42.423230    3094 cni.go:136] multinode detected (4 nodes found), recommending kindnet
	I0814 17:33:42.423278    3094 start.go:340] cluster config:
	{Name:ha-512000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:ha-512000 Namespace:default APIServerHAVIP:192.168.1
05.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.105.6 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.105.7 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.105.8 Port:0 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false
helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOpti
ons:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:33:42.427275    3094 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:33:42.435380    3094 out.go:177] * Starting "ha-512000" primary control-plane node in "ha-512000" cluster
	I0814 17:33:42.439369    3094 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:33:42.439385    3094 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:33:42.439398    3094 cache.go:56] Caching tarball of preloaded images
	I0814 17:33:42.439451    3094 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:33:42.439457    3094 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:33:42.439520    3094 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/ha-512000/config.json ...
	I0814 17:33:42.439958    3094 start.go:360] acquireMachinesLock for ha-512000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:33:42.439992    3094 start.go:364] duration metric: took 28.292µs to acquireMachinesLock for "ha-512000"
	I0814 17:33:42.440001    3094 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:33:42.440007    3094 fix.go:54] fixHost starting: 
	I0814 17:33:42.440132    3094 fix.go:112] recreateIfNeeded on ha-512000: state=Stopped err=<nil>
	W0814 17:33:42.440142    3094 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:33:42.444352    3094 out.go:177] * Restarting existing qemu2 VM for "ha-512000" ...
	I0814 17:33:42.452402    3094 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:33:42.452442    3094 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000/qemu.pid -device virtio-net-pci,netdev=net0,mac=22:90:f9:c5:17:53 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000/disk.qcow2
	I0814 17:33:42.454701    3094 main.go:141] libmachine: STDOUT: 
	I0814 17:33:42.454722    3094 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:33:42.454753    3094 fix.go:56] duration metric: took 14.746709ms for fixHost
	I0814 17:33:42.454758    3094 start.go:83] releasing machines lock for "ha-512000", held for 14.761166ms
	W0814 17:33:42.454765    3094 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:33:42.454798    3094 out.go:239] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:33:42.454804    3094 start.go:729] Will try again in 5 seconds ...
	I0814 17:33:47.456880    3094 start.go:360] acquireMachinesLock for ha-512000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:33:47.457475    3094 start.go:364] duration metric: took 432.334µs to acquireMachinesLock for "ha-512000"
	I0814 17:33:47.457634    3094 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:33:47.457655    3094 fix.go:54] fixHost starting: 
	I0814 17:33:47.458602    3094 fix.go:112] recreateIfNeeded on ha-512000: state=Stopped err=<nil>
	W0814 17:33:47.458629    3094 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:33:47.467100    3094 out.go:177] * Restarting existing qemu2 VM for "ha-512000" ...
	I0814 17:33:47.472047    3094 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:33:47.472310    3094 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000/qemu.pid -device virtio-net-pci,netdev=net0,mac=22:90:f9:c5:17:53 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000/disk.qcow2
	I0814 17:33:47.482098    3094 main.go:141] libmachine: STDOUT: 
	I0814 17:33:47.482215    3094 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:33:47.482321    3094 fix.go:56] duration metric: took 24.666584ms for fixHost
	I0814 17:33:47.482342    3094 start.go:83] releasing machines lock for "ha-512000", held for 24.843375ms
	W0814 17:33:47.482535    3094 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p ha-512000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p ha-512000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:33:47.491035    3094 out.go:177] 
	W0814 17:33:47.495093    3094 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:33:47.495114    3094 out.go:239] * 
	* 
	W0814 17:33:47.497910    3094 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:33:47.506087    3094 out.go:177] 

                                                
                                                
** /stderr **
ha_test.go:469: failed to run minikube start. args "out/minikube-darwin-arm64 node list -p ha-512000 -v=7 --alsologtostderr" : exit status 80
ha_test.go:472: (dbg) Run:  out/minikube-darwin-arm64 node list -p ha-512000
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-512000 -n ha-512000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-512000 -n ha-512000: exit status 7 (33.364208ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-512000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/RestartClusterKeepsNodes (231.43s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DeleteSecondaryNode (0.1s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DeleteSecondaryNode
ha_test.go:487: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 node delete m03 -v=7 --alsologtostderr
ha_test.go:487: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-512000 node delete m03 -v=7 --alsologtostderr: exit status 83 (39.437042ms)

                                                
                                                
-- stdout --
	* The control-plane node ha-512000-m03 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p ha-512000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:33:47.650828    3110 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:33:47.651054    3110 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:33:47.651057    3110 out.go:304] Setting ErrFile to fd 2...
	I0814 17:33:47.651060    3110 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:33:47.651178    3110 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:33:47.651416    3110 mustload.go:65] Loading cluster: ha-512000
	I0814 17:33:47.651636    3110 config.go:182] Loaded profile config "ha-512000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	W0814 17:33:47.651950    3110 out.go:239] ! The control-plane node ha-512000 host is not running (will try others): state=Stopped
	! The control-plane node ha-512000 host is not running (will try others): state=Stopped
	W0814 17:33:47.652061    3110 out.go:239] ! The control-plane node ha-512000-m02 host is not running (will try others): state=Stopped
	! The control-plane node ha-512000-m02 host is not running (will try others): state=Stopped
	I0814 17:33:47.655286    3110 out.go:177] * The control-plane node ha-512000-m03 host is not running: state=Stopped
	I0814 17:33:47.658266    3110 out.go:177]   To start a cluster, run: "minikube start -p ha-512000"

                                                
                                                
** /stderr **
ha_test.go:489: node delete returned an error. args "out/minikube-darwin-arm64 -p ha-512000 node delete m03 -v=7 --alsologtostderr": exit status 83
ha_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 status -v=7 --alsologtostderr
ha_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-512000 status -v=7 --alsologtostderr: exit status 7 (29.789167ms)

                                                
                                                
-- stdout --
	ha-512000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-512000-m02
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-512000-m03
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-512000-m04
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:33:47.689929    3112 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:33:47.690085    3112 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:33:47.690088    3112 out.go:304] Setting ErrFile to fd 2...
	I0814 17:33:47.690091    3112 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:33:47.690226    3112 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:33:47.690338    3112 out.go:298] Setting JSON to false
	I0814 17:33:47.690350    3112 mustload.go:65] Loading cluster: ha-512000
	I0814 17:33:47.690416    3112 notify.go:220] Checking for updates...
	I0814 17:33:47.690571    3112 config.go:182] Loaded profile config "ha-512000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:33:47.690576    3112 status.go:255] checking status of ha-512000 ...
	I0814 17:33:47.690787    3112 status.go:330] ha-512000 host status = "Stopped" (err=<nil>)
	I0814 17:33:47.690792    3112 status.go:343] host is not running, skipping remaining checks
	I0814 17:33:47.690794    3112 status.go:257] ha-512000 status: &{Name:ha-512000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0814 17:33:47.690810    3112 status.go:255] checking status of ha-512000-m02 ...
	I0814 17:33:47.690899    3112 status.go:330] ha-512000-m02 host status = "Stopped" (err=<nil>)
	I0814 17:33:47.690902    3112 status.go:343] host is not running, skipping remaining checks
	I0814 17:33:47.690903    3112 status.go:257] ha-512000-m02 status: &{Name:ha-512000-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0814 17:33:47.690907    3112 status.go:255] checking status of ha-512000-m03 ...
	I0814 17:33:47.690994    3112 status.go:330] ha-512000-m03 host status = "Stopped" (err=<nil>)
	I0814 17:33:47.690997    3112 status.go:343] host is not running, skipping remaining checks
	I0814 17:33:47.690998    3112 status.go:257] ha-512000-m03 status: &{Name:ha-512000-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0814 17:33:47.691003    3112 status.go:255] checking status of ha-512000-m04 ...
	I0814 17:33:47.691095    3112 status.go:330] ha-512000-m04 host status = "Stopped" (err=<nil>)
	I0814 17:33:47.691098    3112 status.go:343] host is not running, skipping remaining checks
	I0814 17:33:47.691099    3112 status.go:257] ha-512000-m04 status: &{Name:ha-512000-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:495: failed to run minikube status. args "out/minikube-darwin-arm64 -p ha-512000 status -v=7 --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-512000 -n ha-512000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-512000 -n ha-512000: exit status 7 (29.180959ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-512000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/DeleteSecondaryNode (0.10s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.08s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete
ha_test.go:390: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json
ha_test.go:413: expected profile "ha-512000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-512000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-512000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"
:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.0\",\"ClusterName\":\"ha-512000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.168.105.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.168.105.5\",\"Port\":8443,\"K
ubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m02\",\"IP\":\"192.168.105.6\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m03\",\"IP\":\"192.168.105.7\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"192.168.105.8\",\"Port\":0,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"helm-tiller\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kub
evirt\":false,\"logviewer\":false,\"metallb\":false,\"metrics-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\"registry\":false,\"registry-aliases\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-gluster\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\
"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-512000 -n ha-512000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-512000 -n ha-512000: exit status 7 (30.363083ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-512000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.08s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StopCluster (202.08s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StopCluster
ha_test.go:531: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 stop -v=7 --alsologtostderr
E0814 17:34:55.352131    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:36:18.439426    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:531: (dbg) Done: out/minikube-darwin-arm64 -p ha-512000 stop -v=7 --alsologtostderr: (3m21.978069875s)
ha_test.go:537: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 status -v=7 --alsologtostderr
ha_test.go:537: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-512000 status -v=7 --alsologtostderr: exit status 7 (64.68525ms)

                                                
                                                
-- stdout --
	ha-512000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-512000-m02
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-512000-m03
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-512000-m04
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:37:09.837714    3186 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:37:09.837937    3186 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:37:09.837942    3186 out.go:304] Setting ErrFile to fd 2...
	I0814 17:37:09.837945    3186 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:37:09.838116    3186 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:37:09.838285    3186 out.go:298] Setting JSON to false
	I0814 17:37:09.838301    3186 mustload.go:65] Loading cluster: ha-512000
	I0814 17:37:09.838344    3186 notify.go:220] Checking for updates...
	I0814 17:37:09.838605    3186 config.go:182] Loaded profile config "ha-512000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:37:09.838611    3186 status.go:255] checking status of ha-512000 ...
	I0814 17:37:09.838892    3186 status.go:330] ha-512000 host status = "Stopped" (err=<nil>)
	I0814 17:37:09.838896    3186 status.go:343] host is not running, skipping remaining checks
	I0814 17:37:09.838899    3186 status.go:257] ha-512000 status: &{Name:ha-512000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0814 17:37:09.838913    3186 status.go:255] checking status of ha-512000-m02 ...
	I0814 17:37:09.839041    3186 status.go:330] ha-512000-m02 host status = "Stopped" (err=<nil>)
	I0814 17:37:09.839045    3186 status.go:343] host is not running, skipping remaining checks
	I0814 17:37:09.839047    3186 status.go:257] ha-512000-m02 status: &{Name:ha-512000-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0814 17:37:09.839052    3186 status.go:255] checking status of ha-512000-m03 ...
	I0814 17:37:09.839182    3186 status.go:330] ha-512000-m03 host status = "Stopped" (err=<nil>)
	I0814 17:37:09.839185    3186 status.go:343] host is not running, skipping remaining checks
	I0814 17:37:09.839188    3186 status.go:257] ha-512000-m03 status: &{Name:ha-512000-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0814 17:37:09.839194    3186 status.go:255] checking status of ha-512000-m04 ...
	I0814 17:37:09.839325    3186 status.go:330] ha-512000-m04 host status = "Stopped" (err=<nil>)
	I0814 17:37:09.839329    3186 status.go:343] host is not running, skipping remaining checks
	I0814 17:37:09.839332    3186 status.go:257] ha-512000-m04 status: &{Name:ha-512000-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:543: status says not two control-plane nodes are present: args "out/minikube-darwin-arm64 -p ha-512000 status -v=7 --alsologtostderr": ha-512000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha-512000-m02
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha-512000-m03
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha-512000-m04
type: Worker
host: Stopped
kubelet: Stopped

                                                
                                                
ha_test.go:549: status says not three kubelets are stopped: args "out/minikube-darwin-arm64 -p ha-512000 status -v=7 --alsologtostderr": ha-512000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha-512000-m02
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha-512000-m03
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha-512000-m04
type: Worker
host: Stopped
kubelet: Stopped

                                                
                                                
ha_test.go:552: status says not two apiservers are stopped: args "out/minikube-darwin-arm64 -p ha-512000 status -v=7 --alsologtostderr": ha-512000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha-512000-m02
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha-512000-m03
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha-512000-m04
type: Worker
host: Stopped
kubelet: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-512000 -n ha-512000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-512000 -n ha-512000: exit status 7 (32.193167ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-512000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/StopCluster (202.08s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartCluster (5.26s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartCluster
ha_test.go:560: (dbg) Run:  out/minikube-darwin-arm64 start -p ha-512000 --wait=true -v=7 --alsologtostderr --driver=qemu2 
ha_test.go:560: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p ha-512000 --wait=true -v=7 --alsologtostderr --driver=qemu2 : exit status 80 (5.182359833s)

                                                
                                                
-- stdout --
	* [ha-512000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting "ha-512000" primary control-plane node in "ha-512000" cluster
	* Restarting existing qemu2 VM for "ha-512000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "ha-512000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:37:09.900805    3190 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:37:09.900947    3190 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:37:09.900950    3190 out.go:304] Setting ErrFile to fd 2...
	I0814 17:37:09.900952    3190 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:37:09.901077    3190 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:37:09.902086    3190 out.go:298] Setting JSON to false
	I0814 17:37:09.918005    3190 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2192,"bootTime":1723680037,"procs":457,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:37:09.918088    3190 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:37:09.922409    3190 out.go:177] * [ha-512000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:37:09.928302    3190 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:37:09.928351    3190 notify.go:220] Checking for updates...
	I0814 17:37:09.936273    3190 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:37:09.939275    3190 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:37:09.942260    3190 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:37:09.945285    3190 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:37:09.948275    3190 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:37:09.951577    3190 config.go:182] Loaded profile config "ha-512000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:37:09.951836    3190 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:37:09.956282    3190 out.go:177] * Using the qemu2 driver based on existing profile
	I0814 17:37:09.963252    3190 start.go:297] selected driver: qemu2
	I0814 17:37:09.963264    3190 start.go:901] validating driver "qemu2" against &{Name:ha-512000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesV
ersion:v1.31.0 ClusterName:ha-512000 Namespace:default APIServerHAVIP:192.168.105.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.105.6 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.105.7 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.105.8 Port:0 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storage
class:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-ho
st Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:37:09.963355    3190 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:37:09.965638    3190 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0814 17:37:09.965692    3190 cni.go:84] Creating CNI manager for ""
	I0814 17:37:09.965698    3190 cni.go:136] multinode detected (4 nodes found), recommending kindnet
	I0814 17:37:09.965749    3190 start.go:340] cluster config:
	{Name:ha-512000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:ha-512000 Namespace:default APIServerHAVIP:192.168.1
05.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.105.6 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.105.7 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.105.8 Port:0 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false
helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOpti
ons:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:37:09.969364    3190 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:37:09.978261    3190 out.go:177] * Starting "ha-512000" primary control-plane node in "ha-512000" cluster
	I0814 17:37:09.982281    3190 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:37:09.982298    3190 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:37:09.982311    3190 cache.go:56] Caching tarball of preloaded images
	I0814 17:37:09.982391    3190 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:37:09.982397    3190 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:37:09.982473    3190 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/ha-512000/config.json ...
	I0814 17:37:09.982922    3190 start.go:360] acquireMachinesLock for ha-512000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:37:09.982960    3190 start.go:364] duration metric: took 29.417µs to acquireMachinesLock for "ha-512000"
	I0814 17:37:09.982973    3190 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:37:09.982978    3190 fix.go:54] fixHost starting: 
	I0814 17:37:09.983102    3190 fix.go:112] recreateIfNeeded on ha-512000: state=Stopped err=<nil>
	W0814 17:37:09.983110    3190 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:37:09.986247    3190 out.go:177] * Restarting existing qemu2 VM for "ha-512000" ...
	I0814 17:37:09.994105    3190 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:37:09.994139    3190 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000/qemu.pid -device virtio-net-pci,netdev=net0,mac=22:90:f9:c5:17:53 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000/disk.qcow2
	I0814 17:37:09.996302    3190 main.go:141] libmachine: STDOUT: 
	I0814 17:37:09.996324    3190 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:37:09.996351    3190 fix.go:56] duration metric: took 13.373166ms for fixHost
	I0814 17:37:09.996356    3190 start.go:83] releasing machines lock for "ha-512000", held for 13.391709ms
	W0814 17:37:09.996362    3190 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:37:09.996396    3190 out.go:239] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:37:09.996401    3190 start.go:729] Will try again in 5 seconds ...
	I0814 17:37:14.998483    3190 start.go:360] acquireMachinesLock for ha-512000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:37:14.998873    3190 start.go:364] duration metric: took 295.709µs to acquireMachinesLock for "ha-512000"
	I0814 17:37:14.999024    3190 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:37:14.999044    3190 fix.go:54] fixHost starting: 
	I0814 17:37:14.999794    3190 fix.go:112] recreateIfNeeded on ha-512000: state=Stopped err=<nil>
	W0814 17:37:14.999823    3190 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:37:15.005261    3190 out.go:177] * Restarting existing qemu2 VM for "ha-512000" ...
	I0814 17:37:15.012283    3190 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:37:15.012569    3190 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000/qemu.pid -device virtio-net-pci,netdev=net0,mac=22:90:f9:c5:17:53 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/ha-512000/disk.qcow2
	I0814 17:37:15.022243    3190 main.go:141] libmachine: STDOUT: 
	I0814 17:37:15.022328    3190 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:37:15.022423    3190 fix.go:56] duration metric: took 23.38ms for fixHost
	I0814 17:37:15.022443    3190 start.go:83] releasing machines lock for "ha-512000", held for 23.547042ms
	W0814 17:37:15.022659    3190 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p ha-512000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p ha-512000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:37:15.030228    3190 out.go:177] 
	W0814 17:37:15.033364    3190 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:37:15.033387    3190 out.go:239] * 
	* 
	W0814 17:37:15.036134    3190 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:37:15.043223    3190 out.go:177] 

                                                
                                                
** /stderr **
ha_test.go:562: failed to start cluster. args "out/minikube-darwin-arm64 start -p ha-512000 --wait=true -v=7 --alsologtostderr --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-512000 -n ha-512000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-512000 -n ha-512000: exit status 7 (71.274084ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-512000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/RestartCluster (5.26s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterClusterRestart (0.08s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterClusterRestart
ha_test.go:390: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json
ha_test.go:413: expected profile "ha-512000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-512000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-512000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"
:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.0\",\"ClusterName\":\"ha-512000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.168.105.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.168.105.5\",\"Port\":8443,\"K
ubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m02\",\"IP\":\"192.168.105.6\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m03\",\"IP\":\"192.168.105.7\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"192.168.105.8\",\"Port\":0,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"helm-tiller\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kub
evirt\":false,\"logviewer\":false,\"metallb\":false,\"metrics-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\"registry\":false,\"registry-aliases\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-gluster\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\
"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-512000 -n ha-512000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-512000 -n ha-512000: exit status 7 (29.375709ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-512000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/DegradedAfterClusterRestart (0.08s)

                                                
                                    
x
+
TestMultiControlPlane/serial/AddSecondaryNode (0.08s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/AddSecondaryNode
ha_test.go:605: (dbg) Run:  out/minikube-darwin-arm64 node add -p ha-512000 --control-plane -v=7 --alsologtostderr
ha_test.go:605: (dbg) Non-zero exit: out/minikube-darwin-arm64 node add -p ha-512000 --control-plane -v=7 --alsologtostderr: exit status 83 (46.304542ms)

                                                
                                                
-- stdout --
	* The control-plane node ha-512000-m03 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p ha-512000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:37:15.233752    3207 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:37:15.233896    3207 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:37:15.233900    3207 out.go:304] Setting ErrFile to fd 2...
	I0814 17:37:15.233902    3207 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:37:15.234029    3207 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:37:15.234259    3207 mustload.go:65] Loading cluster: ha-512000
	I0814 17:37:15.234465    3207 config.go:182] Loaded profile config "ha-512000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	W0814 17:37:15.234771    3207 out.go:239] ! The control-plane node ha-512000 host is not running (will try others): state=Stopped
	! The control-plane node ha-512000 host is not running (will try others): state=Stopped
	W0814 17:37:15.234868    3207 out.go:239] ! The control-plane node ha-512000-m02 host is not running (will try others): state=Stopped
	! The control-plane node ha-512000-m02 host is not running (will try others): state=Stopped
	I0814 17:37:15.239290    3207 out.go:177] * The control-plane node ha-512000-m03 host is not running: state=Stopped
	I0814 17:37:15.246818    3207 out.go:177]   To start a cluster, run: "minikube start -p ha-512000"

                                                
                                                
** /stderr **
ha_test.go:607: failed to add control-plane node to current ha (multi-control plane) cluster. args "out/minikube-darwin-arm64 node add -p ha-512000 --control-plane -v=7 --alsologtostderr" : exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-512000 -n ha-512000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-512000 -n ha-512000: exit status 7 (29.9535ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-512000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/AddSecondaryNode (0.08s)

                                                
                                    
x
+
TestImageBuild/serial/Setup (10.1s)

                                                
                                                
=== RUN   TestImageBuild/serial/Setup
image_test.go:69: (dbg) Run:  out/minikube-darwin-arm64 start -p image-284000 --driver=qemu2 
image_test.go:69: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p image-284000 --driver=qemu2 : exit status 80 (10.035068167s)

                                                
                                                
-- stdout --
	* [image-284000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "image-284000" primary control-plane node in "image-284000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "image-284000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p image-284000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
image_test.go:70: failed to start minikube with args: "out/minikube-darwin-arm64 start -p image-284000 --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p image-284000 -n image-284000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p image-284000 -n image-284000: exit status 7 (68.059708ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "image-284000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestImageBuild/serial/Setup (10.10s)

                                                
                                    
x
+
TestJSONOutput/start/Command (9.78s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 start -p json-output-868000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p json-output-868000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 : exit status 80 (9.776011125s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"9ebb2aac-ba61-440b-b53c-0f16b6739a84","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-868000] minikube v1.33.1 on Darwin 14.5 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"fa2e3949-e73d-43c9-84ba-54d894005290","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19443"}}
	{"specversion":"1.0","id":"27b385b0-10d6-4f2b-899b-deefe9f59df1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig"}}
	{"specversion":"1.0","id":"b2e0b252-2ee4-4305-9ddd-1f51578ac2df","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-arm64"}}
	{"specversion":"1.0","id":"982f24cc-59eb-4003-aeca-54b592b31c05","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"a4d17a92-d36a-4370-9f7e-b657c4afc746","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube"}}
	{"specversion":"1.0","id":"59c6a866-4832-46d2-8acc-e1394dc12304","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"510b7d92-fbb0-479f-a5de-4e577bed98fb","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the qemu2 driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"68d1befa-2aa8-49df-8943-af52eb5c4e62","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Automatically selected the socket_vmnet network"}}
	{"specversion":"1.0","id":"47d9e021-cb32-4203-a4c1-c05b40653e9d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"json-output-868000\" primary control-plane node in \"json-output-868000\" cluster","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"cb8bf658-eeff-4269-a8d1-11e88db408f4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	{"specversion":"1.0","id":"3ee444ba-03d0-4dab-a070-221f762bb82b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Deleting \"json-output-868000\" in qemu2 ...","name":"Creating VM","totalsteps":"19"}}
	{"specversion":"1.0","id":"9c102882-29c9-49cb-a686-b96eb80462c5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"StartHost failed, but will try again: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1"}}
	{"specversion":"1.0","id":"c29cc271-7cb4-4dcb-9a79-7c9b6afd2ca6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	{"specversion":"1.0","id":"6aefa256-c217-463e-8e65-131aeeacb1c2","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"Failed to start qemu2 VM. Running \"minikube delete -p json-output-868000\" may fix it: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1"}}
	{"specversion":"1.0","id":"c7228076-95e9-412d-a1f0-1961494a13fd","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"80","issues":"","message":"error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1","name":"GUEST_PROVISION","url":""}}
	{"specversion":"1.0","id":"3f35e4ef-2a4b-4230-a644-039a530dd379","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"╭───────────────────────────────────────────────────────────────────────────────────────────╮\n│                                                                                           │\n│    If the above advice does not help, please let us know:                                 │\n│    https://github.com/kubernetes/minikube/issues/new/choose                               │\n│                                                                                           │\n│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │\n│
│\n╰───────────────────────────────────────────────────────────────────────────────────────────╯"}}

                                                
                                                
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 start -p json-output-868000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 ": exit status 80
json_output_test.go:213: unable to marshal output: OUTPUT: 
json_output_test.go:70: converting to cloud events: invalid character 'O' looking for beginning of value
--- FAIL: TestJSONOutput/start/Command (9.78s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.08s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 pause -p json-output-868000 --output=json --user=testUser
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 pause -p json-output-868000 --output=json --user=testUser: exit status 83 (76.325084ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"e1e3c3ee-0683-45b1-98f9-6012a0bc7884","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"The control-plane node json-output-868000 host is not running: state=Stopped"}}
	{"specversion":"1.0","id":"84db8422-32a3-44e9-a193-5655abb9efb9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"To start a cluster, run: \"minikube start -p json-output-868000\""}}

                                                
                                                
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 pause -p json-output-868000 --output=json --user=testUser": exit status 83
--- FAIL: TestJSONOutput/pause/Command (0.08s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.05s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 unpause -p json-output-868000 --output=json --user=testUser
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 unpause -p json-output-868000 --output=json --user=testUser: exit status 83 (46.086834ms)

                                                
                                                
-- stdout --
	* The control-plane node json-output-868000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p json-output-868000"

                                                
                                                
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 unpause -p json-output-868000 --output=json --user=testUser": exit status 83
json_output_test.go:213: unable to marshal output: * The control-plane node json-output-868000 host is not running: state=Stopped
json_output_test.go:70: converting to cloud events: invalid character '*' looking for beginning of value
--- FAIL: TestJSONOutput/unpause/Command (0.05s)

                                                
                                    
x
+
TestMinikubeProfile (10.16s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-darwin-arm64 start -p first-234000 --driver=qemu2 
minikube_profile_test.go:44: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p first-234000 --driver=qemu2 : exit status 80 (9.864928417s)

                                                
                                                
-- stdout --
	* [first-234000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "first-234000" primary control-plane node in "first-234000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "first-234000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p first-234000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
minikube_profile_test.go:46: test pre-condition failed. args "out/minikube-darwin-arm64 start -p first-234000 --driver=qemu2 ": exit status 80
panic.go:626: *** TestMinikubeProfile FAILED at 2024-08-14 17:37:49.650644 -0700 PDT m=+1997.954819751
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p second-236000 -n second-236000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p second-236000 -n second-236000: exit status 85 (82.598ms)

                                                
                                                
-- stdout --
	* Profile "second-236000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p second-236000"

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 85 (may be ok)
helpers_test.go:241: "second-236000" host is not running, skipping log retrieval (state="* Profile \"second-236000\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p second-236000\"")
helpers_test.go:175: Cleaning up "second-236000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p second-236000
panic.go:626: *** TestMinikubeProfile FAILED at 2024-08-14 17:37:49.840446 -0700 PDT m=+1998.144625668
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p first-234000 -n first-234000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p first-234000 -n first-234000: exit status 7 (29.842291ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "first-234000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "first-234000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p first-234000
--- FAIL: TestMinikubeProfile (10.16s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (10.01s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-darwin-arm64 start -p mount-start-1-435000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 
mount_start_test.go:98: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p mount-start-1-435000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 : exit status 80 (9.943700333s)

                                                
                                                
-- stdout --
	* [mount-start-1-435000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting minikube without Kubernetes in cluster mount-start-1-435000
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "mount-start-1-435000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p mount-start-1-435000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
mount_start_test.go:100: failed to start minikube with args: "out/minikube-darwin-arm64 start -p mount-start-1-435000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p mount-start-1-435000 -n mount-start-1-435000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p mount-start-1-435000 -n mount-start-1-435000: exit status 7 (67.973917ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "mount-start-1-435000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMountStart/serial/StartWithMountFirst (10.01s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (9.93s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:96: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-628000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 
multinode_test.go:96: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-628000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 : exit status 80 (9.858258625s)

                                                
                                                
-- stdout --
	* [multinode-628000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "multinode-628000" primary control-plane node in "multinode-628000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "multinode-628000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:38:00.171503    3357 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:38:00.171637    3357 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:38:00.171640    3357 out.go:304] Setting ErrFile to fd 2...
	I0814 17:38:00.171642    3357 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:38:00.171759    3357 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:38:00.172783    3357 out.go:298] Setting JSON to false
	I0814 17:38:00.188808    3357 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2243,"bootTime":1723680037,"procs":457,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:38:00.188881    3357 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:38:00.195798    3357 out.go:177] * [multinode-628000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:38:00.203714    3357 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:38:00.203742    3357 notify.go:220] Checking for updates...
	I0814 17:38:00.211665    3357 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:38:00.214712    3357 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:38:00.217763    3357 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:38:00.220778    3357 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:38:00.223712    3357 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:38:00.226839    3357 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:38:00.230688    3357 out.go:177] * Using the qemu2 driver based on user configuration
	I0814 17:38:00.237754    3357 start.go:297] selected driver: qemu2
	I0814 17:38:00.237763    3357 start.go:901] validating driver "qemu2" against <nil>
	I0814 17:38:00.237771    3357 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:38:00.240013    3357 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0814 17:38:00.242703    3357 out.go:177] * Automatically selected the socket_vmnet network
	I0814 17:38:00.245736    3357 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0814 17:38:00.245775    3357 cni.go:84] Creating CNI manager for ""
	I0814 17:38:00.245781    3357 cni.go:136] multinode detected (0 nodes found), recommending kindnet
	I0814 17:38:00.245788    3357 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0814 17:38:00.245824    3357 start.go:340] cluster config:
	{Name:multinode-628000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:multinode-628000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRu
ntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vm
net_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:38:00.249511    3357 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:38:00.254700    3357 out.go:177] * Starting "multinode-628000" primary control-plane node in "multinode-628000" cluster
	I0814 17:38:00.258721    3357 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:38:00.258737    3357 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:38:00.258750    3357 cache.go:56] Caching tarball of preloaded images
	I0814 17:38:00.258816    3357 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:38:00.258821    3357 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:38:00.259044    3357 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/multinode-628000/config.json ...
	I0814 17:38:00.259056    3357 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/multinode-628000/config.json: {Name:mk1b31ae1a4e630e14e5f4b5fa85f76657f76295 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:38:00.259285    3357 start.go:360] acquireMachinesLock for multinode-628000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:38:00.259321    3357 start.go:364] duration metric: took 29.459µs to acquireMachinesLock for "multinode-628000"
	I0814 17:38:00.259333    3357 start.go:93] Provisioning new machine with config: &{Name:multinode-628000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K
ubernetesVersion:v1.31.0 ClusterName:multinode-628000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[
] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:38:00.259374    3357 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:38:00.266677    3357 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0814 17:38:00.284345    3357 start.go:159] libmachine.API.Create for "multinode-628000" (driver="qemu2")
	I0814 17:38:00.284370    3357 client.go:168] LocalClient.Create starting
	I0814 17:38:00.284437    3357 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:38:00.284469    3357 main.go:141] libmachine: Decoding PEM data...
	I0814 17:38:00.284478    3357 main.go:141] libmachine: Parsing certificate...
	I0814 17:38:00.284517    3357 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:38:00.284542    3357 main.go:141] libmachine: Decoding PEM data...
	I0814 17:38:00.284547    3357 main.go:141] libmachine: Parsing certificate...
	I0814 17:38:00.284925    3357 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:38:00.435688    3357 main.go:141] libmachine: Creating SSH key...
	I0814 17:38:00.512944    3357 main.go:141] libmachine: Creating Disk image...
	I0814 17:38:00.512954    3357 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:38:00.513131    3357 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/disk.qcow2
	I0814 17:38:00.522236    3357 main.go:141] libmachine: STDOUT: 
	I0814 17:38:00.522255    3357 main.go:141] libmachine: STDERR: 
	I0814 17:38:00.522308    3357 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/disk.qcow2 +20000M
	I0814 17:38:00.530187    3357 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:38:00.530205    3357 main.go:141] libmachine: STDERR: 
	I0814 17:38:00.530220    3357 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/disk.qcow2
	I0814 17:38:00.530226    3357 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:38:00.530235    3357 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:38:00.530264    3357 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ae:aa:c1:18:4d:e3 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/disk.qcow2
	I0814 17:38:00.531898    3357 main.go:141] libmachine: STDOUT: 
	I0814 17:38:00.531915    3357 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:38:00.531935    3357 client.go:171] duration metric: took 247.565125ms to LocalClient.Create
	I0814 17:38:02.534135    3357 start.go:128] duration metric: took 2.274787875s to createHost
	I0814 17:38:02.534200    3357 start.go:83] releasing machines lock for "multinode-628000", held for 2.274916084s
	W0814 17:38:02.534292    3357 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:38:02.552457    3357 out.go:177] * Deleting "multinode-628000" in qemu2 ...
	W0814 17:38:02.582552    3357 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:38:02.582573    3357 start.go:729] Will try again in 5 seconds ...
	I0814 17:38:07.584714    3357 start.go:360] acquireMachinesLock for multinode-628000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:38:07.585216    3357 start.go:364] duration metric: took 360.5µs to acquireMachinesLock for "multinode-628000"
	I0814 17:38:07.585349    3357 start.go:93] Provisioning new machine with config: &{Name:multinode-628000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K
ubernetesVersion:v1.31.0 ClusterName:multinode-628000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[
] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:38:07.585589    3357 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:38:07.597000    3357 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0814 17:38:07.646021    3357 start.go:159] libmachine.API.Create for "multinode-628000" (driver="qemu2")
	I0814 17:38:07.646069    3357 client.go:168] LocalClient.Create starting
	I0814 17:38:07.646167    3357 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:38:07.646231    3357 main.go:141] libmachine: Decoding PEM data...
	I0814 17:38:07.646249    3357 main.go:141] libmachine: Parsing certificate...
	I0814 17:38:07.646309    3357 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:38:07.646353    3357 main.go:141] libmachine: Decoding PEM data...
	I0814 17:38:07.646367    3357 main.go:141] libmachine: Parsing certificate...
	I0814 17:38:07.647048    3357 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:38:07.851366    3357 main.go:141] libmachine: Creating SSH key...
	I0814 17:38:07.936468    3357 main.go:141] libmachine: Creating Disk image...
	I0814 17:38:07.936477    3357 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:38:07.936647    3357 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/disk.qcow2
	I0814 17:38:07.945699    3357 main.go:141] libmachine: STDOUT: 
	I0814 17:38:07.945717    3357 main.go:141] libmachine: STDERR: 
	I0814 17:38:07.945756    3357 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/disk.qcow2 +20000M
	I0814 17:38:07.953544    3357 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:38:07.953559    3357 main.go:141] libmachine: STDERR: 
	I0814 17:38:07.953569    3357 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/disk.qcow2
	I0814 17:38:07.953573    3357 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:38:07.953597    3357 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:38:07.953622    3357 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/qemu.pid -device virtio-net-pci,netdev=net0,mac=4e:98:b1:11:17:48 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/disk.qcow2
	I0814 17:38:07.955232    3357 main.go:141] libmachine: STDOUT: 
	I0814 17:38:07.955246    3357 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:38:07.955259    3357 client.go:171] duration metric: took 309.189917ms to LocalClient.Create
	I0814 17:38:09.957400    3357 start.go:128] duration metric: took 2.371818666s to createHost
	I0814 17:38:09.957476    3357 start.go:83] releasing machines lock for "multinode-628000", held for 2.372284458s
	W0814 17:38:09.957833    3357 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p multinode-628000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p multinode-628000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:38:09.971581    3357 out.go:177] 
	W0814 17:38:09.975614    3357 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:38:09.975639    3357 out.go:239] * 
	* 
	W0814 17:38:09.978325    3357 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:38:09.986501    3357 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:98: failed to start cluster. args "out/minikube-darwin-arm64 start -p multinode-628000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000: exit status 7 (69.770792ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-628000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/FreshStart2Nodes (9.93s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (81.29s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-628000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-628000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml: exit status 1 (128.127417ms)

                                                
                                                
** stderr ** 
	error: cluster "multinode-628000" does not exist

                                                
                                                
** /stderr **
multinode_test.go:495: failed to create busybox deployment to multinode cluster
multinode_test.go:498: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-628000 -- rollout status deployment/busybox
multinode_test.go:498: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-628000 -- rollout status deployment/busybox: exit status 1 (57.337875ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-628000"

                                                
                                                
** /stderr **
multinode_test.go:500: failed to deploy busybox to multinode cluster
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-628000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-628000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (57.258333ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-628000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-628000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-628000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (104.534709ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-628000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-628000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-628000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.036625ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-628000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-628000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-628000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (104.6805ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-628000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-628000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-628000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.8785ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-628000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
E0814 17:38:21.365635    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-628000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-628000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.634625ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-628000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-628000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-628000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.229917ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-628000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-628000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-628000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.323583ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-628000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-628000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-628000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.83625ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-628000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-628000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-628000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.956083ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-628000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:524: failed to resolve pod IPs: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:528: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-628000 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:528: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-628000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (57.388833ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-628000"

                                                
                                                
** /stderr **
multinode_test.go:530: failed get Pod names
multinode_test.go:536: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-628000 -- exec  -- nslookup kubernetes.io
multinode_test.go:536: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-628000 -- exec  -- nslookup kubernetes.io: exit status 1 (57.569584ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-628000"

                                                
                                                
** /stderr **
multinode_test.go:538: Pod  could not resolve 'kubernetes.io': exit status 1
multinode_test.go:546: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-628000 -- exec  -- nslookup kubernetes.default
multinode_test.go:546: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-628000 -- exec  -- nslookup kubernetes.default: exit status 1 (56.458416ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-628000"

                                                
                                                
** /stderr **
multinode_test.go:548: Pod  could not resolve 'kubernetes.default': exit status 1
multinode_test.go:554: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-628000 -- exec  -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:554: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-628000 -- exec  -- nslookup kubernetes.default.svc.cluster.local: exit status 1 (57.323208ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-628000"

                                                
                                                
** /stderr **
multinode_test.go:556: Pod  could not resolve local service (kubernetes.default.svc.cluster.local): exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000: exit status 7 (29.529792ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-628000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/DeployApp2Nodes (81.29s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (0.09s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:564: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-628000 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:564: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-628000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (56.484167ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-628000"

                                                
                                                
** /stderr **
multinode_test.go:566: failed to get Pod names: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000: exit status 7 (30.649875ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-628000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/PingHostFrom2Pods (0.09s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (0.07s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:121: (dbg) Run:  out/minikube-darwin-arm64 node add -p multinode-628000 -v 3 --alsologtostderr
multinode_test.go:121: (dbg) Non-zero exit: out/minikube-darwin-arm64 node add -p multinode-628000 -v 3 --alsologtostderr: exit status 83 (41.207ms)

                                                
                                                
-- stdout --
	* The control-plane node multinode-628000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p multinode-628000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:39:31.478499    3448 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:39:31.478659    3448 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:39:31.478662    3448 out.go:304] Setting ErrFile to fd 2...
	I0814 17:39:31.478664    3448 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:39:31.478786    3448 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:39:31.479005    3448 mustload.go:65] Loading cluster: multinode-628000
	I0814 17:39:31.479195    3448 config.go:182] Loaded profile config "multinode-628000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:39:31.484061    3448 out.go:177] * The control-plane node multinode-628000 host is not running: state=Stopped
	I0814 17:39:31.488064    3448 out.go:177]   To start a cluster, run: "minikube start -p multinode-628000"

                                                
                                                
** /stderr **
multinode_test.go:123: failed to add node to current cluster. args "out/minikube-darwin-arm64 node add -p multinode-628000 -v 3 --alsologtostderr" : exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000: exit status 7 (29.399917ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-628000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/AddNode (0.07s)

                                                
                                    
x
+
TestMultiNode/serial/MultiNodeLabels (0.06s)

                                                
                                                
=== RUN   TestMultiNode/serial/MultiNodeLabels
multinode_test.go:221: (dbg) Run:  kubectl --context multinode-628000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
multinode_test.go:221: (dbg) Non-zero exit: kubectl --context multinode-628000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]": exit status 1 (29.297583ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: multinode-628000

                                                
                                                
** /stderr **
multinode_test.go:223: failed to 'kubectl get nodes' with args "kubectl --context multinode-628000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": exit status 1
multinode_test.go:230: failed to decode json from label list: args "kubectl --context multinode-628000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": unexpected end of JSON input
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000: exit status 7 (30.634583ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-628000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/MultiNodeLabels (0.06s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.08s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:143: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json
multinode_test.go:166: expected profile "multinode-628000" in json of 'profile list' include 3 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"multinode-628000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"multinode-628000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNU
MACount\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.0\",\"ClusterName\":\"multinode-628000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVer
sion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":
\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000: exit status 7 (30.23525ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-628000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/ProfileList (0.08s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (0.06s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:184: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-628000 status --output json --alsologtostderr
multinode_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-628000 status --output json --alsologtostderr: exit status 7 (30.02175ms)

                                                
                                                
-- stdout --
	{"Name":"multinode-628000","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":false}

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:39:31.685808    3460 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:39:31.685957    3460 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:39:31.685961    3460 out.go:304] Setting ErrFile to fd 2...
	I0814 17:39:31.685963    3460 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:39:31.686100    3460 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:39:31.686226    3460 out.go:298] Setting JSON to true
	I0814 17:39:31.686238    3460 mustload.go:65] Loading cluster: multinode-628000
	I0814 17:39:31.686287    3460 notify.go:220] Checking for updates...
	I0814 17:39:31.686447    3460 config.go:182] Loaded profile config "multinode-628000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:39:31.686452    3460 status.go:255] checking status of multinode-628000 ...
	I0814 17:39:31.686656    3460 status.go:330] multinode-628000 host status = "Stopped" (err=<nil>)
	I0814 17:39:31.686660    3460 status.go:343] host is not running, skipping remaining checks
	I0814 17:39:31.686662    3460 status.go:257] multinode-628000 status: &{Name:multinode-628000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:191: failed to decode json from status: args "out/minikube-darwin-arm64 -p multinode-628000 status --output json --alsologtostderr": json: cannot unmarshal object into Go value of type []cmd.Status
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000: exit status 7 (29.507916ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-628000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/CopyFile (0.06s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (0.14s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:248: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-628000 node stop m03
multinode_test.go:248: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-628000 node stop m03: exit status 85 (45.228291ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_295f67d8757edd996fe5c1e7ccde72c355ccf4dc_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:250: node stop returned an error. args "out/minikube-darwin-arm64 -p multinode-628000 node stop m03": exit status 85
multinode_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-628000 status
multinode_test.go:254: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-628000 status: exit status 7 (29.60075ms)

                                                
                                                
-- stdout --
	multinode-628000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:261: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-628000 status --alsologtostderr
multinode_test.go:261: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-628000 status --alsologtostderr: exit status 7 (30.371916ms)

                                                
                                                
-- stdout --
	multinode-628000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:39:31.821313    3468 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:39:31.821444    3468 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:39:31.821447    3468 out.go:304] Setting ErrFile to fd 2...
	I0814 17:39:31.821449    3468 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:39:31.821596    3468 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:39:31.821717    3468 out.go:298] Setting JSON to false
	I0814 17:39:31.821728    3468 mustload.go:65] Loading cluster: multinode-628000
	I0814 17:39:31.821789    3468 notify.go:220] Checking for updates...
	I0814 17:39:31.821923    3468 config.go:182] Loaded profile config "multinode-628000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:39:31.821928    3468 status.go:255] checking status of multinode-628000 ...
	I0814 17:39:31.822128    3468 status.go:330] multinode-628000 host status = "Stopped" (err=<nil>)
	I0814 17:39:31.822133    3468 status.go:343] host is not running, skipping remaining checks
	I0814 17:39:31.822135    3468 status.go:257] multinode-628000 status: &{Name:multinode-628000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:267: incorrect number of running kubelets: args "out/minikube-darwin-arm64 -p multinode-628000 status --alsologtostderr": multinode-628000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000: exit status 7 (29.392208ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-628000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/StopNode (0.14s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (47.14s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:282: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-628000 node start m03 -v=7 --alsologtostderr
multinode_test.go:282: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-628000 node start m03 -v=7 --alsologtostderr: exit status 85 (47.113625ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:39:31.881315    3472 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:39:31.881550    3472 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:39:31.881554    3472 out.go:304] Setting ErrFile to fd 2...
	I0814 17:39:31.881556    3472 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:39:31.881688    3472 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:39:31.881929    3472 mustload.go:65] Loading cluster: multinode-628000
	I0814 17:39:31.882132    3472 config.go:182] Loaded profile config "multinode-628000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:39:31.887042    3472 out.go:177] 
	W0814 17:39:31.890059    3472 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
	W0814 17:39:31.890064    3472 out.go:239] * 
	* 
	W0814 17:39:31.891748    3472 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:39:31.894985    3472 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:284: I0814 17:39:31.881315    3472 out.go:291] Setting OutFile to fd 1 ...
I0814 17:39:31.881550    3472 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0814 17:39:31.881554    3472 out.go:304] Setting ErrFile to fd 2...
I0814 17:39:31.881556    3472 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0814 17:39:31.881688    3472 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
I0814 17:39:31.881929    3472 mustload.go:65] Loading cluster: multinode-628000
I0814 17:39:31.882132    3472 config.go:182] Loaded profile config "multinode-628000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
I0814 17:39:31.887042    3472 out.go:177] 
W0814 17:39:31.890059    3472 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
W0814 17:39:31.890064    3472 out.go:239] * 
* 
W0814 17:39:31.891748    3472 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
I0814 17:39:31.894985    3472 out.go:177] 
multinode_test.go:285: node start returned an error. args "out/minikube-darwin-arm64 -p multinode-628000 node start m03 -v=7 --alsologtostderr": exit status 85
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-628000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-628000 status -v=7 --alsologtostderr: exit status 7 (29.319334ms)

                                                
                                                
-- stdout --
	multinode-628000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:39:31.927638    3474 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:39:31.927794    3474 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:39:31.927798    3474 out.go:304] Setting ErrFile to fd 2...
	I0814 17:39:31.927800    3474 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:39:31.927921    3474 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:39:31.928048    3474 out.go:298] Setting JSON to false
	I0814 17:39:31.928059    3474 mustload.go:65] Loading cluster: multinode-628000
	I0814 17:39:31.928107    3474 notify.go:220] Checking for updates...
	I0814 17:39:31.928250    3474 config.go:182] Loaded profile config "multinode-628000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:39:31.928255    3474 status.go:255] checking status of multinode-628000 ...
	I0814 17:39:31.928497    3474 status.go:330] multinode-628000 host status = "Stopped" (err=<nil>)
	I0814 17:39:31.928501    3474 status.go:343] host is not running, skipping remaining checks
	I0814 17:39:31.928503    3474 status.go:257] multinode-628000 status: &{Name:multinode-628000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-628000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-628000 status -v=7 --alsologtostderr: exit status 7 (73.516583ms)

                                                
                                                
-- stdout --
	multinode-628000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:39:32.585269    3476 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:39:32.585458    3476 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:39:32.585462    3476 out.go:304] Setting ErrFile to fd 2...
	I0814 17:39:32.585466    3476 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:39:32.585641    3476 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:39:32.585804    3476 out.go:298] Setting JSON to false
	I0814 17:39:32.585822    3476 mustload.go:65] Loading cluster: multinode-628000
	I0814 17:39:32.585864    3476 notify.go:220] Checking for updates...
	I0814 17:39:32.586086    3476 config.go:182] Loaded profile config "multinode-628000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:39:32.586093    3476 status.go:255] checking status of multinode-628000 ...
	I0814 17:39:32.586368    3476 status.go:330] multinode-628000 host status = "Stopped" (err=<nil>)
	I0814 17:39:32.586373    3476 status.go:343] host is not running, skipping remaining checks
	I0814 17:39:32.586376    3476 status.go:257] multinode-628000 status: &{Name:multinode-628000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-628000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-628000 status -v=7 --alsologtostderr: exit status 7 (73.877709ms)

                                                
                                                
-- stdout --
	multinode-628000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:39:34.195176    3478 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:39:34.195366    3478 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:39:34.195370    3478 out.go:304] Setting ErrFile to fd 2...
	I0814 17:39:34.195373    3478 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:39:34.195556    3478 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:39:34.195715    3478 out.go:298] Setting JSON to false
	I0814 17:39:34.195729    3478 mustload.go:65] Loading cluster: multinode-628000
	I0814 17:39:34.195763    3478 notify.go:220] Checking for updates...
	I0814 17:39:34.195997    3478 config.go:182] Loaded profile config "multinode-628000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:39:34.196004    3478 status.go:255] checking status of multinode-628000 ...
	I0814 17:39:34.196266    3478 status.go:330] multinode-628000 host status = "Stopped" (err=<nil>)
	I0814 17:39:34.196271    3478 status.go:343] host is not running, skipping remaining checks
	I0814 17:39:34.196274    3478 status.go:257] multinode-628000 status: &{Name:multinode-628000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-628000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-628000 status -v=7 --alsologtostderr: exit status 7 (70.773542ms)

                                                
                                                
-- stdout --
	multinode-628000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:39:37.384669    3480 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:39:37.384868    3480 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:39:37.384872    3480 out.go:304] Setting ErrFile to fd 2...
	I0814 17:39:37.384876    3480 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:39:37.385040    3480 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:39:37.385182    3480 out.go:298] Setting JSON to false
	I0814 17:39:37.385197    3480 mustload.go:65] Loading cluster: multinode-628000
	I0814 17:39:37.385229    3480 notify.go:220] Checking for updates...
	I0814 17:39:37.385472    3480 config.go:182] Loaded profile config "multinode-628000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:39:37.385479    3480 status.go:255] checking status of multinode-628000 ...
	I0814 17:39:37.385756    3480 status.go:330] multinode-628000 host status = "Stopped" (err=<nil>)
	I0814 17:39:37.385761    3480 status.go:343] host is not running, skipping remaining checks
	I0814 17:39:37.385764    3480 status.go:257] multinode-628000 status: &{Name:multinode-628000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-628000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-628000 status -v=7 --alsologtostderr: exit status 7 (72.915667ms)

                                                
                                                
-- stdout --
	multinode-628000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:39:39.620403    3482 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:39:39.620652    3482 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:39:39.620659    3482 out.go:304] Setting ErrFile to fd 2...
	I0814 17:39:39.620662    3482 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:39:39.620849    3482 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:39:39.621015    3482 out.go:298] Setting JSON to false
	I0814 17:39:39.621030    3482 mustload.go:65] Loading cluster: multinode-628000
	I0814 17:39:39.621070    3482 notify.go:220] Checking for updates...
	I0814 17:39:39.621291    3482 config.go:182] Loaded profile config "multinode-628000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:39:39.621298    3482 status.go:255] checking status of multinode-628000 ...
	I0814 17:39:39.621560    3482 status.go:330] multinode-628000 host status = "Stopped" (err=<nil>)
	I0814 17:39:39.621565    3482 status.go:343] host is not running, skipping remaining checks
	I0814 17:39:39.621568    3482 status.go:257] multinode-628000 status: &{Name:multinode-628000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-628000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-628000 status -v=7 --alsologtostderr: exit status 7 (74.161292ms)

                                                
                                                
-- stdout --
	multinode-628000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:39:46.535002    3491 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:39:46.535228    3491 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:39:46.535233    3491 out.go:304] Setting ErrFile to fd 2...
	I0814 17:39:46.535235    3491 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:39:46.535458    3491 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:39:46.535620    3491 out.go:298] Setting JSON to false
	I0814 17:39:46.535636    3491 mustload.go:65] Loading cluster: multinode-628000
	I0814 17:39:46.535678    3491 notify.go:220] Checking for updates...
	I0814 17:39:46.535901    3491 config.go:182] Loaded profile config "multinode-628000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:39:46.535911    3491 status.go:255] checking status of multinode-628000 ...
	I0814 17:39:46.536183    3491 status.go:330] multinode-628000 host status = "Stopped" (err=<nil>)
	I0814 17:39:46.536188    3491 status.go:343] host is not running, skipping remaining checks
	I0814 17:39:46.536191    3491 status.go:257] multinode-628000 status: &{Name:multinode-628000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-628000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-628000 status -v=7 --alsologtostderr: exit status 7 (74.663583ms)

                                                
                                                
-- stdout --
	multinode-628000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:39:53.106093    3493 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:39:53.106307    3493 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:39:53.106312    3493 out.go:304] Setting ErrFile to fd 2...
	I0814 17:39:53.106315    3493 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:39:53.106495    3493 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:39:53.106656    3493 out.go:298] Setting JSON to false
	I0814 17:39:53.106672    3493 mustload.go:65] Loading cluster: multinode-628000
	I0814 17:39:53.106716    3493 notify.go:220] Checking for updates...
	I0814 17:39:53.106963    3493 config.go:182] Loaded profile config "multinode-628000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:39:53.106969    3493 status.go:255] checking status of multinode-628000 ...
	I0814 17:39:53.107248    3493 status.go:330] multinode-628000 host status = "Stopped" (err=<nil>)
	I0814 17:39:53.107252    3493 status.go:343] host is not running, skipping remaining checks
	I0814 17:39:53.107255    3493 status.go:257] multinode-628000 status: &{Name:multinode-628000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
E0814 17:39:55.345898    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-628000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-628000 status -v=7 --alsologtostderr: exit status 7 (73.091916ms)

                                                
                                                
-- stdout --
	multinode-628000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:40:00.744503    3497 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:40:00.744700    3497 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:40:00.744705    3497 out.go:304] Setting ErrFile to fd 2...
	I0814 17:40:00.744708    3497 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:40:00.744874    3497 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:40:00.745014    3497 out.go:298] Setting JSON to false
	I0814 17:40:00.745034    3497 mustload.go:65] Loading cluster: multinode-628000
	I0814 17:40:00.745080    3497 notify.go:220] Checking for updates...
	I0814 17:40:00.745316    3497 config.go:182] Loaded profile config "multinode-628000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:40:00.745323    3497 status.go:255] checking status of multinode-628000 ...
	I0814 17:40:00.745631    3497 status.go:330] multinode-628000 host status = "Stopped" (err=<nil>)
	I0814 17:40:00.745636    3497 status.go:343] host is not running, skipping remaining checks
	I0814 17:40:00.745639    3497 status.go:257] multinode-628000 status: &{Name:multinode-628000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-628000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-628000 status -v=7 --alsologtostderr: exit status 7 (72.968917ms)

                                                
                                                
-- stdout --
	multinode-628000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:40:18.950996    3505 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:40:18.951205    3505 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:40:18.951212    3505 out.go:304] Setting ErrFile to fd 2...
	I0814 17:40:18.951215    3505 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:40:18.951392    3505 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:40:18.951540    3505 out.go:298] Setting JSON to false
	I0814 17:40:18.951555    3505 mustload.go:65] Loading cluster: multinode-628000
	I0814 17:40:18.951595    3505 notify.go:220] Checking for updates...
	I0814 17:40:18.951819    3505 config.go:182] Loaded profile config "multinode-628000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:40:18.951825    3505 status.go:255] checking status of multinode-628000 ...
	I0814 17:40:18.952103    3505 status.go:330] multinode-628000 host status = "Stopped" (err=<nil>)
	I0814 17:40:18.952109    3505 status.go:343] host is not running, skipping remaining checks
	I0814 17:40:18.952112    3505 status.go:257] multinode-628000 status: &{Name:multinode-628000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:294: failed to run minikube status. args "out/minikube-darwin-arm64 -p multinode-628000 status -v=7 --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000: exit status 7 (33.478541ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-628000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/StartAfterStop (47.14s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (7.15s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:314: (dbg) Run:  out/minikube-darwin-arm64 node list -p multinode-628000
multinode_test.go:321: (dbg) Run:  out/minikube-darwin-arm64 stop -p multinode-628000
multinode_test.go:321: (dbg) Done: out/minikube-darwin-arm64 stop -p multinode-628000: (1.799688292s)
multinode_test.go:326: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-628000 --wait=true -v=8 --alsologtostderr
multinode_test.go:326: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-628000 --wait=true -v=8 --alsologtostderr: exit status 80 (5.22039275s)

                                                
                                                
-- stdout --
	* [multinode-628000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting "multinode-628000" primary control-plane node in "multinode-628000" cluster
	* Restarting existing qemu2 VM for "multinode-628000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "multinode-628000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:40:20.879762    3521 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:40:20.879919    3521 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:40:20.879924    3521 out.go:304] Setting ErrFile to fd 2...
	I0814 17:40:20.879927    3521 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:40:20.880107    3521 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:40:20.881329    3521 out.go:298] Setting JSON to false
	I0814 17:40:20.900725    3521 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2383,"bootTime":1723680037,"procs":457,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:40:20.900796    3521 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:40:20.905291    3521 out.go:177] * [multinode-628000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:40:20.912161    3521 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:40:20.912211    3521 notify.go:220] Checking for updates...
	I0814 17:40:20.919315    3521 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:40:20.920619    3521 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:40:20.923242    3521 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:40:20.926275    3521 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:40:20.929282    3521 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:40:20.932614    3521 config.go:182] Loaded profile config "multinode-628000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:40:20.932663    3521 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:40:20.937277    3521 out.go:177] * Using the qemu2 driver based on existing profile
	I0814 17:40:20.944296    3521 start.go:297] selected driver: qemu2
	I0814 17:40:20.944305    3521 start.go:901] validating driver "qemu2" against &{Name:multinode-628000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kube
rnetesVersion:v1.31.0 ClusterName:multinode-628000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:40:20.944381    3521 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:40:20.946831    3521 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0814 17:40:20.946885    3521 cni.go:84] Creating CNI manager for ""
	I0814 17:40:20.946891    3521 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0814 17:40:20.946938    3521 start.go:340] cluster config:
	{Name:multinode-628000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:multinode-628000 Namespace:default APIServerH
AVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:fals
e DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:40:20.950595    3521 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:40:20.957210    3521 out.go:177] * Starting "multinode-628000" primary control-plane node in "multinode-628000" cluster
	I0814 17:40:20.961282    3521 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:40:20.961299    3521 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:40:20.961315    3521 cache.go:56] Caching tarball of preloaded images
	I0814 17:40:20.961379    3521 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:40:20.961393    3521 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:40:20.961451    3521 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/multinode-628000/config.json ...
	I0814 17:40:20.961916    3521 start.go:360] acquireMachinesLock for multinode-628000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:40:20.961952    3521 start.go:364] duration metric: took 29.417µs to acquireMachinesLock for "multinode-628000"
	I0814 17:40:20.961961    3521 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:40:20.961967    3521 fix.go:54] fixHost starting: 
	I0814 17:40:20.962090    3521 fix.go:112] recreateIfNeeded on multinode-628000: state=Stopped err=<nil>
	W0814 17:40:20.962098    3521 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:40:20.965268    3521 out.go:177] * Restarting existing qemu2 VM for "multinode-628000" ...
	I0814 17:40:20.973306    3521 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:40:20.973358    3521 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/qemu.pid -device virtio-net-pci,netdev=net0,mac=4e:98:b1:11:17:48 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/disk.qcow2
	I0814 17:40:20.975519    3521 main.go:141] libmachine: STDOUT: 
	I0814 17:40:20.975536    3521 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:40:20.975565    3521 fix.go:56] duration metric: took 13.598334ms for fixHost
	I0814 17:40:20.975570    3521 start.go:83] releasing machines lock for "multinode-628000", held for 13.612834ms
	W0814 17:40:20.975577    3521 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:40:20.975617    3521 out.go:239] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:40:20.975622    3521 start.go:729] Will try again in 5 seconds ...
	I0814 17:40:25.977683    3521 start.go:360] acquireMachinesLock for multinode-628000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:40:25.978151    3521 start.go:364] duration metric: took 380.375µs to acquireMachinesLock for "multinode-628000"
	I0814 17:40:25.978297    3521 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:40:25.978321    3521 fix.go:54] fixHost starting: 
	I0814 17:40:25.979081    3521 fix.go:112] recreateIfNeeded on multinode-628000: state=Stopped err=<nil>
	W0814 17:40:25.979108    3521 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:40:25.987587    3521 out.go:177] * Restarting existing qemu2 VM for "multinode-628000" ...
	I0814 17:40:25.991388    3521 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:40:25.991555    3521 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/qemu.pid -device virtio-net-pci,netdev=net0,mac=4e:98:b1:11:17:48 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/disk.qcow2
	I0814 17:40:26.001235    3521 main.go:141] libmachine: STDOUT: 
	I0814 17:40:26.001306    3521 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:40:26.001395    3521 fix.go:56] duration metric: took 23.075583ms for fixHost
	I0814 17:40:26.001410    3521 start.go:83] releasing machines lock for "multinode-628000", held for 23.236917ms
	W0814 17:40:26.001575    3521 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p multinode-628000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p multinode-628000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:40:26.008597    3521 out.go:177] 
	W0814 17:40:26.012610    3521 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:40:26.012635    3521 out.go:239] * 
	* 
	W0814 17:40:26.015142    3521 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:40:26.023527    3521 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:328: failed to run minikube start. args "out/minikube-darwin-arm64 node list -p multinode-628000" : exit status 80
multinode_test.go:331: (dbg) Run:  out/minikube-darwin-arm64 node list -p multinode-628000
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000: exit status 7 (31.951708ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-628000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/RestartKeepsNodes (7.15s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (0.1s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:416: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-628000 node delete m03
multinode_test.go:416: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-628000 node delete m03: exit status 83 (38.536916ms)

                                                
                                                
-- stdout --
	* The control-plane node multinode-628000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p multinode-628000"

                                                
                                                
-- /stdout --
multinode_test.go:418: node delete returned an error. args "out/minikube-darwin-arm64 -p multinode-628000 node delete m03": exit status 83
multinode_test.go:422: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-628000 status --alsologtostderr
multinode_test.go:422: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-628000 status --alsologtostderr: exit status 7 (30.553958ms)

                                                
                                                
-- stdout --
	multinode-628000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:40:26.206382    3537 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:40:26.206538    3537 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:40:26.206541    3537 out.go:304] Setting ErrFile to fd 2...
	I0814 17:40:26.206543    3537 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:40:26.206669    3537 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:40:26.206786    3537 out.go:298] Setting JSON to false
	I0814 17:40:26.206797    3537 mustload.go:65] Loading cluster: multinode-628000
	I0814 17:40:26.206859    3537 notify.go:220] Checking for updates...
	I0814 17:40:26.206990    3537 config.go:182] Loaded profile config "multinode-628000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:40:26.206996    3537 status.go:255] checking status of multinode-628000 ...
	I0814 17:40:26.207206    3537 status.go:330] multinode-628000 host status = "Stopped" (err=<nil>)
	I0814 17:40:26.207209    3537 status.go:343] host is not running, skipping remaining checks
	I0814 17:40:26.207212    3537 status.go:257] multinode-628000 status: &{Name:multinode-628000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:424: failed to run minikube status. args "out/minikube-darwin-arm64 -p multinode-628000 status --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000: exit status 7 (30.15775ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-628000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/DeleteNode (0.10s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (3.19s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:345: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-628000 stop
multinode_test.go:345: (dbg) Done: out/minikube-darwin-arm64 -p multinode-628000 stop: (3.06429225s)
multinode_test.go:351: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-628000 status
multinode_test.go:351: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-628000 status: exit status 7 (63.371125ms)

                                                
                                                
-- stdout --
	multinode-628000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:358: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-628000 status --alsologtostderr
multinode_test.go:358: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-628000 status --alsologtostderr: exit status 7 (32.156791ms)

                                                
                                                
-- stdout --
	multinode-628000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:40:29.396947    3561 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:40:29.397080    3561 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:40:29.397083    3561 out.go:304] Setting ErrFile to fd 2...
	I0814 17:40:29.397085    3561 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:40:29.397197    3561 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:40:29.397307    3561 out.go:298] Setting JSON to false
	I0814 17:40:29.397319    3561 mustload.go:65] Loading cluster: multinode-628000
	I0814 17:40:29.397377    3561 notify.go:220] Checking for updates...
	I0814 17:40:29.397516    3561 config.go:182] Loaded profile config "multinode-628000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:40:29.397521    3561 status.go:255] checking status of multinode-628000 ...
	I0814 17:40:29.397750    3561 status.go:330] multinode-628000 host status = "Stopped" (err=<nil>)
	I0814 17:40:29.397753    3561 status.go:343] host is not running, skipping remaining checks
	I0814 17:40:29.397756    3561 status.go:257] multinode-628000 status: &{Name:multinode-628000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:364: incorrect number of stopped hosts: args "out/minikube-darwin-arm64 -p multinode-628000 status --alsologtostderr": multinode-628000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
multinode_test.go:368: incorrect number of stopped kubelets: args "out/minikube-darwin-arm64 -p multinode-628000 status --alsologtostderr": multinode-628000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000: exit status 7 (29.84ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-628000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/StopMultiNode (3.19s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (5.25s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:376: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-628000 --wait=true -v=8 --alsologtostderr --driver=qemu2 
multinode_test.go:376: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-628000 --wait=true -v=8 --alsologtostderr --driver=qemu2 : exit status 80 (5.18060175s)

                                                
                                                
-- stdout --
	* [multinode-628000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting "multinode-628000" primary control-plane node in "multinode-628000" cluster
	* Restarting existing qemu2 VM for "multinode-628000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "multinode-628000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:40:29.456445    3565 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:40:29.456575    3565 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:40:29.456577    3565 out.go:304] Setting ErrFile to fd 2...
	I0814 17:40:29.456580    3565 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:40:29.456710    3565 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:40:29.457700    3565 out.go:298] Setting JSON to false
	I0814 17:40:29.473585    3565 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2392,"bootTime":1723680037,"procs":455,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:40:29.473651    3565 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:40:29.478361    3565 out.go:177] * [multinode-628000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:40:29.485260    3565 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:40:29.485367    3565 notify.go:220] Checking for updates...
	I0814 17:40:29.492285    3565 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:40:29.495229    3565 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:40:29.498293    3565 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:40:29.501233    3565 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:40:29.504250    3565 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:40:29.507585    3565 config.go:182] Loaded profile config "multinode-628000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:40:29.507863    3565 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:40:29.511150    3565 out.go:177] * Using the qemu2 driver based on existing profile
	I0814 17:40:29.518231    3565 start.go:297] selected driver: qemu2
	I0814 17:40:29.518237    3565 start.go:901] validating driver "qemu2" against &{Name:multinode-628000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kube
rnetesVersion:v1.31.0 ClusterName:multinode-628000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:40:29.518280    3565 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:40:29.520491    3565 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0814 17:40:29.520515    3565 cni.go:84] Creating CNI manager for ""
	I0814 17:40:29.520521    3565 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0814 17:40:29.520565    3565 start.go:340] cluster config:
	{Name:multinode-628000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:multinode-628000 Namespace:default APIServerH
AVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:fals
e DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:40:29.524001    3565 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:40:29.531216    3565 out.go:177] * Starting "multinode-628000" primary control-plane node in "multinode-628000" cluster
	I0814 17:40:29.535190    3565 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:40:29.535209    3565 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:40:29.535217    3565 cache.go:56] Caching tarball of preloaded images
	I0814 17:40:29.535274    3565 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:40:29.535280    3565 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:40:29.535348    3565 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/multinode-628000/config.json ...
	I0814 17:40:29.535827    3565 start.go:360] acquireMachinesLock for multinode-628000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:40:29.535857    3565 start.go:364] duration metric: took 22.792µs to acquireMachinesLock for "multinode-628000"
	I0814 17:40:29.535866    3565 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:40:29.535870    3565 fix.go:54] fixHost starting: 
	I0814 17:40:29.535993    3565 fix.go:112] recreateIfNeeded on multinode-628000: state=Stopped err=<nil>
	W0814 17:40:29.536001    3565 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:40:29.540203    3565 out.go:177] * Restarting existing qemu2 VM for "multinode-628000" ...
	I0814 17:40:29.548244    3565 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:40:29.548280    3565 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/qemu.pid -device virtio-net-pci,netdev=net0,mac=4e:98:b1:11:17:48 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/disk.qcow2
	I0814 17:40:29.550347    3565 main.go:141] libmachine: STDOUT: 
	I0814 17:40:29.550376    3565 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:40:29.550408    3565 fix.go:56] duration metric: took 14.537958ms for fixHost
	I0814 17:40:29.550413    3565 start.go:83] releasing machines lock for "multinode-628000", held for 14.552ms
	W0814 17:40:29.550420    3565 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:40:29.550452    3565 out.go:239] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:40:29.550458    3565 start.go:729] Will try again in 5 seconds ...
	I0814 17:40:34.552020    3565 start.go:360] acquireMachinesLock for multinode-628000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:40:34.552554    3565 start.go:364] duration metric: took 414.958µs to acquireMachinesLock for "multinode-628000"
	I0814 17:40:34.552716    3565 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:40:34.552738    3565 fix.go:54] fixHost starting: 
	I0814 17:40:34.553553    3565 fix.go:112] recreateIfNeeded on multinode-628000: state=Stopped err=<nil>
	W0814 17:40:34.553583    3565 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:40:34.558097    3565 out.go:177] * Restarting existing qemu2 VM for "multinode-628000" ...
	I0814 17:40:34.565059    3565 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:40:34.565314    3565 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/qemu.pid -device virtio-net-pci,netdev=net0,mac=4e:98:b1:11:17:48 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/multinode-628000/disk.qcow2
	I0814 17:40:34.574632    3565 main.go:141] libmachine: STDOUT: 
	I0814 17:40:34.574702    3565 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:40:34.574795    3565 fix.go:56] duration metric: took 22.060333ms for fixHost
	I0814 17:40:34.574809    3565 start.go:83] releasing machines lock for "multinode-628000", held for 22.23ms
	W0814 17:40:34.574997    3565 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p multinode-628000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p multinode-628000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:40:34.582023    3565 out.go:177] 
	W0814 17:40:34.586132    3565 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:40:34.586156    3565 out.go:239] * 
	* 
	W0814 17:40:34.588696    3565 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:40:34.596044    3565 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:378: failed to start cluster. args "out/minikube-darwin-arm64 start -p multinode-628000 --wait=true -v=8 --alsologtostderr --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000: exit status 7 (66.98575ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-628000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/RestartMultiNode (5.25s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (20.97s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:455: (dbg) Run:  out/minikube-darwin-arm64 node list -p multinode-628000
multinode_test.go:464: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-628000-m01 --driver=qemu2 
multinode_test.go:464: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-628000-m01 --driver=qemu2 : exit status 80 (10.254893084s)

                                                
                                                
-- stdout --
	* [multinode-628000-m01] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "multinode-628000-m01" primary control-plane node in "multinode-628000-m01" cluster
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "multinode-628000-m01" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p multinode-628000-m01" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:472: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-628000-m02 --driver=qemu2 
multinode_test.go:472: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-628000-m02 --driver=qemu2 : exit status 80 (10.487135666s)

                                                
                                                
-- stdout --
	* [multinode-628000-m02] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "multinode-628000-m02" primary control-plane node in "multinode-628000-m02" cluster
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "multinode-628000-m02" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p multinode-628000-m02" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:474: failed to start profile. args "out/minikube-darwin-arm64 start -p multinode-628000-m02 --driver=qemu2 " : exit status 80
multinode_test.go:479: (dbg) Run:  out/minikube-darwin-arm64 node add -p multinode-628000
multinode_test.go:479: (dbg) Non-zero exit: out/minikube-darwin-arm64 node add -p multinode-628000: exit status 83 (79.78875ms)

                                                
                                                
-- stdout --
	* The control-plane node multinode-628000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p multinode-628000"

                                                
                                                
-- /stdout --
multinode_test.go:484: (dbg) Run:  out/minikube-darwin-arm64 delete -p multinode-628000-m02
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-628000 -n multinode-628000: exit status 7 (30.143917ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-628000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/ValidateNameConflict (20.97s)

                                                
                                    
x
+
TestPreload (10.01s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-darwin-arm64 start -p test-preload-760000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.24.4
preload_test.go:44: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p test-preload-760000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.24.4: exit status 80 (9.861043625s)

                                                
                                                
-- stdout --
	* [test-preload-760000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "test-preload-760000" primary control-plane node in "test-preload-760000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "test-preload-760000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:40:55.784073    3624 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:40:55.784207    3624 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:40:55.784210    3624 out.go:304] Setting ErrFile to fd 2...
	I0814 17:40:55.784212    3624 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:40:55.784359    3624 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:40:55.785444    3624 out.go:298] Setting JSON to false
	I0814 17:40:55.801409    3624 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2418,"bootTime":1723680037,"procs":455,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:40:55.801474    3624 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:40:55.807764    3624 out.go:177] * [test-preload-760000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:40:55.815810    3624 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:40:55.815877    3624 notify.go:220] Checking for updates...
	I0814 17:40:55.823730    3624 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:40:55.826790    3624 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:40:55.833793    3624 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:40:55.836721    3624 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:40:55.839708    3624 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:40:55.842983    3624 config.go:182] Loaded profile config "multinode-628000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:40:55.843050    3624 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:40:55.847739    3624 out.go:177] * Using the qemu2 driver based on user configuration
	I0814 17:40:55.854686    3624 start.go:297] selected driver: qemu2
	I0814 17:40:55.854693    3624 start.go:901] validating driver "qemu2" against <nil>
	I0814 17:40:55.854700    3624 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:40:55.857126    3624 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0814 17:40:55.859707    3624 out.go:177] * Automatically selected the socket_vmnet network
	I0814 17:40:55.862776    3624 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0814 17:40:55.862806    3624 cni.go:84] Creating CNI manager for ""
	I0814 17:40:55.862813    3624 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:40:55.862817    3624 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0814 17:40:55.862862    3624 start.go:340] cluster config:
	{Name:test-preload-760000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.4 ClusterName:test-preload-760000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Conta
inerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/so
cket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:40:55.866798    3624 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:40:55.874708    3624 out.go:177] * Starting "test-preload-760000" primary control-plane node in "test-preload-760000" cluster
	I0814 17:40:55.878501    3624 preload.go:131] Checking if preload exists for k8s version v1.24.4 and runtime docker
	I0814 17:40:55.878585    3624 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/test-preload-760000/config.json ...
	I0814 17:40:55.878603    3624 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/test-preload-760000/config.json: {Name:mk7adbffada7d6b04bae416854f07df65974b16c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:40:55.878603    3624 cache.go:107] acquiring lock: {Name:mkfb2a02c93df7684ceeb9294fe33d944a3bb658 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:40:55.878609    3624 cache.go:107] acquiring lock: {Name:mk359f5009d368d12087fcc88e3b61934a717f69 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:40:55.878602    3624 cache.go:107] acquiring lock: {Name:mk30a6a0d466916ba623cab5b5193579b9e9606e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:40:55.878640    3624 cache.go:107] acquiring lock: {Name:mk1b48455b146654f375f36dc360755825b5e11e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:40:55.878859    3624 cache.go:107] acquiring lock: {Name:mk8810923cf983b7bec38fa3f7cc79762eaa0d56 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:40:55.878919    3624 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.24.4
	I0814 17:40:55.878904    3624 cache.go:107] acquiring lock: {Name:mke9c494219c1fb93febce323a1c14c0a22cb858 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:40:55.878943    3624 cache.go:107] acquiring lock: {Name:mk04590ae7e3d6a0c836d52581e79c609db88a64 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:40:55.878993    3624 image.go:135] retrieving image: registry.k8s.io/pause:3.7
	I0814 17:40:55.879013    3624 start.go:360] acquireMachinesLock for test-preload-760000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:40:55.879059    3624 start.go:364] duration metric: took 39.292µs to acquireMachinesLock for "test-preload-760000"
	I0814 17:40:55.879057    3624 cache.go:107] acquiring lock: {Name:mk56cb9ff25e8a0656c456c49dd53bc8fa328e70 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:40:55.879099    3624 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.24.4
	I0814 17:40:55.879109    3624 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.24.4
	I0814 17:40:55.879072    3624 start.go:93] Provisioning new machine with config: &{Name:test-preload-760000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.24.4 ClusterName:test-preload-760000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOp
tions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:40:55.879129    3624 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:40:55.879236    3624 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.24.4
	I0814 17:40:55.878996    3624 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:40:55.879329    3624 image.go:135] retrieving image: registry.k8s.io/coredns/coredns:v1.8.6
	I0814 17:40:55.879387    3624 image.go:135] retrieving image: registry.k8s.io/etcd:3.5.3-0
	I0814 17:40:55.883724    3624 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0814 17:40:55.892220    3624 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.24.4
	I0814 17:40:55.893193    3624 image.go:178] daemon lookup for registry.k8s.io/coredns/coredns:v1.8.6: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.8.6
	I0814 17:40:55.893333    3624 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.24.4
	I0814 17:40:55.893369    3624 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:40:55.893392    3624 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.24.4
	I0814 17:40:55.893410    3624 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.24.4
	I0814 17:40:55.893401    3624 image.go:178] daemon lookup for registry.k8s.io/pause:3.7: Error response from daemon: No such image: registry.k8s.io/pause:3.7
	I0814 17:40:55.893756    3624 image.go:178] daemon lookup for registry.k8s.io/etcd:3.5.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.3-0
	I0814 17:40:55.902739    3624 start.go:159] libmachine.API.Create for "test-preload-760000" (driver="qemu2")
	I0814 17:40:55.902756    3624 client.go:168] LocalClient.Create starting
	I0814 17:40:55.902839    3624 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:40:55.902875    3624 main.go:141] libmachine: Decoding PEM data...
	I0814 17:40:55.902894    3624 main.go:141] libmachine: Parsing certificate...
	I0814 17:40:55.902932    3624 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:40:55.902956    3624 main.go:141] libmachine: Decoding PEM data...
	I0814 17:40:55.902964    3624 main.go:141] libmachine: Parsing certificate...
	I0814 17:40:55.903365    3624 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:40:56.050673    3624 main.go:141] libmachine: Creating SSH key...
	I0814 17:40:56.232594    3624 main.go:141] libmachine: Creating Disk image...
	I0814 17:40:56.232617    3624 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:40:56.232768    3624 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/test-preload-760000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/test-preload-760000/disk.qcow2
	I0814 17:40:56.242822    3624 main.go:141] libmachine: STDOUT: 
	I0814 17:40:56.242872    3624 main.go:141] libmachine: STDERR: 
	I0814 17:40:56.242947    3624 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/test-preload-760000/disk.qcow2 +20000M
	I0814 17:40:56.251654    3624 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:40:56.251674    3624 main.go:141] libmachine: STDERR: 
	I0814 17:40:56.251692    3624 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/test-preload-760000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/test-preload-760000/disk.qcow2
	I0814 17:40:56.251696    3624 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:40:56.251712    3624 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:40:56.251739    3624 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/test-preload-760000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/test-preload-760000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/test-preload-760000/qemu.pid -device virtio-net-pci,netdev=net0,mac=e6:8b:30:b7:28:88 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/test-preload-760000/disk.qcow2
	I0814 17:40:56.253610    3624 main.go:141] libmachine: STDOUT: 
	I0814 17:40:56.253640    3624 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:40:56.253663    3624 client.go:171] duration metric: took 350.909167ms to LocalClient.Create
	I0814 17:40:56.459024    3624 cache.go:162] opening:  /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.4
	I0814 17:40:56.475837    3624 cache.go:162] opening:  /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.24.4
	I0814 17:40:56.477284    3624 cache.go:162] opening:  /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.4
	W0814 17:40:56.479716    3624 image.go:283] image registry.k8s.io/coredns/coredns:v1.8.6 arch mismatch: want arm64 got amd64. fixing
	I0814 17:40:56.479736    3624 cache.go:162] opening:  /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6
	I0814 17:40:56.517710    3624 cache.go:162] opening:  /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.4
	I0814 17:40:56.558333    3624 cache.go:162] opening:  /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7
	I0814 17:40:56.587339    3624 cache.go:162] opening:  /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0
	I0814 17:40:56.782575    3624 cache.go:157] /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7 exists
	I0814 17:40:56.782654    3624 cache.go:96] cache image "registry.k8s.io/pause:3.7" -> "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7" took 904.026792ms
	I0814 17:40:56.782699    3624 cache.go:80] save to tar file registry.k8s.io/pause:3.7 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7 succeeded
	W0814 17:40:56.968519    3624 image.go:283] image gcr.io/k8s-minikube/storage-provisioner:v5 arch mismatch: want arm64 got amd64. fixing
	I0814 17:40:56.968623    3624 cache.go:162] opening:  /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5
	I0814 17:40:57.269969    3624 cache.go:157] /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I0814 17:40:57.270027    3624 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 1.391445709s
	I0814 17:40:57.270052    3624 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I0814 17:40:58.253895    3624 start.go:128] duration metric: took 2.374755792s to createHost
	I0814 17:40:58.253956    3624 start.go:83] releasing machines lock for "test-preload-760000", held for 2.374936709s
	W0814 17:40:58.254020    3624 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:40:58.265145    3624 out.go:177] * Deleting "test-preload-760000" in qemu2 ...
	W0814 17:40:58.293296    3624 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:40:58.293325    3624 start.go:729] Will try again in 5 seconds ...
	I0814 17:40:58.721888    3624 cache.go:157] /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.24.4 exists
	I0814 17:40:58.721941    3624 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.24.4" -> "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.24.4" took 2.843144625s
	I0814 17:40:58.721964    3624 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.24.4 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.24.4 succeeded
	I0814 17:40:58.868279    3624 cache.go:157] /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6 exists
	I0814 17:40:58.868321    3624 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.8.6" -> "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6" took 2.989526834s
	I0814 17:40:58.868350    3624 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.8.6 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6 succeeded
	I0814 17:41:00.320077    3624 cache.go:157] /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.4 exists
	I0814 17:41:00.320135    3624 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.24.4" -> "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.4" took 4.44162775s
	I0814 17:41:00.320163    3624 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.24.4 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.4 succeeded
	I0814 17:41:00.813345    3624 cache.go:157] /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.4 exists
	I0814 17:41:00.813398    3624 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.24.4" -> "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.4" took 4.9348945s
	I0814 17:41:00.813427    3624 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.24.4 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.4 succeeded
	I0814 17:41:02.188612    3624 cache.go:157] /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.4 exists
	I0814 17:41:02.188661    3624 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.24.4" -> "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.4" took 6.309736708s
	I0814 17:41:02.188685    3624 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.24.4 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.4 succeeded
	I0814 17:41:03.293405    3624 start.go:360] acquireMachinesLock for test-preload-760000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:41:03.293877    3624 start.go:364] duration metric: took 383.834µs to acquireMachinesLock for "test-preload-760000"
	I0814 17:41:03.293998    3624 start.go:93] Provisioning new machine with config: &{Name:test-preload-760000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.24.4 ClusterName:test-preload-760000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOp
tions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:41:03.294273    3624 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:41:03.307093    3624 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0814 17:41:03.357083    3624 start.go:159] libmachine.API.Create for "test-preload-760000" (driver="qemu2")
	I0814 17:41:03.357142    3624 client.go:168] LocalClient.Create starting
	I0814 17:41:03.357273    3624 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:41:03.357336    3624 main.go:141] libmachine: Decoding PEM data...
	I0814 17:41:03.357356    3624 main.go:141] libmachine: Parsing certificate...
	I0814 17:41:03.357437    3624 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:41:03.357481    3624 main.go:141] libmachine: Decoding PEM data...
	I0814 17:41:03.357496    3624 main.go:141] libmachine: Parsing certificate...
	I0814 17:41:03.357997    3624 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:41:03.452424    3624 cache.go:157] /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0 exists
	I0814 17:41:03.452444    3624 cache.go:96] cache image "registry.k8s.io/etcd:3.5.3-0" -> "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0" took 7.573769667s
	I0814 17:41:03.452453    3624 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.3-0 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0 succeeded
	I0814 17:41:03.452464    3624 cache.go:87] Successfully saved all images to host disk.
	I0814 17:41:03.517988    3624 main.go:141] libmachine: Creating SSH key...
	I0814 17:41:03.548651    3624 main.go:141] libmachine: Creating Disk image...
	I0814 17:41:03.548656    3624 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:41:03.548839    3624 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/test-preload-760000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/test-preload-760000/disk.qcow2
	I0814 17:41:03.558083    3624 main.go:141] libmachine: STDOUT: 
	I0814 17:41:03.558114    3624 main.go:141] libmachine: STDERR: 
	I0814 17:41:03.558180    3624 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/test-preload-760000/disk.qcow2 +20000M
	I0814 17:41:03.566141    3624 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:41:03.566156    3624 main.go:141] libmachine: STDERR: 
	I0814 17:41:03.566170    3624 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/test-preload-760000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/test-preload-760000/disk.qcow2
	I0814 17:41:03.566173    3624 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:41:03.566189    3624 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:41:03.566224    3624 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/test-preload-760000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/test-preload-760000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/test-preload-760000/qemu.pid -device virtio-net-pci,netdev=net0,mac=8a:ed:05:f6:84:47 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/test-preload-760000/disk.qcow2
	I0814 17:41:03.567873    3624 main.go:141] libmachine: STDOUT: 
	I0814 17:41:03.567889    3624 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:41:03.567903    3624 client.go:171] duration metric: took 210.758833ms to LocalClient.Create
	I0814 17:41:05.570165    3624 start.go:128] duration metric: took 2.275851584s to createHost
	I0814 17:41:05.570249    3624 start.go:83] releasing machines lock for "test-preload-760000", held for 2.276388875s
	W0814 17:41:05.570717    3624 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p test-preload-760000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p test-preload-760000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:41:05.586326    3624 out.go:177] 
	W0814 17:41:05.590408    3624 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:41:05.590434    3624 out.go:239] * 
	* 
	W0814 17:41:05.593259    3624 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:41:05.602294    3624 out.go:177] 

                                                
                                                
** /stderr **
preload_test.go:46: out/minikube-darwin-arm64 start -p test-preload-760000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.24.4 failed: exit status 80
panic.go:626: *** TestPreload FAILED at 2024-08-14 17:41:05.62017 -0700 PDT m=+2193.928451334
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p test-preload-760000 -n test-preload-760000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p test-preload-760000 -n test-preload-760000: exit status 7 (65.755417ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "test-preload-760000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "test-preload-760000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p test-preload-760000
--- FAIL: TestPreload (10.01s)

                                                
                                    
x
+
TestScheduledStopUnix (9.96s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-darwin-arm64 start -p scheduled-stop-100000 --memory=2048 --driver=qemu2 
scheduled_stop_test.go:128: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p scheduled-stop-100000 --memory=2048 --driver=qemu2 : exit status 80 (9.806922042s)

                                                
                                                
-- stdout --
	* [scheduled-stop-100000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "scheduled-stop-100000" primary control-plane node in "scheduled-stop-100000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "scheduled-stop-100000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p scheduled-stop-100000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
scheduled_stop_test.go:130: starting minikube: exit status 80

                                                
                                                
-- stdout --
	* [scheduled-stop-100000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "scheduled-stop-100000" primary control-plane node in "scheduled-stop-100000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "scheduled-stop-100000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p scheduled-stop-100000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
panic.go:626: *** TestScheduledStopUnix FAILED at 2024-08-14 17:41:15.569534 -0700 PDT m=+2203.878023459
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p scheduled-stop-100000 -n scheduled-stop-100000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p scheduled-stop-100000 -n scheduled-stop-100000: exit status 7 (70.395041ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "scheduled-stop-100000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "scheduled-stop-100000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p scheduled-stop-100000
--- FAIL: TestScheduledStopUnix (9.96s)

                                                
                                    
x
+
TestSkaffold (12.35s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:59: (dbg) Run:  /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/skaffold.exe122889686 version
skaffold_test.go:59: (dbg) Done: /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/skaffold.exe122889686 version: (1.05411525s)
skaffold_test.go:63: skaffold version: v2.13.1
skaffold_test.go:66: (dbg) Run:  out/minikube-darwin-arm64 start -p skaffold-022000 --memory=2600 --driver=qemu2 
skaffold_test.go:66: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p skaffold-022000 --memory=2600 --driver=qemu2 : exit status 80 (9.849411125s)

                                                
                                                
-- stdout --
	* [skaffold-022000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "skaffold-022000" primary control-plane node in "skaffold-022000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "skaffold-022000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p skaffold-022000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
skaffold_test.go:68: starting minikube: exit status 80

                                                
                                                
-- stdout --
	* [skaffold-022000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "skaffold-022000" primary control-plane node in "skaffold-022000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "skaffold-022000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p skaffold-022000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
panic.go:626: *** TestSkaffold FAILED at 2024-08-14 17:41:27.918074 -0700 PDT m=+2216.226821959
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p skaffold-022000 -n skaffold-022000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p skaffold-022000 -n skaffold-022000: exit status 7 (62.248708ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "skaffold-022000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "skaffold-022000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p skaffold-022000
--- FAIL: TestSkaffold (12.35s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (622.15s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:120: (dbg) Run:  /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube-v1.26.0.93159371 start -p running-upgrade-987000 --memory=2200 --vm-driver=qemu2 
version_upgrade_test.go:120: (dbg) Done: /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube-v1.26.0.93159371 start -p running-upgrade-987000 --memory=2200 --vm-driver=qemu2 : (1m6.335013542s)
version_upgrade_test.go:130: (dbg) Run:  out/minikube-darwin-arm64 start -p running-upgrade-987000 --memory=2200 --alsologtostderr -v=1 --driver=qemu2 
E0814 17:43:21.334822    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:44:55.314382    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:46:24.423120    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:48:21.326329    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:49:55.305783    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
version_upgrade_test.go:130: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p running-upgrade-987000 --memory=2200 --alsologtostderr -v=1 --driver=qemu2 : exit status 80 (8m41.034492167s)

                                                
                                                
-- stdout --
	* [running-upgrade-987000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Kubernetes 1.31.0 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.0
	* Using the qemu2 driver based on existing profile
	* Starting "running-upgrade-987000" primary control-plane node in "running-upgrade-987000" cluster
	* Updating the running qemu2 "running-upgrade-987000" VM ...
	* Preparing Kubernetes v1.24.1 on Docker 20.10.16 ...
	  - Generating certificates and keys ...
	  - Booting up control plane ...
	  - Configuring RBAC rules ...
	* Configuring bridge CNI (Container Networking Interface) ...
	* Verifying Kubernetes components...
	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	* Enabled addons: storage-provisioner
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:42:57.276923    3966 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:42:57.277058    3966 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:42:57.277062    3966 out.go:304] Setting ErrFile to fd 2...
	I0814 17:42:57.277064    3966 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:42:57.277171    3966 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:42:57.278121    3966 out.go:298] Setting JSON to false
	I0814 17:42:57.294748    3966 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2540,"bootTime":1723680037,"procs":459,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:42:57.294822    3966 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:42:57.299746    3966 out.go:177] * [running-upgrade-987000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:42:57.307734    3966 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:42:57.307830    3966 notify.go:220] Checking for updates...
	I0814 17:42:57.315631    3966 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:42:57.319712    3966 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:42:57.322675    3966 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:42:57.325710    3966 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:42:57.328751    3966 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:42:57.330065    3966 config.go:182] Loaded profile config "running-upgrade-987000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I0814 17:42:57.332660    3966 out.go:177] * Kubernetes 1.31.0 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.0
	I0814 17:42:57.335671    3966 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:42:57.339600    3966 out.go:177] * Using the qemu2 driver based on existing profile
	I0814 17:42:57.346722    3966 start.go:297] selected driver: qemu2
	I0814 17:42:57.346727    3966 start.go:901] validating driver "qemu2" against &{Name:running-upgrade-987000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.26.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:50332 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:running-upgra
de-987000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizat
ions:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s}
	I0814 17:42:57.346773    3966 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:42:57.348862    3966 cni.go:84] Creating CNI manager for ""
	I0814 17:42:57.348881    3966 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:42:57.348901    3966 start.go:340] cluster config:
	{Name:running-upgrade-987000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.26.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:50332 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:running-upgrade-987000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerN
ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:
SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s}
	I0814 17:42:57.348947    3966 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:42:57.355658    3966 out.go:177] * Starting "running-upgrade-987000" primary control-plane node in "running-upgrade-987000" cluster
	I0814 17:42:57.359719    3966 preload.go:131] Checking if preload exists for k8s version v1.24.1 and runtime docker
	I0814 17:42:57.359731    3966 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-arm64.tar.lz4
	I0814 17:42:57.359738    3966 cache.go:56] Caching tarball of preloaded images
	I0814 17:42:57.359783    3966 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:42:57.359790    3966 cache.go:59] Finished verifying existence of preloaded tar for v1.24.1 on docker
	I0814 17:42:57.359839    3966 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/config.json ...
	I0814 17:42:57.360182    3966 start.go:360] acquireMachinesLock for running-upgrade-987000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:43:09.835360    3966 start.go:364] duration metric: took 12.476446959s to acquireMachinesLock for "running-upgrade-987000"
	I0814 17:43:09.835381    3966 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:43:09.835385    3966 fix.go:54] fixHost starting: 
	I0814 17:43:09.836359    3966 fix.go:112] recreateIfNeeded on running-upgrade-987000: state=Running err=<nil>
	W0814 17:43:09.836375    3966 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:43:09.839942    3966 out.go:177] * Updating the running qemu2 "running-upgrade-987000" VM ...
	I0814 17:43:09.847788    3966 machine.go:94] provisionDockerMachine start ...
	I0814 17:43:09.847876    3966 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:09.848030    3966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1028f85a0] 0x1028fae00 <nil>  [] 0s} localhost 50265 <nil> <nil>}
	I0814 17:43:09.848035    3966 main.go:141] libmachine: About to run SSH command:
	hostname
	I0814 17:43:09.938855    3966 main.go:141] libmachine: SSH cmd err, output: <nil>: running-upgrade-987000
	
	I0814 17:43:09.938876    3966 buildroot.go:166] provisioning hostname "running-upgrade-987000"
	I0814 17:43:09.938923    3966 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:09.939054    3966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1028f85a0] 0x1028fae00 <nil>  [] 0s} localhost 50265 <nil> <nil>}
	I0814 17:43:09.939059    3966 main.go:141] libmachine: About to run SSH command:
	sudo hostname running-upgrade-987000 && echo "running-upgrade-987000" | sudo tee /etc/hostname
	I0814 17:43:10.016249    3966 main.go:141] libmachine: SSH cmd err, output: <nil>: running-upgrade-987000
	
	I0814 17:43:10.016311    3966 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:10.016451    3966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1028f85a0] 0x1028fae00 <nil>  [] 0s} localhost 50265 <nil> <nil>}
	I0814 17:43:10.016458    3966 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\srunning-upgrade-987000' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 running-upgrade-987000/g' /etc/hosts;
				else 
					echo '127.0.1.1 running-upgrade-987000' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0814 17:43:10.091287    3966 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0814 17:43:10.091310    3966 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/19443-949/.minikube CaCertPath:/Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/19443-949/.minikube}
	I0814 17:43:10.091322    3966 buildroot.go:174] setting up certificates
	I0814 17:43:10.091327    3966 provision.go:84] configureAuth start
	I0814 17:43:10.091332    3966 provision.go:143] copyHostCerts
	I0814 17:43:10.091407    3966 exec_runner.go:144] found /Users/jenkins/minikube-integration/19443-949/.minikube/cert.pem, removing ...
	I0814 17:43:10.091413    3966 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19443-949/.minikube/cert.pem
	I0814 17:43:10.091538    3966 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/19443-949/.minikube/cert.pem (1123 bytes)
	I0814 17:43:10.091710    3966 exec_runner.go:144] found /Users/jenkins/minikube-integration/19443-949/.minikube/key.pem, removing ...
	I0814 17:43:10.091713    3966 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19443-949/.minikube/key.pem
	I0814 17:43:10.091754    3966 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/19443-949/.minikube/key.pem (1679 bytes)
	I0814 17:43:10.091852    3966 exec_runner.go:144] found /Users/jenkins/minikube-integration/19443-949/.minikube/ca.pem, removing ...
	I0814 17:43:10.091855    3966 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19443-949/.minikube/ca.pem
	I0814 17:43:10.091895    3966 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/19443-949/.minikube/ca.pem (1078 bytes)
	I0814 17:43:10.091974    3966 provision.go:117] generating server cert: /Users/jenkins/minikube-integration/19443-949/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca-key.pem org=jenkins.running-upgrade-987000 san=[127.0.0.1 localhost minikube running-upgrade-987000]
	I0814 17:43:10.152178    3966 provision.go:177] copyRemoteCerts
	I0814 17:43:10.152224    3966 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0814 17:43:10.152238    3966 sshutil.go:53] new ssh client: &{IP:localhost Port:50265 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/running-upgrade-987000/id_rsa Username:docker}
	I0814 17:43:10.191207    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0814 17:43:10.200524    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
	I0814 17:43:10.207988    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0814 17:43:10.215039    3966 provision.go:87] duration metric: took 123.714292ms to configureAuth
	I0814 17:43:10.215051    3966 buildroot.go:189] setting minikube options for container-runtime
	I0814 17:43:10.215186    3966 config.go:182] Loaded profile config "running-upgrade-987000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I0814 17:43:10.215227    3966 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:10.215322    3966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1028f85a0] 0x1028fae00 <nil>  [] 0s} localhost 50265 <nil> <nil>}
	I0814 17:43:10.215326    3966 main.go:141] libmachine: About to run SSH command:
	df --output=fstype / | tail -n 1
	I0814 17:43:10.286559    3966 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs
	
	I0814 17:43:10.286571    3966 buildroot.go:70] root file system type: tmpfs
	I0814 17:43:10.286618    3966 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
	I0814 17:43:10.286669    3966 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:10.286788    3966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1028f85a0] 0x1028fae00 <nil>  [] 0s} localhost 50265 <nil> <nil>}
	I0814 17:43:10.286822    3966 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	After=network.target  minikube-automount.service docker.socket
	Requires= minikube-automount.service docker.socket 
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP \$MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	" | sudo tee /lib/systemd/system/docker.service.new
	I0814 17:43:10.362130    3966 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	After=network.target  minikube-automount.service docker.socket
	Requires= minikube-automount.service docker.socket 
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP $MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	
	I0814 17:43:10.362182    3966 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:10.362305    3966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1028f85a0] 0x1028fae00 <nil>  [] 0s} localhost 50265 <nil> <nil>}
	I0814 17:43:10.362313    3966 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
	I0814 17:43:10.435191    3966 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0814 17:43:10.435201    3966 machine.go:97] duration metric: took 587.448292ms to provisionDockerMachine
	I0814 17:43:10.435206    3966 start.go:293] postStartSetup for "running-upgrade-987000" (driver="qemu2")
	I0814 17:43:10.435213    3966 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0814 17:43:10.435260    3966 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0814 17:43:10.435269    3966 sshutil.go:53] new ssh client: &{IP:localhost Port:50265 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/running-upgrade-987000/id_rsa Username:docker}
	I0814 17:43:10.471901    3966 ssh_runner.go:195] Run: cat /etc/os-release
	I0814 17:43:10.473174    3966 info.go:137] Remote host: Buildroot 2021.02.12
	I0814 17:43:10.473181    3966 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19443-949/.minikube/addons for local assets ...
	I0814 17:43:10.473249    3966 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19443-949/.minikube/files for local assets ...
	I0814 17:43:10.473339    3966 filesync.go:149] local asset: /Users/jenkins/minikube-integration/19443-949/.minikube/files/etc/ssl/certs/14042.pem -> 14042.pem in /etc/ssl/certs
	I0814 17:43:10.473431    3966 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0814 17:43:10.476433    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/files/etc/ssl/certs/14042.pem --> /etc/ssl/certs/14042.pem (1708 bytes)
	I0814 17:43:10.482809    3966 start.go:296] duration metric: took 47.60075ms for postStartSetup
	I0814 17:43:10.482822    3966 fix.go:56] duration metric: took 647.485417ms for fixHost
	I0814 17:43:10.482854    3966 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:10.482963    3966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1028f85a0] 0x1028fae00 <nil>  [] 0s} localhost 50265 <nil> <nil>}
	I0814 17:43:10.482967    3966 main.go:141] libmachine: About to run SSH command:
	date +%s.%N
	I0814 17:43:10.552545    3966 main.go:141] libmachine: SSH cmd err, output: <nil>: 1723682590.739823230
	
	I0814 17:43:10.552553    3966 fix.go:216] guest clock: 1723682590.739823230
	I0814 17:43:10.552558    3966 fix.go:229] Guest: 2024-08-14 17:43:10.73982323 -0700 PDT Remote: 2024-08-14 17:43:10.482823 -0700 PDT m=+13.227440085 (delta=257.00023ms)
	I0814 17:43:10.552569    3966 fix.go:200] guest clock delta is within tolerance: 257.00023ms
	I0814 17:43:10.552572    3966 start.go:83] releasing machines lock for "running-upgrade-987000", held for 717.255833ms
	I0814 17:43:10.552635    3966 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0814 17:43:10.552638    3966 ssh_runner.go:195] Run: cat /version.json
	I0814 17:43:10.552645    3966 sshutil.go:53] new ssh client: &{IP:localhost Port:50265 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/running-upgrade-987000/id_rsa Username:docker}
	I0814 17:43:10.552658    3966 sshutil.go:53] new ssh client: &{IP:localhost Port:50265 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/running-upgrade-987000/id_rsa Username:docker}
	W0814 17:43:10.553370    3966 sshutil.go:64] dial failure (will retry): dial tcp [::1]:50265: connect: connection refused
	I0814 17:43:10.553393    3966 retry.go:31] will retry after 159.58979ms: dial tcp [::1]:50265: connect: connection refused
	W0814 17:43:10.751710    3966 start.go:419] Unable to open version.json: cat /version.json: Process exited with status 1
	stdout:
	
	stderr:
	cat: /version.json: No such file or directory
	I0814 17:43:10.751781    3966 ssh_runner.go:195] Run: systemctl --version
	I0814 17:43:10.753761    3966 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	W0814 17:43:10.755558    3966 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
	I0814 17:43:10.755587    3966 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
	I0814 17:43:10.758377    3966 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
	I0814 17:43:10.763204    3966 cni.go:308] configured [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
	I0814 17:43:10.763211    3966 start.go:495] detecting cgroup driver to use...
	I0814 17:43:10.763279    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0814 17:43:10.768755    3966 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.7"|' /etc/containerd/config.toml"
	I0814 17:43:10.771913    3966 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0814 17:43:10.774716    3966 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
	I0814 17:43:10.774736    3966 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0814 17:43:10.777878    3966 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0814 17:43:10.781311    3966 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0814 17:43:10.784860    3966 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0814 17:43:10.787732    3966 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0814 17:43:10.790835    3966 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0814 17:43:10.794109    3966 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
	I0814 17:43:10.797444    3966 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"
	I0814 17:43:10.800472    3966 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0814 17:43:10.803183    3966 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0814 17:43:10.805810    3966 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:43:10.894078    3966 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0814 17:43:10.905139    3966 start.go:495] detecting cgroup driver to use...
	I0814 17:43:10.905219    3966 ssh_runner.go:195] Run: sudo systemctl cat docker.service
	I0814 17:43:10.910482    3966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0814 17:43:10.915207    3966 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0814 17:43:10.923301    3966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0814 17:43:10.928765    3966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0814 17:43:10.933321    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0814 17:43:10.938541    3966 ssh_runner.go:195] Run: which cri-dockerd
	I0814 17:43:10.939917    3966 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
	I0814 17:43:10.942760    3966 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
	I0814 17:43:10.948067    3966 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
	I0814 17:43:11.062303    3966 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
	I0814 17:43:11.169494    3966 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
	I0814 17:43:11.169546    3966 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
	I0814 17:43:11.174894    3966 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:43:11.278986    3966 ssh_runner.go:195] Run: sudo systemctl restart docker
	I0814 17:43:17.905352    3966 ssh_runner.go:235] Completed: sudo systemctl restart docker: (6.626770458s)
	I0814 17:43:17.905415    3966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket
	I0814 17:43:17.910704    3966 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket
	I0814 17:43:17.918949    3966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
	I0814 17:43:17.924295    3966 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
	I0814 17:43:18.010386    3966 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
	I0814 17:43:18.100238    3966 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:43:18.188571    3966 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
	I0814 17:43:18.195765    3966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
	I0814 17:43:18.200488    3966 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:43:18.299512    3966 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service
	I0814 17:43:18.345087    3966 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock
	I0814 17:43:18.345162    3966 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
	I0814 17:43:18.348176    3966 start.go:563] Will wait 60s for crictl version
	I0814 17:43:18.348258    3966 ssh_runner.go:195] Run: which crictl
	I0814 17:43:18.350083    3966 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0814 17:43:18.363320    3966 start.go:579] Version:  0.1.0
	RuntimeName:  docker
	RuntimeVersion:  20.10.16
	RuntimeApiVersion:  1.41.0
	I0814 17:43:18.363385    3966 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I0814 17:43:18.379442    3966 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I0814 17:43:18.401502    3966 out.go:204] * Preparing Kubernetes v1.24.1 on Docker 20.10.16 ...
	I0814 17:43:18.401596    3966 ssh_runner.go:195] Run: grep 10.0.2.2	host.minikube.internal$ /etc/hosts
	I0814 17:43:18.403501    3966 kubeadm.go:883] updating cluster {Name:running-upgrade-987000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:50332 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName
:running-upgrade-987000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Di
sableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s} ...
	I0814 17:43:18.403558    3966 preload.go:131] Checking if preload exists for k8s version v1.24.1 and runtime docker
	I0814 17:43:18.403606    3966 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I0814 17:43:18.414813    3966 docker.go:685] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-apiserver:v1.24.1
	k8s.gcr.io/kube-proxy:v1.24.1
	k8s.gcr.io/kube-controller-manager:v1.24.1
	k8s.gcr.io/kube-scheduler:v1.24.1
	k8s.gcr.io/etcd:3.5.3-0
	k8s.gcr.io/pause:3.7
	k8s.gcr.io/coredns/coredns:v1.8.6
	k8s.gcr.io/pause:3.6
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I0814 17:43:18.414823    3966 docker.go:691] registry.k8s.io/kube-apiserver:v1.24.1 wasn't preloaded
	I0814 17:43:18.414873    3966 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I0814 17:43:18.418249    3966 ssh_runner.go:195] Run: which lz4
	I0814 17:43:18.419882    3966 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
	I0814 17:43:18.421272    3966 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/preloaded.tar.lz4': No such file or directory
	I0814 17:43:18.421297    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (359514331 bytes)
	I0814 17:43:19.543565    3966 docker.go:649] duration metric: took 1.123792166s to copy over tarball
	I0814 17:43:19.543626    3966 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
	I0814 17:43:20.621259    3966 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (1.077675375s)
	I0814 17:43:20.621273    3966 ssh_runner.go:146] rm: /preloaded.tar.lz4
	I0814 17:43:20.637061    3966 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I0814 17:43:20.640099    3966 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2523 bytes)
	I0814 17:43:20.645620    3966 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:43:20.735433    3966 ssh_runner.go:195] Run: sudo systemctl restart docker
	I0814 17:43:21.913445    3966 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.178045958s)
	I0814 17:43:21.913695    3966 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I0814 17:43:21.938831    3966 docker.go:685] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-apiserver:v1.24.1
	k8s.gcr.io/kube-proxy:v1.24.1
	k8s.gcr.io/kube-controller-manager:v1.24.1
	k8s.gcr.io/kube-scheduler:v1.24.1
	k8s.gcr.io/etcd:3.5.3-0
	k8s.gcr.io/pause:3.7
	k8s.gcr.io/coredns/coredns:v1.8.6
	<none>:<none>
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I0814 17:43:21.938840    3966 docker.go:691] registry.k8s.io/kube-apiserver:v1.24.1 wasn't preloaded
	I0814 17:43:21.938844    3966 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.24.1 registry.k8s.io/kube-controller-manager:v1.24.1 registry.k8s.io/kube-scheduler:v1.24.1 registry.k8s.io/kube-proxy:v1.24.1 registry.k8s.io/pause:3.7 registry.k8s.io/etcd:3.5.3-0 registry.k8s.io/coredns/coredns:v1.8.6 gcr.io/k8s-minikube/storage-provisioner:v5]
	I0814 17:43:21.942722    3966 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:43:21.944494    3966 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.24.1
	I0814 17:43:21.946281    3966 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:43:21.946314    3966 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.24.1
	I0814 17:43:21.948881    3966 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.24.1
	I0814 17:43:21.948875    3966 image.go:135] retrieving image: registry.k8s.io/etcd:3.5.3-0
	I0814 17:43:21.951064    3966 image.go:135] retrieving image: registry.k8s.io/pause:3.7
	I0814 17:43:21.951091    3966 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.24.1
	I0814 17:43:21.953344    3966 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.24.1
	I0814 17:43:21.953632    3966 image.go:178] daemon lookup for registry.k8s.io/etcd:3.5.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.3-0
	I0814 17:43:21.955266    3966 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.24.1
	I0814 17:43:21.955278    3966 image.go:178] daemon lookup for registry.k8s.io/pause:3.7: Error response from daemon: No such image: registry.k8s.io/pause:3.7
	I0814 17:43:21.956314    3966 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.24.1
	I0814 17:43:21.957020    3966 image.go:135] retrieving image: registry.k8s.io/coredns/coredns:v1.8.6
	I0814 17:43:21.958618    3966 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.24.1
	I0814 17:43:21.959745    3966 image.go:178] daemon lookup for registry.k8s.io/coredns/coredns:v1.8.6: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.8.6
	I0814 17:43:22.370497    3966 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.24.1
	I0814 17:43:22.377266    3966 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.24.1
	I0814 17:43:22.388165    3966 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/etcd:3.5.3-0
	I0814 17:43:22.395784    3966 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.24.1" needs transfer: "registry.k8s.io/kube-apiserver:v1.24.1" does not exist at hash "7c5896a75862a8bc252122185a929cec1393db2c525f6440137d4fbf46bbf6f9" in container runtime
	I0814 17:43:22.395820    3966 docker.go:337] Removing image: registry.k8s.io/kube-apiserver:v1.24.1
	I0814 17:43:22.395884    3966 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-apiserver:v1.24.1
	I0814 17:43:22.403113    3966 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.24.1" needs transfer: "registry.k8s.io/kube-proxy:v1.24.1" does not exist at hash "fcbd620bbac080b658602c597709b377cb2b3fec134a097a27f94cba9b2ed2fa" in container runtime
	I0814 17:43:22.403145    3966 docker.go:337] Removing image: registry.k8s.io/kube-proxy:v1.24.1
	I0814 17:43:22.403200    3966 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-proxy:v1.24.1
	I0814 17:43:22.406050    3966 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/pause:3.7
	I0814 17:43:22.411380    3966 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.24.1
	I0814 17:43:22.412646    3966 cache_images.go:116] "registry.k8s.io/etcd:3.5.3-0" needs transfer: "registry.k8s.io/etcd:3.5.3-0" does not exist at hash "a9a710bb96df080e6b9c720eb85dc5b832ff84abf77263548d74fedec6466a5a" in container runtime
	I0814 17:43:22.412669    3966 docker.go:337] Removing image: registry.k8s.io/etcd:3.5.3-0
	I0814 17:43:22.412702    3966 ssh_runner.go:195] Run: docker rmi registry.k8s.io/etcd:3.5.3-0
	I0814 17:43:22.430206    3966 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.1
	I0814 17:43:22.440041    3966 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.1
	I0814 17:43:22.442279    3966 cache_images.go:116] "registry.k8s.io/pause:3.7" needs transfer: "registry.k8s.io/pause:3.7" does not exist at hash "e5a475a0380575fb5df454b2e32bdec93e1ec0094d8a61e895b41567cb884550" in container runtime
	I0814 17:43:22.442313    3966 docker.go:337] Removing image: registry.k8s.io/pause:3.7
	I0814 17:43:22.442443    3966 ssh_runner.go:195] Run: docker rmi registry.k8s.io/pause:3.7
	I0814 17:43:22.444219    3966 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.24.1
	I0814 17:43:22.444774    3966 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.24.1" needs transfer: "registry.k8s.io/kube-scheduler:v1.24.1" does not exist at hash "000c19baf6bba51ff7ae5449f4c7a16d9190cef0263f58070dbf62cea9c4982f" in container runtime
	I0814 17:43:22.444823    3966 docker.go:337] Removing image: registry.k8s.io/kube-scheduler:v1.24.1
	I0814 17:43:22.444850    3966 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-scheduler:v1.24.1
	I0814 17:43:22.466135    3966 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.24.1" needs transfer: "registry.k8s.io/kube-controller-manager:v1.24.1" does not exist at hash "f61bbe9259d7caa580deb6c8e4bfd1780c7b5887efe3aa3adc7cc74f68a27c1b" in container runtime
	I0814 17:43:22.466160    3966 docker.go:337] Removing image: registry.k8s.io/kube-controller-manager:v1.24.1
	I0814 17:43:22.466209    3966 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-controller-manager:v1.24.1
	I0814 17:43:22.483110    3966 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0
	I0814 17:43:22.483219    3966 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/etcd_3.5.3-0
	I0814 17:43:22.483396    3966 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7
	I0814 17:43:22.483456    3966 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/pause_3.7
	I0814 17:43:22.484882    3966 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.24.1
	I0814 17:43:22.484921    3966 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.1
	I0814 17:43:22.486101    3966 ssh_runner.go:352] existence check for /var/lib/minikube/images/pause_3.7: stat -c "%s %y" /var/lib/minikube/images/pause_3.7: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/images/pause_3.7': No such file or directory
	I0814 17:43:22.486114    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7 --> /var/lib/minikube/images/pause_3.7 (268288 bytes)
	I0814 17:43:22.486361    3966 ssh_runner.go:352] existence check for /var/lib/minikube/images/etcd_3.5.3-0: stat -c "%s %y" /var/lib/minikube/images/etcd_3.5.3-0: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/images/etcd_3.5.3-0': No such file or directory
	I0814 17:43:22.486373    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0 --> /var/lib/minikube/images/etcd_3.5.3-0 (81117184 bytes)
	W0814 17:43:22.491077    3966 image.go:283] image registry.k8s.io/coredns/coredns:v1.8.6 arch mismatch: want arm64 got amd64. fixing
	I0814 17:43:22.491203    3966 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/coredns/coredns:v1.8.6
	I0814 17:43:22.496529    3966 docker.go:304] Loading image: /var/lib/minikube/images/pause_3.7
	I0814 17:43:22.496542    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/pause_3.7 | docker load"
	W0814 17:43:22.556132    3966 image.go:283] image gcr.io/k8s-minikube/storage-provisioner:v5 arch mismatch: want arm64 got amd64. fixing
	I0814 17:43:22.556242    3966 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:43:22.563386    3966 cache_images.go:321] Transferred and loaded /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7 from cache
	I0814 17:43:22.563397    3966 cache_images.go:116] "registry.k8s.io/coredns/coredns:v1.8.6" needs transfer: "registry.k8s.io/coredns/coredns:v1.8.6" does not exist at hash "6af7f860a8197bfa3fdb7dec2061aa33870253e87a1e91c492d55b8a4fd38d14" in container runtime
	I0814 17:43:22.563416    3966 docker.go:337] Removing image: registry.k8s.io/coredns/coredns:v1.8.6
	I0814 17:43:22.563470    3966 ssh_runner.go:195] Run: docker rmi registry.k8s.io/coredns/coredns:v1.8.6
	I0814 17:43:22.582442    3966 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "66749159455b3f08c8318fe0233122f54d0f5889f9c5fdfb73c3fd9d99895b51" in container runtime
	I0814 17:43:22.582477    3966 docker.go:337] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:43:22.582535    3966 ssh_runner.go:195] Run: docker rmi gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:43:22.614139    3966 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6
	I0814 17:43:22.614255    3966 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/coredns_v1.8.6
	I0814 17:43:22.627948    3966 ssh_runner.go:352] existence check for /var/lib/minikube/images/coredns_v1.8.6: stat -c "%s %y" /var/lib/minikube/images/coredns_v1.8.6: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/images/coredns_v1.8.6': No such file or directory
	I0814 17:43:22.627995    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6 --> /var/lib/minikube/images/coredns_v1.8.6 (12318720 bytes)
	I0814 17:43:22.724609    3966 docker.go:304] Loading image: /var/lib/minikube/images/coredns_v1.8.6
	I0814 17:43:22.724624    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/coredns_v1.8.6 | docker load"
	I0814 17:43:22.824717    3966 cache_images.go:321] Transferred and loaded /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6 from cache
	I0814 17:43:22.843931    3966 docker.go:304] Loading image: /var/lib/minikube/images/etcd_3.5.3-0
	I0814 17:43:22.843945    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/etcd_3.5.3-0 | docker load"
	I0814 17:43:22.974405    3966 cache_images.go:321] Transferred and loaded /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0 from cache
	I0814 17:43:22.974441    3966 cache_images.go:92] duration metric: took 1.035640667s to LoadCachedImages
	W0814 17:43:22.974485    3966 out.go:239] X Unable to load cached images: LoadCachedImages: stat /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.1: no such file or directory
	X Unable to load cached images: LoadCachedImages: stat /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.1: no such file or directory
	I0814 17:43:22.974492    3966 kubeadm.go:934] updating node { 10.0.2.15 8443 v1.24.1 docker true true} ...
	I0814 17:43:22.974549    3966 kubeadm.go:946] kubelet [Unit]
	Wants=docker.socket
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=running-upgrade-987000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=10.0.2.15
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.1 ClusterName:running-upgrade-987000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0814 17:43:22.974610    3966 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
	I0814 17:43:22.988250    3966 cni.go:84] Creating CNI manager for ""
	I0814 17:43:22.988261    3966 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:43:22.988268    3966 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0814 17:43:22.988277    3966 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:10.0.2.15 APIServerPort:8443 KubernetesVersion:v1.24.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:running-upgrade-987000 NodeName:running-upgrade-987000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "10.0.2.15"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:10.0.2.15 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/
etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0814 17:43:22.988344    3966 kubeadm.go:187] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 10.0.2.15
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/cri-dockerd.sock
	  name: "running-upgrade-987000"
	  kubeletExtraArgs:
	    node-ip: 10.0.2.15
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "10.0.2.15"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.1
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0814 17:43:22.988405    3966 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.1
	I0814 17:43:22.991202    3966 binaries.go:44] Found k8s binaries, skipping transfer
	I0814 17:43:22.991228    3966 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0814 17:43:22.994548    3966 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (380 bytes)
	I0814 17:43:22.999765    3966 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0814 17:43:23.004742    3966 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2096 bytes)
	I0814 17:43:23.010432    3966 ssh_runner.go:195] Run: grep 10.0.2.15	control-plane.minikube.internal$ /etc/hosts
	I0814 17:43:23.011815    3966 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:43:23.100205    3966 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0814 17:43:23.105743    3966 certs.go:68] Setting up /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000 for IP: 10.0.2.15
	I0814 17:43:23.105753    3966 certs.go:194] generating shared ca certs ...
	I0814 17:43:23.105761    3966 certs.go:226] acquiring lock for ca certs: {Name:mk9c8185fea6e56aae9b82059113ab288e9964dd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:43:23.105904    3966 certs.go:235] skipping valid "minikubeCA" ca cert: /Users/jenkins/minikube-integration/19443-949/.minikube/ca.key
	I0814 17:43:23.105947    3966 certs.go:235] skipping valid "proxyClientCA" ca cert: /Users/jenkins/minikube-integration/19443-949/.minikube/proxy-client-ca.key
	I0814 17:43:23.105952    3966 certs.go:256] generating profile certs ...
	I0814 17:43:23.106026    3966 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/client.key
	I0814 17:43:23.106043    3966 certs.go:363] generating signed profile cert for "minikube": /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/apiserver.key.da6ee18f
	I0814 17:43:23.106053    3966 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/apiserver.crt.da6ee18f with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 10.0.2.15]
	I0814 17:43:23.154642    3966 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/apiserver.crt.da6ee18f ...
	I0814 17:43:23.154653    3966 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/apiserver.crt.da6ee18f: {Name:mk6ea616718b57f3fae48014281a3095b9e7e01a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:43:23.154926    3966 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/apiserver.key.da6ee18f ...
	I0814 17:43:23.154931    3966 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/apiserver.key.da6ee18f: {Name:mk2d63e654768c252419d794a1e039db650efc47 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:43:23.155063    3966 certs.go:381] copying /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/apiserver.crt.da6ee18f -> /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/apiserver.crt
	I0814 17:43:23.155199    3966 certs.go:385] copying /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/apiserver.key.da6ee18f -> /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/apiserver.key
	I0814 17:43:23.155341    3966 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/proxy-client.key
	I0814 17:43:23.155469    3966 certs.go:484] found cert: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/1404.pem (1338 bytes)
	W0814 17:43:23.155491    3966 certs.go:480] ignoring /Users/jenkins/minikube-integration/19443-949/.minikube/certs/1404_empty.pem, impossibly tiny 0 bytes
	I0814 17:43:23.155495    3966 certs.go:484] found cert: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca-key.pem (1675 bytes)
	I0814 17:43:23.155514    3966 certs.go:484] found cert: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem (1078 bytes)
	I0814 17:43:23.155531    3966 certs.go:484] found cert: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem (1123 bytes)
	I0814 17:43:23.155554    3966 certs.go:484] found cert: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/key.pem (1679 bytes)
	I0814 17:43:23.155594    3966 certs.go:484] found cert: /Users/jenkins/minikube-integration/19443-949/.minikube/files/etc/ssl/certs/14042.pem (1708 bytes)
	I0814 17:43:23.155953    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0814 17:43:23.163457    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0814 17:43:23.170501    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0814 17:43:23.178238    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0814 17:43:23.185502    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
	I0814 17:43:23.192252    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0814 17:43:23.199447    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0814 17:43:23.206753    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0814 17:43:23.214311    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0814 17:43:23.221247    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/certs/1404.pem --> /usr/share/ca-certificates/1404.pem (1338 bytes)
	I0814 17:43:23.228279    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/files/etc/ssl/certs/14042.pem --> /usr/share/ca-certificates/14042.pem (1708 bytes)
	I0814 17:43:23.235283    3966 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0814 17:43:23.240413    3966 ssh_runner.go:195] Run: openssl version
	I0814 17:43:23.242259    3966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14042.pem && ln -fs /usr/share/ca-certificates/14042.pem /etc/ssl/certs/14042.pem"
	I0814 17:43:23.245083    3966 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14042.pem
	I0814 17:43:23.246831    3966 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 15 00:12 /usr/share/ca-certificates/14042.pem
	I0814 17:43:23.246858    3966 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14042.pem
	I0814 17:43:23.248843    3966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14042.pem /etc/ssl/certs/3ec20f2e.0"
	I0814 17:43:23.251606    3966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0814 17:43:23.254954    3966 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0814 17:43:23.256419    3966 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 15 00:05 /usr/share/ca-certificates/minikubeCA.pem
	I0814 17:43:23.256438    3966 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0814 17:43:23.258316    3966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0814 17:43:23.261048    3966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1404.pem && ln -fs /usr/share/ca-certificates/1404.pem /etc/ssl/certs/1404.pem"
	I0814 17:43:23.264013    3966 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1404.pem
	I0814 17:43:23.265754    3966 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 15 00:12 /usr/share/ca-certificates/1404.pem
	I0814 17:43:23.265773    3966 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1404.pem
	I0814 17:43:23.267447    3966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1404.pem /etc/ssl/certs/51391683.0"
	I0814 17:43:23.270598    3966 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0814 17:43:23.272151    3966 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0814 17:43:23.274004    3966 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0814 17:43:23.275793    3966 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0814 17:43:23.277764    3966 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0814 17:43:23.280449    3966 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0814 17:43:23.282936    3966 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0814 17:43:23.285088    3966 kubeadm.go:392] StartCluster: {Name:running-upgrade-987000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:50332 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:ru
nning-upgrade-987000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disab
leOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s}
	I0814 17:43:23.285163    3966 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I0814 17:43:23.298125    3966 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0814 17:43:23.301697    3966 kubeadm.go:408] found existing configuration files, will attempt cluster restart
	I0814 17:43:23.301706    3966 kubeadm.go:593] restartPrimaryControlPlane start ...
	I0814 17:43:23.301738    3966 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0814 17:43:23.306387    3966 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0814 17:43:23.306690    3966 kubeconfig.go:47] verify endpoint returned: get endpoint: "running-upgrade-987000" does not appear in /Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:43:23.306790    3966 kubeconfig.go:62] /Users/jenkins/minikube-integration/19443-949/kubeconfig needs updating (will repair): [kubeconfig missing "running-upgrade-987000" cluster setting kubeconfig missing "running-upgrade-987000" context setting]
	I0814 17:43:23.306976    3966 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/kubeconfig: {Name:mke777513f7f5736c6804680b89db76bd98a8ac2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:43:23.307450    3966 kapi.go:59] client config for running-upgrade-987000: &rest.Config{Host:"https://10.0.2.15:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/client.key", CAFile:"/Users/jenkins/minikube-integration/19443-949/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8
(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x103eb0f90), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0814 17:43:23.307782    3966 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0814 17:43:23.311344    3966 kubeadm.go:640] detected kubeadm config drift (will reconfigure cluster from new /var/tmp/minikube/kubeadm.yaml):
	-- stdout --
	--- /var/tmp/minikube/kubeadm.yaml
	+++ /var/tmp/minikube/kubeadm.yaml.new
	@@ -11,7 +11,7 @@
	       - signing
	       - authentication
	 nodeRegistration:
	-  criSocket: /var/run/cri-dockerd.sock
	+  criSocket: unix:///var/run/cri-dockerd.sock
	   name: "running-upgrade-987000"
	   kubeletExtraArgs:
	     node-ip: 10.0.2.15
	@@ -49,7 +49,9 @@
	 authentication:
	   x509:
	     clientCAFile: /var/lib/minikube/certs/ca.crt
	-cgroupDriver: systemd
	+cgroupDriver: cgroupfs
	+hairpinMode: hairpin-veth
	+runtimeRequestTimeout: 15m
	 clusterDomain: "cluster.local"
	 # disable disk resource management by default
	 imageGCHighThresholdPercent: 100
	
	-- /stdout --
	I0814 17:43:23.311351    3966 kubeadm.go:1160] stopping kube-system containers ...
	I0814 17:43:23.311395    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I0814 17:43:23.329538    3966 docker.go:483] Stopping containers: [dd96d4eb3b67 9671e64239eb 1ab4864a2af9 29670631474a 55491ceb3162 9caa6cc21585 de3ef9e2b2d4 3fdb416cf0f2 5ad71bd0d968 cd8cd813fdd5 6e0da723e642 a751dc583108 af68cbe724cf 380e3572dce2 5cedaf3c3e7d 915af3c05d85 ad789586937d 8820d0cfb35a fae89c628969 d3b7f45f9c5a 01f8fc3ed27f 5fd5c2e62fb4 92e378181829]
	I0814 17:43:23.329615    3966 ssh_runner.go:195] Run: docker stop dd96d4eb3b67 9671e64239eb 1ab4864a2af9 29670631474a 55491ceb3162 9caa6cc21585 de3ef9e2b2d4 3fdb416cf0f2 5ad71bd0d968 cd8cd813fdd5 6e0da723e642 a751dc583108 af68cbe724cf 380e3572dce2 5cedaf3c3e7d 915af3c05d85 ad789586937d 8820d0cfb35a fae89c628969 d3b7f45f9c5a 01f8fc3ed27f 5fd5c2e62fb4 92e378181829
	I0814 17:43:23.342729    3966 ssh_runner.go:195] Run: sudo systemctl stop kubelet
	I0814 17:43:23.436233    3966 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0814 17:43:23.440000    3966 kubeadm.go:157] found existing configuration files:
	-rw------- 1 root root 5639 Aug 15 00:42 /etc/kubernetes/admin.conf
	-rw------- 1 root root 5653 Aug 15 00:42 /etc/kubernetes/controller-manager.conf
	-rw------- 1 root root 2027 Aug 15 00:42 /etc/kubernetes/kubelet.conf
	-rw------- 1 root root 5597 Aug 15 00:42 /etc/kubernetes/scheduler.conf
	
	I0814 17:43:23.440031    3966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/admin.conf
	I0814 17:43:23.443250    3966 kubeadm.go:163] "https://control-plane.minikube.internal:50332" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/admin.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0814 17:43:23.443274    3966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I0814 17:43:23.446578    3966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/kubelet.conf
	I0814 17:43:23.449458    3966 kubeadm.go:163] "https://control-plane.minikube.internal:50332" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/kubelet.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0814 17:43:23.449503    3966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I0814 17:43:23.452610    3966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/controller-manager.conf
	I0814 17:43:23.455817    3966 kubeadm.go:163] "https://control-plane.minikube.internal:50332" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/controller-manager.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0814 17:43:23.455847    3966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0814 17:43:23.458950    3966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/scheduler.conf
	I0814 17:43:23.461725    3966 kubeadm.go:163] "https://control-plane.minikube.internal:50332" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/scheduler.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0814 17:43:23.461750    3966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0814 17:43:23.464297    3966 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0814 17:43:23.467745    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
	I0814 17:43:23.510061    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
	I0814 17:43:24.064466    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
	I0814 17:43:24.277384    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
	I0814 17:43:24.306310    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
	I0814 17:43:24.333327    3966 api_server.go:52] waiting for apiserver process to appear ...
	I0814 17:43:24.333412    3966 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0814 17:43:24.833784    3966 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0814 17:43:25.335535    3966 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0814 17:43:25.835165    3966 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0814 17:43:26.335370    3966 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0814 17:43:26.835338    3966 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0814 17:43:26.840000    3966 api_server.go:72] duration metric: took 2.506786041s to wait for apiserver process to appear ...
	I0814 17:43:26.840008    3966 api_server.go:88] waiting for apiserver healthz status ...
	I0814 17:43:26.840022    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:31.841927    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:31.841968    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:36.842041    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:36.842068    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:41.842233    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:41.842313    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:46.842602    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:46.842654    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:51.843135    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:51.843181    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:56.843829    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:56.843887    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:01.844909    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:01.844957    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:06.845503    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:06.845579    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:11.847638    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:11.847743    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:16.849876    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:16.849956    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:21.852322    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:21.852361    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:26.854533    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:26.854970    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:44:26.888556    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:44:26.888686    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:44:26.907912    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:44:26.908007    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:44:26.922616    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:44:26.922698    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:44:26.935323    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:44:26.935396    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:44:26.946226    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:44:26.946299    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:44:26.956266    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:44:26.956351    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:44:26.966882    3966 logs.go:276] 0 containers: []
	W0814 17:44:26.966893    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:44:26.966953    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:44:26.977856    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:44:26.977873    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:44:26.977878    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:44:26.989806    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:44:26.989816    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:44:27.057891    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:44:27.057902    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:44:27.083472    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:44:27.083486    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:44:27.100392    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:44:27.100403    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:44:27.115652    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:44:27.115667    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:44:27.136763    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:44:27.136774    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:44:27.179529    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:44:27.179544    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:44:27.191039    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:44:27.191048    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:44:27.208205    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:44:27.208221    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:44:27.221253    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:44:27.221267    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:44:27.234941    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:44:27.234952    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:44:27.250498    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:44:27.250529    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:44:27.267535    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:44:27.267546    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:44:27.279010    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:44:27.279022    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:44:27.290806    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:44:27.290819    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:44:27.315922    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:44:27.315929    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:44:27.319918    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:44:27.319923    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:44:27.333021    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:44:27.333035    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:44:29.846118    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:34.847770    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:34.848206    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:44:34.904346    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:44:34.904432    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:44:34.924364    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:44:34.924449    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:44:34.947145    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:44:34.947212    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:44:34.957738    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:44:34.957796    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:44:34.969258    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:44:34.969329    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:44:34.980228    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:44:34.980297    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:44:34.990909    3966 logs.go:276] 0 containers: []
	W0814 17:44:34.990922    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:44:34.990993    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:44:35.001639    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:44:35.001659    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:44:35.001666    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:44:35.045149    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:44:35.045165    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:44:35.064144    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:44:35.064158    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:44:35.075682    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:44:35.075693    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:44:35.087034    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:44:35.087048    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:44:35.099507    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:44:35.099523    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:44:35.116743    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:44:35.116755    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:44:35.138298    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:44:35.138314    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:44:35.154260    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:44:35.154273    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:44:35.166082    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:44:35.166092    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:44:35.177345    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:44:35.177357    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:44:35.188772    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:44:35.188781    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:44:35.199815    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:44:35.199830    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:44:35.204130    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:44:35.204136    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:44:35.243672    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:44:35.243684    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:44:35.259561    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:44:35.259571    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:44:35.273029    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:44:35.273041    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:44:35.286003    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:44:35.286016    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:44:35.304019    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:44:35.304036    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:44:37.834782    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:42.836523    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:42.836706    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:44:42.855557    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:44:42.855654    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:44:42.869540    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:44:42.869614    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:44:42.882616    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:44:42.882682    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:44:42.893585    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:44:42.893651    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:44:42.904511    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:44:42.904578    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:44:42.915386    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:44:42.915459    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:44:42.927114    3966 logs.go:276] 0 containers: []
	W0814 17:44:42.927126    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:44:42.927184    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:44:42.941842    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:44:42.941858    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:44:42.941863    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:44:42.963709    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:44:42.963720    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:44:42.976981    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:44:42.976991    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:44:42.994069    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:44:42.994080    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:44:43.037985    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:44:43.037995    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:44:43.049559    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:44:43.049570    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:44:43.061119    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:44:43.061130    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:44:43.078285    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:44:43.078295    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:44:43.091293    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:44:43.091305    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:44:43.096393    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:44:43.096400    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:44:43.136975    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:44:43.136988    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:44:43.154890    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:44:43.154909    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:44:43.167078    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:44:43.167094    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:44:43.196039    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:44:43.196052    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:44:43.211695    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:44:43.211711    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:44:43.224151    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:44:43.224165    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:44:43.244626    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:44:43.244637    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:44:43.257054    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:44:43.257067    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:44:43.270456    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:44:43.270469    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:44:45.786893    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:50.789115    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:50.789402    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:44:50.816943    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:44:50.817069    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:44:50.834829    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:44:50.834908    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:44:50.849928    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:44:50.850005    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:44:50.865328    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:44:50.865400    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:44:50.875984    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:44:50.876049    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:44:50.890684    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:44:50.890756    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:44:50.900908    3966 logs.go:276] 0 containers: []
	W0814 17:44:50.900922    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:44:50.900975    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:44:50.911589    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:44:50.911606    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:44:50.911611    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:44:50.928530    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:44:50.928541    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:44:50.939854    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:44:50.939867    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:44:50.952616    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:44:50.952626    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:44:50.978022    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:44:50.978032    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:44:50.992558    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:44:50.992569    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:44:51.008753    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:44:51.008764    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:44:51.023626    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:44:51.023638    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:44:51.035335    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:44:51.035349    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:44:51.047262    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:44:51.047275    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:44:51.092039    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:44:51.092054    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:44:51.106820    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:44:51.106835    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:44:51.121136    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:44:51.121150    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:44:51.135947    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:44:51.135959    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:44:51.156941    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:44:51.156953    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:44:51.161736    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:44:51.161748    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:44:51.199220    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:44:51.199233    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:44:51.215548    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:44:51.215561    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:44:51.230363    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:44:51.230375    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:44:53.745547    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:58.747778    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:58.747947    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:44:58.760546    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:44:58.760624    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:44:58.771597    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:44:58.771672    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:44:58.782262    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:44:58.782336    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:44:58.793770    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:44:58.793848    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:44:58.804177    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:44:58.804243    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:44:58.814566    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:44:58.814633    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:44:58.828077    3966 logs.go:276] 0 containers: []
	W0814 17:44:58.828089    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:44:58.828142    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:44:58.838459    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:44:58.838482    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:44:58.838488    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:44:58.879791    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:44:58.879801    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:44:58.893774    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:44:58.893788    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:44:58.908485    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:44:58.908498    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:44:58.920441    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:44:58.920452    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:44:58.938320    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:44:58.938333    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:44:58.950955    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:44:58.950970    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:44:58.979163    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:44:58.979177    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:44:58.984360    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:44:58.984373    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:44:59.005608    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:44:59.005623    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:44:59.018313    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:44:59.018325    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:44:59.030156    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:44:59.030168    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:44:59.042377    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:44:59.042388    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:44:59.054452    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:44:59.054464    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:44:59.092776    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:44:59.092789    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:44:59.108081    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:44:59.108098    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:44:59.126288    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:44:59.126301    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:44:59.161523    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:44:59.161538    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:44:59.179782    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:44:59.179795    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:01.701868    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:06.702490    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:06.702642    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:06.714149    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:45:06.714230    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:06.725280    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:45:06.725352    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:06.735895    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:45:06.735971    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:06.746606    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:45:06.746677    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:06.757183    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:45:06.757247    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:06.770921    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:45:06.770998    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:06.781859    3966 logs.go:276] 0 containers: []
	W0814 17:45:06.781873    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:06.781932    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:06.792901    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:45:06.792919    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:45:06.792924    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:45:06.804326    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:45:06.804342    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:45:06.815324    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:45:06.815338    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:45:06.826910    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:45:06.826922    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:45:06.842346    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:45:06.842362    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:45:06.857146    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:45:06.857155    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:45:06.869860    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:45:06.869873    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:45:06.882267    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:45:06.882279    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:45:06.894782    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:06.894793    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:06.920699    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:45:06.920710    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:45:06.935730    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:45:06.935740    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:45:06.948268    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:45:06.948280    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:45:06.965180    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:45:06.965188    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:45:06.985756    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:45:06.985768    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:45:07.009673    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:07.009681    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:07.055685    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:07.055699    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:07.061034    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:07.061046    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:07.099530    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:45:07.099542    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:45:07.113538    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:45:07.113551    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:09.629063    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:14.631258    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:14.631403    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:14.643288    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:45:14.643369    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:14.654030    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:45:14.654104    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:14.665524    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:45:14.665602    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:14.676767    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:45:14.676839    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:14.687692    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:45:14.687760    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:14.698454    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:45:14.698530    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:14.708323    3966 logs.go:276] 0 containers: []
	W0814 17:45:14.708335    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:14.708394    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:14.718465    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:45:14.718480    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:45:14.718485    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:45:14.733064    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:45:14.733080    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:45:14.751826    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:14.751838    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:14.779173    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:45:14.779190    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:14.792508    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:14.792520    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:14.797293    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:45:14.797306    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:45:14.809646    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:45:14.809660    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:45:14.821615    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:45:14.821630    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:45:14.836604    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:45:14.836619    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:45:14.848982    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:45:14.848993    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:45:14.861221    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:45:14.861233    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:45:14.879717    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:45:14.879730    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:45:14.891768    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:45:14.891779    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:45:14.903267    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:14.903277    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:14.948162    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:45:14.948176    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:45:14.962216    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:45:14.962227    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:45:14.976901    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:45:14.976916    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:45:14.991565    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:45:14.991578    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:45:15.003846    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:15.003859    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:17.549790    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:22.552087    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:22.552334    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:22.582837    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:45:22.582955    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:22.601284    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:45:22.601369    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:22.615654    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:45:22.615733    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:22.627854    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:45:22.627920    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:22.643030    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:45:22.643100    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:22.654711    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:45:22.654780    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:22.665861    3966 logs.go:276] 0 containers: []
	W0814 17:45:22.665873    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:22.665931    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:22.681193    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:45:22.681208    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:45:22.681214    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:45:22.694400    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:45:22.694415    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:45:22.713443    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:45:22.713453    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:45:22.725883    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:45:22.725892    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:45:22.738267    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:22.738283    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:22.782923    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:22.782937    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:22.821491    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:45:22.821503    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:45:22.833375    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:45:22.833388    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:45:22.854861    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:45:22.854873    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:45:22.867213    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:45:22.867224    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:45:22.879358    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:22.879370    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:22.904712    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:45:22.904722    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:45:22.922063    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:45:22.922075    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:45:22.940459    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:45:22.940471    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:22.953466    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:22.953481    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:22.958497    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:45:22.958504    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:45:22.973379    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:45:22.973391    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:45:22.989333    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:45:22.989346    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:45:23.002128    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:45:23.002141    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:45:25.517521    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:30.519584    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:30.519732    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:30.531221    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:45:30.531300    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:30.544374    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:45:30.544443    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:30.554811    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:45:30.554910    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:30.565814    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:45:30.565884    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:30.577767    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:45:30.577840    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:30.592395    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:45:30.592474    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:30.603762    3966 logs.go:276] 0 containers: []
	W0814 17:45:30.603773    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:30.603835    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:30.620538    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:45:30.620556    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:45:30.620562    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:45:30.632832    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:45:30.632842    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:30.647161    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:45:30.647178    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:45:30.662580    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:45:30.662593    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:45:30.682207    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:45:30.682224    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:45:30.694828    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:45:30.694841    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:45:30.707933    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:45:30.707945    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:45:30.719884    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:45:30.719897    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:45:30.732104    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:45:30.732117    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:45:30.744887    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:45:30.744900    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:45:30.763138    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:30.763155    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:30.799611    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:45:30.799622    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:45:30.813942    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:45:30.813955    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:45:30.829588    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:45:30.829601    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:45:30.841676    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:45:30.841690    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:45:30.854550    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:45:30.854562    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:45:30.866631    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:30.866645    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:30.893758    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:30.893778    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:30.937687    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:30.937707    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:33.443576    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:38.445828    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:38.446087    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:38.473178    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:45:38.473280    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:38.489805    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:45:38.489884    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:38.503985    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:45:38.504066    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:38.520389    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:45:38.520462    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:38.531863    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:45:38.531932    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:38.543551    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:45:38.543626    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:38.558623    3966 logs.go:276] 0 containers: []
	W0814 17:45:38.558634    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:38.558694    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:38.570370    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:45:38.570386    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:45:38.570392    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:45:38.586148    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:45:38.586157    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:45:38.599707    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:45:38.599718    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:45:38.612131    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:45:38.612145    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:45:38.627626    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:38.627640    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:38.632773    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:38.632785    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:38.669972    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:45:38.669981    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:45:38.686254    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:45:38.686262    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:45:38.705640    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:45:38.705652    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:38.718907    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:45:38.718916    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:45:38.734198    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:45:38.734212    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:45:38.746674    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:45:38.746687    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:45:38.759852    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:45:38.759862    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:45:38.772634    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:45:38.772645    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:45:38.785430    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:38.785443    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:38.811724    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:38.811734    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:38.858053    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:45:38.858068    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:45:38.870122    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:45:38.870133    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:45:38.888431    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:45:38.888442    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:45:41.407127    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:46.409559    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:46.409926    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:46.448215    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:45:46.448267    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:46.465119    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:45:46.465199    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:46.479031    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:45:46.479102    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:46.494860    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:45:46.494922    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:46.506806    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:45:46.506864    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:46.522543    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:45:46.522613    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:46.533433    3966 logs.go:276] 0 containers: []
	W0814 17:45:46.533446    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:46.533501    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:46.545784    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:45:46.545802    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:45:46.545807    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:45:46.563214    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:45:46.563232    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:45:46.575291    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:45:46.575303    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:46.589453    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:45:46.589463    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:45:46.601369    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:45:46.601384    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:45:46.613998    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:45:46.614011    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:45:46.626021    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:45:46.626030    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:45:46.638066    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:45:46.638080    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:45:46.660308    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:45:46.660326    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:45:46.672732    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:46.672742    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:46.677837    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:46.677848    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:46.715111    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:45:46.715124    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:45:46.741202    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:45:46.741216    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:45:46.758480    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:45:46.758494    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:45:46.770836    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:46.770847    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:46.797851    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:46.797862    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:46.843598    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:45:46.843610    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:45:46.856128    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:45:46.856141    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:45:46.871019    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:45:46.871032    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:45:49.385179    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:54.387427    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:54.387714    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:54.423390    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:45:54.423480    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:54.441040    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:45:54.441128    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:54.455404    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:45:54.455481    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:54.467594    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:45:54.467668    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:54.479009    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:45:54.479075    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:54.490382    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:45:54.490453    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:54.501331    3966 logs.go:276] 0 containers: []
	W0814 17:45:54.501347    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:54.501403    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:54.513089    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:45:54.513100    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:54.513105    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:54.558025    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:45:54.558046    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:45:54.577251    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:54.577266    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:54.581882    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:45:54.581889    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:45:54.595578    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:45:54.595591    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:54.608470    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:45:54.608482    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:45:54.625845    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:45:54.625862    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:45:54.638771    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:45:54.638784    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:45:54.650761    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:45:54.650773    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:45:54.671712    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:45:54.671721    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:45:54.685228    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:54.685239    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:54.721480    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:45:54.721491    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:45:54.735872    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:45:54.735883    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:45:54.747614    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:45:54.747626    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:45:54.760046    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:54.760057    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:54.786745    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:45:54.786759    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:45:54.799411    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:45:54.799427    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:45:54.811582    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:45:54.811595    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:45:54.827370    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:45:54.827380    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:45:57.340879    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:02.342280    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:02.342602    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:02.371188    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:46:02.371300    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:02.389522    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:46:02.389602    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:02.407134    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:46:02.407184    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:02.419918    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:46:02.419956    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:02.431722    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:46:02.431757    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:02.448836    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:46:02.448913    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:02.460088    3966 logs.go:276] 0 containers: []
	W0814 17:46:02.460099    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:02.460167    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:02.471548    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:46:02.471564    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:46:02.471569    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:46:02.483373    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:46:02.483388    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:02.495847    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:46:02.495856    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:46:02.510376    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:46:02.510385    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:46:02.522738    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:46:02.522750    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:46:02.541338    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:46:02.541351    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:46:02.553516    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:02.553527    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:02.591087    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:46:02.591099    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:46:02.610008    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:46:02.610020    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:46:02.622846    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:02.622860    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:02.670718    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:46:02.670731    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:46:02.692614    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:46:02.692625    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:46:02.704842    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:46:02.704858    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:46:02.717148    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:46:02.717159    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:46:02.729237    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:02.729250    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:02.754422    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:02.754432    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:02.759079    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:46:02.759089    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:46:02.774161    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:46:02.774171    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:46:02.785684    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:46:02.785700    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:46:05.304949    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:10.305893    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:10.306031    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:10.325019    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:46:10.325062    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:10.338952    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:46:10.338994    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:10.350495    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:46:10.350533    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:10.362159    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:46:10.362195    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:10.374840    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:46:10.374898    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:10.386162    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:46:10.386236    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:10.396661    3966 logs.go:276] 0 containers: []
	W0814 17:46:10.396671    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:10.396730    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:10.410240    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:46:10.410257    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:10.410264    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:10.457648    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:46:10.457674    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:46:10.469842    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:46:10.469856    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:46:10.482970    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:46:10.482983    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:46:10.500774    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:46:10.500787    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:46:10.513906    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:46:10.513918    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:46:10.526261    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:46:10.526273    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:46:10.538437    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:46:10.538449    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:46:10.558539    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:10.558551    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:10.563037    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:10.563047    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:10.600417    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:46:10.600430    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:46:10.616074    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:46:10.616087    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:46:10.632036    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:46:10.632049    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:46:10.663250    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:46:10.663259    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:46:10.680972    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:46:10.680984    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:46:10.694244    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:46:10.694255    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:46:10.709949    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:46:10.709961    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:46:10.726618    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:10.726629    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:10.749660    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:46:10.749668    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:13.263941    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:18.266000    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:18.266073    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:18.278621    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:46:18.278686    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:18.290004    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:46:18.290072    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:18.301682    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:46:18.301750    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:18.313256    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:46:18.313324    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:18.324255    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:46:18.324327    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:18.335084    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:46:18.335152    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:18.346226    3966 logs.go:276] 0 containers: []
	W0814 17:46:18.346237    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:18.346301    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:18.358311    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:46:18.358327    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:46:18.358333    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:46:18.372559    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:46:18.372570    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:46:18.391197    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:46:18.391207    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:46:18.404905    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:46:18.404918    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:18.418547    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:18.418555    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:18.464601    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:46:18.464620    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:46:18.479875    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:46:18.479888    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:46:18.496013    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:46:18.496025    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:46:18.508666    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:46:18.508679    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:46:18.520843    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:46:18.520858    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:46:18.533901    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:46:18.533913    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:46:18.546800    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:18.546812    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:18.572621    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:18.572631    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:18.577550    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:46:18.577563    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:46:18.590117    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:46:18.590130    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:46:18.605831    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:46:18.605845    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:46:18.618455    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:46:18.618469    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:46:18.636689    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:18.636701    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:18.680496    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:46:18.680506    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:46:21.194332    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:26.196462    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:26.196543    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:26.208223    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:46:26.208295    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:26.219333    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:46:26.219404    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:26.238730    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:46:26.238802    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:26.250215    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:46:26.250287    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:26.262137    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:46:26.262213    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:26.273810    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:46:26.273882    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:26.285186    3966 logs.go:276] 0 containers: []
	W0814 17:46:26.285203    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:26.285267    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:26.296383    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:46:26.296399    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:26.296404    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:26.343271    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:46:26.343282    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:46:26.358351    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:46:26.358360    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:46:26.370569    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:46:26.370583    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:46:26.387416    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:46:26.387429    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:46:26.402012    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:46:26.402023    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:46:26.420232    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:46:26.420247    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:46:26.442907    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:26.442921    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:26.479304    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:46:26.479317    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:46:26.497532    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:46:26.497545    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:46:26.511514    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:26.511528    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:26.516773    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:46:26.516783    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:46:26.534152    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:46:26.534163    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:46:26.545554    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:46:26.545567    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:46:26.562473    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:46:26.562483    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:46:26.581879    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:46:26.581893    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:46:26.594705    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:46:26.594718    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:46:26.610985    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:26.610997    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:26.637573    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:46:26.637590    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:29.150970    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:34.151714    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:34.151808    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:34.169586    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:46:34.169661    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:34.180380    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:46:34.180458    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:34.195850    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:46:34.195931    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:34.207467    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:46:34.207540    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:34.219096    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:46:34.219170    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:34.230391    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:46:34.230461    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:34.241890    3966 logs.go:276] 0 containers: []
	W0814 17:46:34.241904    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:34.241967    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:34.254007    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:46:34.254023    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:34.254030    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:34.291420    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:46:34.291433    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:46:34.304734    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:46:34.304750    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:46:34.322444    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:46:34.322454    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:46:34.335338    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:46:34.335349    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:46:34.347864    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:46:34.347875    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:46:34.362737    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:46:34.362746    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:46:34.374798    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:46:34.374810    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:46:34.386330    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:46:34.386341    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:46:34.401624    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:46:34.401632    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:46:34.415228    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:46:34.415236    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:46:34.433929    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:34.433937    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:34.438525    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:46:34.438537    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:46:34.453596    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:46:34.453610    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:46:34.465892    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:34.465905    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:34.488644    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:46:34.488652    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:34.500441    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:34.500452    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:34.544401    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:46:34.544411    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:46:34.558978    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:46:34.558988    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:46:37.073784    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:42.076126    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:42.076200    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:42.087601    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:46:42.087638    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:42.100364    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:46:42.100438    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:42.123026    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:46:42.123099    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:42.134600    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:46:42.134670    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:42.146522    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:46:42.146594    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:42.158623    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:46:42.158696    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:42.171136    3966 logs.go:276] 0 containers: []
	W0814 17:46:42.171150    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:42.171213    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:42.190056    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:46:42.190074    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:46:42.190080    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:46:42.205246    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:46:42.205258    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:46:42.219425    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:46:42.219438    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:46:42.237976    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:46:42.237988    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:46:42.250774    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:46:42.250785    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:46:42.265369    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:46:42.265385    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:46:42.277846    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:46:42.277861    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:46:42.293297    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:46:42.293314    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:46:42.305616    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:46:42.305629    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:42.318699    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:42.318714    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:42.357871    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:46:42.357882    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:46:42.376586    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:46:42.376600    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:46:42.388963    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:42.388974    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:42.413190    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:46:42.413204    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:46:42.425921    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:46:42.425930    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:46:42.438082    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:42.438096    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:42.482990    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:42.483009    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:42.488141    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:46:42.488148    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:46:42.499168    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:46:42.499180    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:46:45.013107    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:50.015491    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:50.015576    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:50.028943    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:46:50.029018    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:50.040714    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:46:50.040783    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:50.052160    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:46:50.052234    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:50.063391    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:46:50.063465    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:50.074739    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:46:50.074817    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:50.086257    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:46:50.086339    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:50.097407    3966 logs.go:276] 0 containers: []
	W0814 17:46:50.097420    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:50.097482    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:50.109370    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:46:50.109386    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:46:50.109392    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:46:50.133958    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:46:50.133969    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:46:50.146047    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:50.146058    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:50.182798    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:46:50.182815    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:46:50.197615    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:46:50.197631    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:46:50.217170    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:46:50.217191    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:46:50.234635    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:46:50.234647    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:46:50.252265    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:46:50.252280    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:46:50.272296    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:46:50.272308    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:50.285415    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:50.285428    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:50.290308    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:46:50.290319    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:46:50.302640    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:50.302648    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:50.327614    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:46:50.327627    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:46:50.344025    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:46:50.344033    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:46:50.356276    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:46:50.356289    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:46:50.378212    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:46:50.378226    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:46:50.391414    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:50.391428    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:50.436659    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:46:50.436675    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:46:50.448216    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:46:50.448227    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:46:52.961384    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:57.963756    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:57.963967    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:57.982214    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:46:57.982302    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:57.996904    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:46:57.996976    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:58.008447    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:46:58.008526    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:58.020660    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:46:58.020699    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:58.032422    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:46:58.032494    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:58.043776    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:46:58.043852    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:58.055013    3966 logs.go:276] 0 containers: []
	W0814 17:46:58.055027    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:58.055087    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:58.073747    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:46:58.073763    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:58.073768    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:58.120655    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:58.120679    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:58.157992    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:46:58.158003    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:46:58.170859    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:46:58.170873    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:46:58.183909    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:46:58.183922    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:46:58.199149    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:46:58.199162    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:46:58.211213    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:46:58.211224    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:46:58.226978    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:46:58.226991    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:46:58.242389    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:46:58.242400    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:46:58.254339    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:46:58.254351    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:46:58.274728    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:46:58.274740    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:46:58.287662    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:46:58.287674    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:46:58.299604    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:58.299615    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:58.325224    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:58.325238    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:58.330069    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:46:58.330077    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:46:58.341536    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:46:58.341548    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:46:58.354053    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:46:58.354067    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:46:58.372283    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:46:58.372297    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:46:58.384156    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:46:58.384167    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:47:00.901001    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:05.903389    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:05.903603    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:47:05.929591    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:47:05.929685    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:47:05.946703    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:47:05.946781    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:47:05.960621    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:47:05.960701    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:47:05.972883    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:47:05.972984    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:47:05.985166    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:47:05.985241    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:47:05.998316    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:47:05.998397    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:47:06.009393    3966 logs.go:276] 0 containers: []
	W0814 17:47:06.009404    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:47:06.009468    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:47:06.020766    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:47:06.020793    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:47:06.020805    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:47:06.032766    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:47:06.032775    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:47:06.045209    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:47:06.045220    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:47:06.058147    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:47:06.058158    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:47:06.076137    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:47:06.076152    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:47:06.088857    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:47:06.088869    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:47:06.101519    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:47:06.101531    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:47:06.116196    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:47:06.116208    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:47:06.163361    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:47:06.163379    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:47:06.178474    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:47:06.178485    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:47:06.195091    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:47:06.195101    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:47:06.220785    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:47:06.220802    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:47:06.235427    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:47:06.235443    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:47:06.247811    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:47:06.247823    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:47:06.265574    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:47:06.265588    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:47:06.285882    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:47:06.285895    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:47:06.301761    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:47:06.301771    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:47:06.343669    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:47:06.343688    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:47:06.357533    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:47:06.357545    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:47:08.864132    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:13.866131    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:13.866312    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:47:13.883323    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:47:13.883401    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:47:13.897607    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:47:13.897686    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:47:13.909312    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:47:13.909383    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:47:13.921021    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:47:13.921094    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:47:13.931986    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:47:13.932060    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:47:13.943524    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:47:13.943599    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:47:13.956293    3966 logs.go:276] 0 containers: []
	W0814 17:47:13.956307    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:47:13.956364    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:47:13.967692    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:47:13.967709    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:47:13.967714    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:47:13.980373    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:47:13.980384    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:47:14.025602    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:47:14.025614    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:47:14.067712    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:47:14.067724    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:47:14.083036    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:47:14.083054    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:47:14.095886    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:47:14.095898    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:47:14.109768    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:47:14.109780    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:47:14.122593    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:47:14.122605    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:47:14.134659    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:47:14.134673    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:47:14.149913    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:47:14.149930    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:47:14.166349    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:47:14.166360    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:47:14.179111    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:47:14.179125    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:47:14.194392    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:47:14.194409    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:47:14.216646    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:47:14.216657    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:47:14.239466    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:47:14.239478    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:47:14.253087    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:47:14.253100    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:47:14.257425    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:47:14.257431    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:47:14.270054    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:47:14.270066    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:47:14.292645    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:47:14.292660    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:47:16.808466    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:21.808887    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:21.809127    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:47:21.826989    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:47:21.827073    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:47:21.841701    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:47:21.841773    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:47:21.858427    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:47:21.858508    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:47:21.869975    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:47:21.870051    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:47:21.881032    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:47:21.881113    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:47:21.891868    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:47:21.891940    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:47:21.902443    3966 logs.go:276] 0 containers: []
	W0814 17:47:21.902454    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:47:21.902511    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:47:21.913208    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:47:21.913225    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:47:21.913231    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:47:21.953772    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:47:21.953787    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:47:21.969123    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:47:21.969137    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:47:21.981366    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:47:21.981379    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:47:21.994038    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:47:21.994052    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:47:22.018313    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:47:22.018330    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:47:22.065721    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:47:22.065742    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:47:22.083774    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:47:22.083789    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:47:22.096509    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:47:22.096522    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:47:22.109346    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:47:22.109359    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:47:22.124879    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:47:22.124892    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:47:22.140395    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:47:22.140409    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:47:22.156666    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:47:22.156681    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:47:22.169504    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:47:22.169519    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:47:22.182212    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:47:22.182224    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:47:22.195281    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:47:22.195294    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:47:22.214024    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:47:22.214038    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:47:22.218653    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:47:22.218665    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:47:22.231537    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:47:22.231548    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:47:24.746726    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:29.748835    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:29.748872    3966 kubeadm.go:597] duration metric: took 4m6.454122958s to restartPrimaryControlPlane
	W0814 17:47:29.748906    3966 out.go:239] ! Unable to restart control-plane node(s), will reset cluster: <no value>
	! Unable to restart control-plane node(s), will reset cluster: <no value>
	I0814 17:47:29.748923    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force"
	I0814 17:47:30.804622    3966 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force": (1.05571675s)
	I0814 17:47:30.804701    3966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0814 17:47:30.809713    3966 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0814 17:47:30.812383    3966 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0814 17:47:30.815103    3966 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0814 17:47:30.815110    3966 kubeadm.go:157] found existing configuration files:
	
	I0814 17:47:30.815129    3966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/admin.conf
	I0814 17:47:30.817537    3966 kubeadm.go:163] "https://control-plane.minikube.internal:50332" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I0814 17:47:30.817562    3966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I0814 17:47:30.820100    3966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/kubelet.conf
	I0814 17:47:30.823222    3966 kubeadm.go:163] "https://control-plane.minikube.internal:50332" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I0814 17:47:30.823246    3966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I0814 17:47:30.825997    3966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/controller-manager.conf
	I0814 17:47:30.828322    3966 kubeadm.go:163] "https://control-plane.minikube.internal:50332" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I0814 17:47:30.828340    3966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0814 17:47:30.831263    3966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/scheduler.conf
	I0814 17:47:30.833897    3966 kubeadm.go:163] "https://control-plane.minikube.internal:50332" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I0814 17:47:30.833918    3966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0814 17:47:30.836315    3966 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
	I0814 17:47:30.853704    3966 kubeadm.go:310] [init] Using Kubernetes version: v1.24.1
	I0814 17:47:30.853768    3966 kubeadm.go:310] [preflight] Running pre-flight checks
	I0814 17:47:30.912413    3966 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0814 17:47:30.912470    3966 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0814 17:47:30.912519    3966 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0814 17:47:30.962104    3966 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0814 17:47:30.966232    3966 out.go:204]   - Generating certificates and keys ...
	I0814 17:47:30.966272    3966 kubeadm.go:310] [certs] Using existing ca certificate authority
	I0814 17:47:30.966307    3966 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
	I0814 17:47:30.966350    3966 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
	I0814 17:47:30.966382    3966 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
	I0814 17:47:30.966413    3966 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
	I0814 17:47:30.966444    3966 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
	I0814 17:47:30.966477    3966 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
	I0814 17:47:30.966548    3966 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
	I0814 17:47:30.966585    3966 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
	I0814 17:47:30.966618    3966 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
	I0814 17:47:30.966637    3966 kubeadm.go:310] [certs] Using the existing "sa" key
	I0814 17:47:30.966685    3966 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0814 17:47:31.064603    3966 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0814 17:47:31.262263    3966 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0814 17:47:31.309384    3966 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0814 17:47:31.356121    3966 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0814 17:47:31.386591    3966 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0814 17:47:31.386798    3966 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0814 17:47:31.386894    3966 kubeadm.go:310] [kubelet-start] Starting the kubelet
	I0814 17:47:31.479692    3966 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0814 17:47:31.486837    3966 out.go:204]   - Booting up control plane ...
	I0814 17:47:31.486888    3966 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0814 17:47:31.486939    3966 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0814 17:47:31.486974    3966 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0814 17:47:31.487014    3966 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0814 17:47:31.487085    3966 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I0814 17:47:35.989710    3966 kubeadm.go:310] [apiclient] All control plane components are healthy after 4.502377 seconds
	I0814 17:47:35.989788    3966 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0814 17:47:35.993989    3966 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0814 17:47:36.503474    3966 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
	I0814 17:47:36.503584    3966 kubeadm.go:310] [mark-control-plane] Marking the node running-upgrade-987000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0814 17:47:37.007806    3966 kubeadm.go:310] [bootstrap-token] Using token: kv1hgy.cybwvwwdsbzloxiy
	I0814 17:47:37.012388    3966 out.go:204]   - Configuring RBAC rules ...
	I0814 17:47:37.012449    3966 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0814 17:47:37.014313    3966 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0814 17:47:37.019982    3966 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0814 17:47:37.020922    3966 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0814 17:47:37.021719    3966 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0814 17:47:37.022624    3966 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0814 17:47:37.026750    3966 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0814 17:47:37.217861    3966 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
	I0814 17:47:37.416733    3966 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
	I0814 17:47:37.416750    3966 kubeadm.go:310] 
	I0814 17:47:37.416784    3966 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
	I0814 17:47:37.416787    3966 kubeadm.go:310] 
	I0814 17:47:37.416824    3966 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
	I0814 17:47:37.416828    3966 kubeadm.go:310] 
	I0814 17:47:37.416840    3966 kubeadm.go:310]   mkdir -p $HOME/.kube
	I0814 17:47:37.416869    3966 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0814 17:47:37.416898    3966 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0814 17:47:37.416901    3966 kubeadm.go:310] 
	I0814 17:47:37.416926    3966 kubeadm.go:310] Alternatively, if you are the root user, you can run:
	I0814 17:47:37.416928    3966 kubeadm.go:310] 
	I0814 17:47:37.416953    3966 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0814 17:47:37.416958    3966 kubeadm.go:310] 
	I0814 17:47:37.416983    3966 kubeadm.go:310] You should now deploy a pod network to the cluster.
	I0814 17:47:37.417020    3966 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0814 17:47:37.417080    3966 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0814 17:47:37.417087    3966 kubeadm.go:310] 
	I0814 17:47:37.417129    3966 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
	I0814 17:47:37.417177    3966 kubeadm.go:310] and service account keys on each node and then running the following as root:
	I0814 17:47:37.417182    3966 kubeadm.go:310] 
	I0814 17:47:37.417230    3966 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token kv1hgy.cybwvwwdsbzloxiy \
	I0814 17:47:37.417286    3966 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:957dccc044ee8898881693e1bb8f325b1f0a5c6f5463b6f7c0e6b1456e2d6ac2 \
	I0814 17:47:37.417300    3966 kubeadm.go:310] 	--control-plane 
	I0814 17:47:37.417304    3966 kubeadm.go:310] 
	I0814 17:47:37.417350    3966 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
	I0814 17:47:37.417353    3966 kubeadm.go:310] 
	I0814 17:47:37.417398    3966 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token kv1hgy.cybwvwwdsbzloxiy \
	I0814 17:47:37.417452    3966 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:957dccc044ee8898881693e1bb8f325b1f0a5c6f5463b6f7c0e6b1456e2d6ac2 
	I0814 17:47:37.417505    3966 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0814 17:47:37.417513    3966 cni.go:84] Creating CNI manager for ""
	I0814 17:47:37.417521    3966 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:47:37.421308    3966 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
	I0814 17:47:37.427361    3966 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
	I0814 17:47:37.430700    3966 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)
	I0814 17:47:37.435515    3966 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0814 17:47:37.435585    3966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0814 17:47:37.435587    3966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes running-upgrade-987000 minikube.k8s.io/updated_at=2024_08_14T17_47_37_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=a560a51f794134545edbbeb49e1ab4a0b1355168 minikube.k8s.io/name=running-upgrade-987000 minikube.k8s.io/primary=true
	I0814 17:47:37.480256    3966 ops.go:34] apiserver oom_adj: -16
	I0814 17:47:37.480271    3966 kubeadm.go:1113] duration metric: took 44.725375ms to wait for elevateKubeSystemPrivileges
	I0814 17:47:37.480281    3966 kubeadm.go:394] duration metric: took 4m14.202365291s to StartCluster
	I0814 17:47:37.480290    3966 settings.go:142] acquiring lock: {Name:mkcf010cb030fc0976e1870794cf1a021579ed31 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:47:37.480365    3966 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:47:37.480759    3966 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/kubeconfig: {Name:mke777513f7f5736c6804680b89db76bd98a8ac2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:47:37.480972    3966 start.go:235] Will wait 6m0s for node &{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:47:37.481003    3966 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I0814 17:47:37.481045    3966 addons.go:69] Setting storage-provisioner=true in profile "running-upgrade-987000"
	I0814 17:47:37.481059    3966 addons.go:234] Setting addon storage-provisioner=true in "running-upgrade-987000"
	I0814 17:47:37.481061    3966 config.go:182] Loaded profile config "running-upgrade-987000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I0814 17:47:37.481064    3966 addons.go:69] Setting default-storageclass=true in profile "running-upgrade-987000"
	I0814 17:47:37.481072    3966 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "running-upgrade-987000"
	W0814 17:47:37.481062    3966 addons.go:243] addon storage-provisioner should already be in state true
	I0814 17:47:37.481095    3966 host.go:66] Checking if "running-upgrade-987000" exists ...
	I0814 17:47:37.482061    3966 kapi.go:59] client config for running-upgrade-987000: &rest.Config{Host:"https://10.0.2.15:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/client.key", CAFile:"/Users/jenkins/minikube-integration/19443-949/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8
(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x103eb0f90), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0814 17:47:37.482182    3966 addons.go:234] Setting addon default-storageclass=true in "running-upgrade-987000"
	W0814 17:47:37.482186    3966 addons.go:243] addon default-storageclass should already be in state true
	I0814 17:47:37.482194    3966 host.go:66] Checking if "running-upgrade-987000" exists ...
	I0814 17:47:37.484383    3966 out.go:177] * Verifying Kubernetes components...
	I0814 17:47:37.484694    3966 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
	I0814 17:47:37.488480    3966 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0814 17:47:37.488487    3966 sshutil.go:53] new ssh client: &{IP:localhost Port:50265 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/running-upgrade-987000/id_rsa Username:docker}
	I0814 17:47:37.492272    3966 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:47:37.496180    3966 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:47:37.500317    3966 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0814 17:47:37.500323    3966 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0814 17:47:37.500329    3966 sshutil.go:53] new ssh client: &{IP:localhost Port:50265 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/running-upgrade-987000/id_rsa Username:docker}
	I0814 17:47:37.590341    3966 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0814 17:47:37.595326    3966 api_server.go:52] waiting for apiserver process to appear ...
	I0814 17:47:37.595369    3966 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0814 17:47:37.599796    3966 api_server.go:72] duration metric: took 118.816083ms to wait for apiserver process to appear ...
	I0814 17:47:37.599805    3966 api_server.go:88] waiting for apiserver healthz status ...
	I0814 17:47:37.599811    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:37.605080    3966 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0814 17:47:37.659728    3966 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0814 17:47:37.972097    3966 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
	I0814 17:47:37.972109    3966 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
	I0814 17:47:42.601775    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:42.601898    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:47.602207    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:47.602238    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:52.602481    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:52.602502    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:57.602813    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:57.602837    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:02.603639    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:02.603676    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:07.604382    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:07.604406    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	W0814 17:48:07.973289    3966 out.go:239] ! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error listing StorageClasses: Get "https://10.0.2.15:8443/apis/storage.k8s.io/v1/storageclasses": dial tcp 10.0.2.15:8443: i/o timeout]
	! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error listing StorageClasses: Get "https://10.0.2.15:8443/apis/storage.k8s.io/v1/storageclasses": dial tcp 10.0.2.15:8443: i/o timeout]
	I0814 17:48:07.977461    3966 out.go:177] * Enabled addons: storage-provisioner
	I0814 17:48:07.991457    3966 addons.go:510] duration metric: took 30.511279375s for enable addons: enabled=[storage-provisioner]
	I0814 17:48:12.605338    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:12.605361    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:17.606581    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:17.606628    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:22.608206    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:22.608253    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:27.610302    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:27.610325    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:32.612338    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:32.612360    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:37.614434    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:37.614576    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:48:37.625546    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:48:37.625612    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:48:37.636003    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:48:37.636069    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:48:37.645956    3966 logs.go:276] 2 containers: [e503088d4f61 f805e836332e]
	I0814 17:48:37.646035    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:48:37.660016    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:48:37.660086    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:48:37.671051    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:48:37.671121    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:48:37.681944    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:48:37.682012    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:48:37.691879    3966 logs.go:276] 0 containers: []
	W0814 17:48:37.691889    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:48:37.691945    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:48:37.701930    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:48:37.701946    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:48:37.701951    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:48:37.716765    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:48:37.716780    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:48:37.728375    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:48:37.728385    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:48:37.751660    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:48:37.751672    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:48:37.786489    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:48:37.786500    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:48:37.800019    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:48:37.800029    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:48:37.811485    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:48:37.811498    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:48:37.823192    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:48:37.823205    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:48:37.842007    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:48:37.842017    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:48:37.853648    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:48:37.853660    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:48:37.889342    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:48:37.889351    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:48:37.893548    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:48:37.893555    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:48:37.908322    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:48:37.908333    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:48:40.427821    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:45.430001    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:45.430097    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:48:45.441860    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:48:45.441931    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:48:45.452986    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:48:45.453049    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:48:45.463646    3966 logs.go:276] 2 containers: [e503088d4f61 f805e836332e]
	I0814 17:48:45.463718    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:48:45.474275    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:48:45.474342    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:48:45.484685    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:48:45.484755    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:48:45.495084    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:48:45.495147    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:48:45.506265    3966 logs.go:276] 0 containers: []
	W0814 17:48:45.506277    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:48:45.506331    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:48:45.517691    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:48:45.517709    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:48:45.517714    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:48:45.552390    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:48:45.552402    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:48:45.567021    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:48:45.567032    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:48:45.581055    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:48:45.581066    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:48:45.592709    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:48:45.592721    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:48:45.611233    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:48:45.611244    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:48:45.636032    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:48:45.636044    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:48:45.640982    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:48:45.640987    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:48:45.674591    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:48:45.674602    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:48:45.686343    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:48:45.686355    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:48:45.702477    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:48:45.702487    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:48:45.719367    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:48:45.719377    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:48:45.732059    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:48:45.732070    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:48:48.244385    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:53.244953    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:53.245107    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:48:53.256887    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:48:53.256956    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:48:53.267958    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:48:53.268024    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:48:53.279475    3966 logs.go:276] 2 containers: [e503088d4f61 f805e836332e]
	I0814 17:48:53.279540    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:48:53.293231    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:48:53.293297    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:48:53.306170    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:48:53.306241    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:48:53.317024    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:48:53.317092    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:48:53.337896    3966 logs.go:276] 0 containers: []
	W0814 17:48:53.337910    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:48:53.337969    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:48:53.348551    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:48:53.348565    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:48:53.348570    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:48:53.372754    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:48:53.372765    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:48:53.383703    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:48:53.383721    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:48:53.388175    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:48:53.388182    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:48:53.423209    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:48:53.423220    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:48:53.437731    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:48:53.437740    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:48:53.451382    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:48:53.451397    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:48:53.463361    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:48:53.463375    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:48:53.478011    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:48:53.478021    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:48:53.512637    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:48:53.512646    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:48:53.524423    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:48:53.524436    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:48:53.538831    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:48:53.538842    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:48:53.556682    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:48:53.556693    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:48:56.070312    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:01.072465    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:01.072569    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:01.084092    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:49:01.084161    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:01.100096    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:49:01.100168    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:01.113385    3966 logs.go:276] 2 containers: [e503088d4f61 f805e836332e]
	I0814 17:49:01.113457    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:01.124158    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:49:01.124231    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:01.138200    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:49:01.138293    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:01.150914    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:49:01.150988    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:01.161773    3966 logs.go:276] 0 containers: []
	W0814 17:49:01.161785    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:01.161841    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:01.172333    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:49:01.172347    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:49:01.172352    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:49:01.183926    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:49:01.183935    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:49:01.195421    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:49:01.195433    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:49:01.214905    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:49:01.214919    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:49:01.232286    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:01.232299    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:01.267085    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:49:01.267098    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:49:01.281517    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:49:01.281529    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:49:01.296087    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:49:01.296097    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:49:01.310045    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:49:01.310056    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:49:01.323661    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:01.323672    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:01.346860    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:49:01.346871    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:01.359902    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:01.359914    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:01.395758    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:01.395767    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:03.902427    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:08.904543    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:08.904638    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:08.915090    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:49:08.915159    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:08.926170    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:49:08.926235    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:08.937696    3966 logs.go:276] 2 containers: [e503088d4f61 f805e836332e]
	I0814 17:49:08.937767    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:08.949114    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:49:08.949187    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:08.959961    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:49:08.960031    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:08.978534    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:49:08.978606    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:08.989220    3966 logs.go:276] 0 containers: []
	W0814 17:49:08.989231    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:08.989291    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:08.999960    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:49:08.999975    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:49:08.999980    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:49:09.014860    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:49:09.014869    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:49:09.026944    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:49:09.026954    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:49:09.044431    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:09.044442    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:09.069426    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:09.069434    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:09.074062    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:49:09.074070    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:49:09.088273    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:49:09.088284    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:49:09.104964    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:49:09.104974    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:49:09.116194    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:49:09.116204    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:49:09.128032    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:49:09.128044    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:49:09.147824    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:49:09.147835    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:09.159668    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:09.159677    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:09.196594    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:09.196605    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:11.737418    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:16.739639    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:16.739733    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:16.753651    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:49:16.753724    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:16.767634    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:49:16.767705    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:16.779544    3966 logs.go:276] 2 containers: [e503088d4f61 f805e836332e]
	I0814 17:49:16.779611    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:16.790762    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:49:16.790832    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:16.801946    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:49:16.802015    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:16.812852    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:49:16.812921    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:16.822965    3966 logs.go:276] 0 containers: []
	W0814 17:49:16.822975    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:16.823031    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:16.837432    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:49:16.837447    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:49:16.837452    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:49:16.849578    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:16.849592    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:16.854142    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:16.854151    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:16.888537    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:49:16.888547    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:49:16.902769    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:49:16.902782    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:49:16.914902    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:49:16.914917    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:49:16.926417    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:49:16.926426    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:49:16.945709    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:16.945723    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:16.981584    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:49:16.981592    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:49:16.995592    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:49:16.995606    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:49:17.013174    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:49:17.013189    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:49:17.028790    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:17.028805    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:17.054012    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:49:17.054020    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:19.567319    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:24.569425    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:24.569508    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:24.580742    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:49:24.580813    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:24.592262    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:49:24.592336    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:24.604158    3966 logs.go:276] 2 containers: [e503088d4f61 f805e836332e]
	I0814 17:49:24.604248    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:24.615944    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:49:24.616015    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:24.627817    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:49:24.627889    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:24.639471    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:49:24.639543    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:24.651003    3966 logs.go:276] 0 containers: []
	W0814 17:49:24.651015    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:24.651078    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:24.667717    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:49:24.667731    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:49:24.667738    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:49:24.680692    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:49:24.680704    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:49:24.699774    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:49:24.699788    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:49:24.716922    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:24.716936    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:24.753110    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:24.753120    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:24.757489    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:24.757495    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:24.807787    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:49:24.807802    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:49:24.826637    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:49:24.826646    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:49:24.840442    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:49:24.840454    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:49:24.858340    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:24.858353    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:24.883090    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:49:24.883098    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:24.894436    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:49:24.894445    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:49:24.911060    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:49:24.911070    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:49:27.427659    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:32.429379    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:32.429475    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:32.441382    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:49:32.441455    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:32.457983    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:49:32.458058    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:32.472839    3966 logs.go:276] 2 containers: [e503088d4f61 f805e836332e]
	I0814 17:49:32.472914    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:32.484255    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:49:32.484326    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:32.495614    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:49:32.495681    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:32.506732    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:49:32.506807    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:32.518274    3966 logs.go:276] 0 containers: []
	W0814 17:49:32.518286    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:32.518345    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:32.528726    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:49:32.528740    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:32.528745    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:32.533384    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:32.533396    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:32.569037    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:49:32.569050    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:49:32.583339    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:49:32.583348    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:49:32.594714    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:49:32.594727    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:32.610824    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:32.610834    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:32.645309    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:49:32.645318    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:49:32.657638    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:49:32.657648    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:49:32.668671    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:49:32.668682    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:49:32.683291    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:49:32.683302    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:49:32.694434    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:49:32.694442    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:49:32.711743    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:32.711753    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:32.734850    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:49:32.734857    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:49:35.251889    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:40.253935    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:40.254022    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:40.265820    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:49:40.265897    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:40.277070    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:49:40.277149    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:40.289036    3966 logs.go:276] 2 containers: [e503088d4f61 f805e836332e]
	I0814 17:49:40.289107    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:40.301585    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:49:40.301655    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:40.312296    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:49:40.312371    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:40.324388    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:49:40.324465    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:40.334753    3966 logs.go:276] 0 containers: []
	W0814 17:49:40.334766    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:40.334826    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:40.345414    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:49:40.345430    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:49:40.345435    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:40.357453    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:49:40.357467    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:49:40.371908    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:49:40.371916    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:49:40.385726    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:49:40.385741    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:49:40.396996    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:49:40.397005    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:49:40.411732    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:49:40.411742    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:49:40.428530    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:49:40.428544    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:49:40.440528    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:40.440539    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:40.463971    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:40.463981    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:40.498338    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:40.498354    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:40.503585    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:40.503593    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:40.538161    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:49:40.538176    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:49:40.550298    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:49:40.550308    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:49:43.064273    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:48.066403    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": dial tcp 10.0.2.15:8443: i/o timeout (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:48.066487    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:48.077668    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:49:48.077741    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:48.088779    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:49:48.088852    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:48.100301    3966 logs.go:276] 2 containers: [e503088d4f61 f805e836332e]
	I0814 17:49:48.100367    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:48.112080    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:49:48.112153    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:48.123868    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:49:48.123947    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:48.136698    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:49:48.136766    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:48.148610    3966 logs.go:276] 0 containers: []
	W0814 17:49:48.148622    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:48.148686    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:48.164064    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:49:48.164080    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:49:48.164084    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:49:48.175737    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:49:48.175749    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:48.190969    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:48.190981    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:48.227938    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:48.227952    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:48.232679    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:48.232686    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:48.268734    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:49:48.268745    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:49:48.282732    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:49:48.282745    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:49:48.294584    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:48.294595    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:48.317963    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:49:48.317971    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:49:48.338126    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:49:48.338165    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:49:48.350033    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:49:48.350047    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:49:48.365731    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:49:48.365742    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:49:48.388389    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:49:48.388400    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:49:50.907774    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:55.910093    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:55.910182    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:55.921853    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:49:55.921926    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:55.932624    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:49:55.932696    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:55.943689    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:49:55.943764    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:55.954840    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:49:55.954908    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:55.965981    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:49:55.966058    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:55.977763    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:49:55.977840    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:55.995719    3966 logs.go:276] 0 containers: []
	W0814 17:49:55.995733    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:55.995797    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:56.007212    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:49:56.007230    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:49:56.007236    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:49:56.022649    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:49:56.022662    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:49:56.039302    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:56.039313    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:56.064814    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:49:56.064829    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:56.077216    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:56.077228    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:56.081584    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:49:56.081590    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:49:56.096527    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:49:56.096537    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:49:56.108220    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:56.108231    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:56.152291    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:49:56.152306    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:49:56.166245    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:49:56.166256    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:49:56.177924    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:49:56.177934    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:49:56.189436    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:49:56.189447    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:49:56.201606    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:49:56.201621    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:49:56.217988    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:56.218000    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:56.253951    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:49:56.253961    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:49:58.768497    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:03.769010    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:03.769094    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:03.781024    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:50:03.781105    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:03.792945    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:50:03.793016    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:03.804899    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:50:03.804979    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:03.816220    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:50:03.816291    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:03.827757    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:50:03.827828    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:03.839197    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:50:03.839266    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:03.851032    3966 logs.go:276] 0 containers: []
	W0814 17:50:03.851045    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:03.851108    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:03.867209    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:50:03.867230    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:50:03.867234    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:50:03.883121    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:03.883130    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:03.908890    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:03.908907    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:03.913844    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:50:03.913856    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:50:03.926830    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:50:03.926841    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:50:03.946047    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:50:03.946058    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:50:03.957728    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:50:03.957739    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:03.969284    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:03.969295    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:04.003891    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:04.003899    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:04.079950    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:50:04.079964    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:50:04.095092    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:50:04.095103    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:50:04.107367    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:50:04.107379    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:50:04.129777    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:50:04.129793    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:50:04.155481    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:50:04.155493    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:50:04.166502    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:50:04.166511    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:50:06.679930    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:11.681190    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:11.681285    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:11.692735    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:50:11.692808    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:11.703666    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:50:11.703737    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:11.715844    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:50:11.715918    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:11.727839    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:50:11.727913    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:11.739008    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:50:11.739079    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:11.750128    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:50:11.750196    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:11.760613    3966 logs.go:276] 0 containers: []
	W0814 17:50:11.760624    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:11.760680    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:11.771888    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:50:11.771905    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:11.771911    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:11.777026    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:50:11.777035    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:50:11.789154    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:50:11.789165    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:50:11.802327    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:50:11.802336    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:50:11.815216    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:50:11.815227    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:11.827861    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:11.827876    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:11.863983    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:50:11.863991    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:50:11.878579    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:50:11.878593    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:50:11.890220    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:50:11.890232    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:50:11.902184    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:50:11.902198    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:50:11.914566    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:11.914575    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:11.950900    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:50:11.950912    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:50:11.966306    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:11.966320    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:11.991733    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:50:11.991742    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:50:12.005701    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:50:12.005715    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:50:14.529911    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:19.531965    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:19.532056    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:19.543767    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:50:19.543838    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:19.556753    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:50:19.556823    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:19.568829    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:50:19.568906    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:19.581906    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:50:19.581979    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:19.592834    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:50:19.592902    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:19.603899    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:50:19.603963    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:19.614838    3966 logs.go:276] 0 containers: []
	W0814 17:50:19.614850    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:19.614915    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:19.626882    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:50:19.626902    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:50:19.626907    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:19.639378    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:50:19.639389    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:50:19.655245    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:50:19.655258    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:50:19.667954    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:50:19.667968    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:50:19.680187    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:50:19.680199    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:50:19.691820    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:19.691830    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:19.716736    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:19.716744    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:19.752383    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:50:19.752394    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:50:19.764519    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:50:19.764534    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:50:19.776545    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:19.776560    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:19.781025    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:19.781032    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:19.816339    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:50:19.816351    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:50:19.830581    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:50:19.830589    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:50:19.842122    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:50:19.842138    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:50:19.859851    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:50:19.859862    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:50:22.376519    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:27.378043    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": dial tcp 10.0.2.15:8443: i/o timeout (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:27.378130    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:27.390157    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:50:27.390224    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:27.401593    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:50:27.401661    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:27.412699    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:50:27.412773    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:27.423742    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:50:27.423807    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:27.435272    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:50:27.435347    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:27.446545    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:50:27.446621    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:27.457264    3966 logs.go:276] 0 containers: []
	W0814 17:50:27.457277    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:27.457340    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:27.468640    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:50:27.468661    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:27.468668    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:27.513043    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:50:27.513052    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:50:27.527931    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:50:27.527942    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:50:27.545528    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:50:27.545541    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:50:27.557295    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:50:27.557310    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:50:27.571683    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:50:27.571697    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:50:27.584107    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:50:27.584117    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:50:27.601816    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:27.601829    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:27.625587    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:50:27.625595    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:27.637430    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:27.637440    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:27.671663    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:27.671671    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:27.676025    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:50:27.676031    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:50:27.687752    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:50:27.687762    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:50:27.699278    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:50:27.699287    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:50:27.718365    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:50:27.718375    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:50:30.231914    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:35.233936    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:35.234037    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:35.246159    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:50:35.246237    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:35.258304    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:50:35.258369    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:35.270315    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:50:35.270388    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:35.281961    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:50:35.282043    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:35.293078    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:50:35.293143    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:35.305227    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:50:35.305294    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:35.316258    3966 logs.go:276] 0 containers: []
	W0814 17:50:35.316269    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:35.316328    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:35.329537    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:50:35.329556    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:50:35.329562    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:50:35.348503    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:35.348519    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:35.374857    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:35.374873    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:35.418600    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:50:35.418609    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:50:35.433459    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:50:35.433467    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:50:35.448301    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:50:35.448308    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:50:35.461292    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:35.461303    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:35.495375    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:35.495384    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:35.499812    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:50:35.499819    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:50:35.514631    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:50:35.514642    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:50:35.529742    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:50:35.529755    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:50:35.541711    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:50:35.541724    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:50:35.554016    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:50:35.554027    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:50:35.568750    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:50:35.568760    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:50:35.579867    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:50:35.579878    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:38.093599    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:43.095614    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:43.095731    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:43.107174    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:50:43.107245    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:43.118631    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:50:43.118699    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:43.131025    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:50:43.131101    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:43.144401    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:50:43.144468    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:43.155241    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:50:43.155312    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:43.166602    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:50:43.166671    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:43.177404    3966 logs.go:276] 0 containers: []
	W0814 17:50:43.177411    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:43.177468    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:43.191625    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:50:43.191641    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:50:43.191646    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:50:43.204367    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:50:43.204376    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:50:43.217422    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:50:43.217429    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:50:43.230530    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:50:43.230544    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:43.244538    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:43.244551    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:43.249329    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:50:43.249337    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:50:43.261818    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:50:43.261826    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:50:43.274591    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:50:43.274603    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:50:43.287045    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:43.287056    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:43.325548    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:43.325563    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:43.356889    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:43.356903    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:43.391677    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:50:43.391692    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:50:43.411202    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:50:43.411214    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:50:43.425695    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:50:43.425706    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:50:43.440404    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:50:43.440415    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:50:45.960136    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:50.962213    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:50.962293    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:50.974039    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:50:50.974111    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:50.986074    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:50:50.986149    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:50.997388    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:50:50.997462    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:51.008666    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:50:51.008737    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:51.020218    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:50:51.020285    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:51.034018    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:50:51.034087    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:51.045354    3966 logs.go:276] 0 containers: []
	W0814 17:50:51.045365    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:51.045427    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:51.056696    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:50:51.056717    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:50:51.056723    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:50:51.069233    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:50:51.069244    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:50:51.081922    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:50:51.081934    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:50:51.098625    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:50:51.098640    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:51.111549    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:51.111562    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:51.151888    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:50:51.151900    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:50:51.164842    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:51.164858    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:51.191478    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:50:51.191492    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:50:51.206213    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:50:51.206229    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:50:51.224248    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:50:51.224260    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:50:51.236316    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:50:51.236332    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:50:51.250779    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:50:51.250790    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:50:51.263035    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:50:51.263047    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:50:51.275141    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:51.275153    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:51.312269    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:51.312284    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:53.818766    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:58.820598    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:58.820651    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:58.831926    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:50:58.831992    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:58.843060    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:50:58.843130    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:58.854898    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:50:58.854967    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:58.865856    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:50:58.865930    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:58.881078    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:50:58.881144    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:58.900658    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:50:58.900728    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:58.911046    3966 logs.go:276] 0 containers: []
	W0814 17:50:58.911059    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:58.911121    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:58.923066    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:50:58.923086    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:50:58.923091    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:50:58.936246    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:50:58.936260    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:50:58.952726    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:58.952737    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:58.990702    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:50:58.990726    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:50:59.004162    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:59.004175    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:59.008653    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:50:59.008664    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:50:59.032871    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:50:59.032883    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:50:59.045194    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:50:59.045207    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:50:59.058402    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:50:59.058412    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:50:59.071439    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:50:59.071455    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:59.083854    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:59.083868    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:59.121241    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:50:59.121252    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:50:59.133509    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:50:59.133520    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:50:59.151994    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:59.152004    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:59.176461    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:50:59.176468    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:51:01.691836    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:51:06.693936    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:51:06.694011    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:51:06.708534    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:51:06.708596    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:51:06.720019    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:51:06.720089    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:51:06.732988    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:51:06.733067    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:51:06.749007    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:51:06.749068    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:51:06.759855    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:51:06.759924    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:51:06.777013    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:51:06.777083    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:51:06.788332    3966 logs.go:276] 0 containers: []
	W0814 17:51:06.788670    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:51:06.788797    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:51:06.808315    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:51:06.808338    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:51:06.808344    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:51:06.826412    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:51:06.826423    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:51:06.838905    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:51:06.838919    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:51:06.875829    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:51:06.875850    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:51:06.880783    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:51:06.880790    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:51:06.896027    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:51:06.896045    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:51:06.907974    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:51:06.907986    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:51:06.923965    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:51:06.923984    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:51:06.939085    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:51:06.939096    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:51:06.964867    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:51:06.964880    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:51:07.001606    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:51:07.001617    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:51:07.013238    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:51:07.013253    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:51:07.025027    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:51:07.025038    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:51:07.041528    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:51:07.041540    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:51:07.055951    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:51:07.055961    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:51:09.569539    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:51:14.571629    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:51:14.571710    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:51:14.582854    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:51:14.582924    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:51:14.594274    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:51:14.594345    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:51:14.606160    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:51:14.606235    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:51:14.618276    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:51:14.618345    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:51:14.629689    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:51:14.629754    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:51:14.641557    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:51:14.641631    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:51:14.652927    3966 logs.go:276] 0 containers: []
	W0814 17:51:14.652939    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:51:14.652995    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:51:14.664152    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:51:14.664170    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:51:14.664176    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:51:14.668882    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:51:14.668892    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:51:14.706974    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:51:14.706987    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:51:14.719967    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:51:14.719979    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:51:14.756449    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:51:14.756462    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:51:14.776295    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:51:14.776306    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:51:14.791293    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:51:14.791308    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:51:14.804378    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:51:14.804389    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:51:14.816959    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:51:14.816970    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:51:14.829278    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:51:14.829290    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:51:14.841713    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:51:14.841726    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:51:14.853578    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:51:14.853589    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:51:14.869409    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:51:14.869420    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:51:14.887172    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:51:14.887182    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:51:14.898816    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:51:14.898829    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:51:17.424780    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:51:22.426988    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:51:22.427097    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:51:22.443658    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:51:22.443731    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:51:22.457642    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:51:22.457682    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:51:22.469136    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:51:22.469207    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:51:22.485252    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:51:22.485325    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:51:22.497104    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:51:22.497173    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:51:22.508697    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:51:22.508764    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:51:22.520646    3966 logs.go:276] 0 containers: []
	W0814 17:51:22.520657    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:51:22.520721    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:51:22.532065    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:51:22.532081    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:51:22.532085    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:51:22.570457    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:51:22.570469    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:51:22.593384    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:51:22.593393    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:51:22.619058    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:51:22.619074    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:51:22.631881    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:51:22.631890    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:51:22.636673    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:51:22.636684    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:51:22.675676    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:51:22.675689    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:51:22.691252    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:51:22.691264    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:51:22.705888    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:51:22.705899    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:51:22.719143    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:51:22.719154    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:51:22.735118    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:51:22.735132    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:51:22.749560    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:51:22.749573    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:51:22.761306    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:51:22.761315    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:51:22.772910    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:51:22.772920    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:51:22.785381    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:51:22.785398    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:51:25.302442    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:51:30.304630    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:51:30.304742    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:51:30.320716    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:51:30.320806    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:51:30.334292    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:51:30.334369    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:51:30.349703    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:51:30.349775    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:51:30.362328    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:51:30.362396    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:51:30.377867    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:51:30.377945    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:51:30.390599    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:51:30.390666    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:51:30.403149    3966 logs.go:276] 0 containers: []
	W0814 17:51:30.403161    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:51:30.403201    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:51:30.414089    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:51:30.414109    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:51:30.414115    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:51:30.429036    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:51:30.429046    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:51:30.442903    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:51:30.442925    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:51:30.461331    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:51:30.461349    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:51:30.483095    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:51:30.483116    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:51:30.545207    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:51:30.545227    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:51:30.567766    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:51:30.567784    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:51:30.591429    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:51:30.591448    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:51:30.617596    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:51:30.617607    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:51:30.629515    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:51:30.629526    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:51:30.634736    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:51:30.634745    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:51:30.647465    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:51:30.647476    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:51:30.663172    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:51:30.663184    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:51:30.676942    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:51:30.676954    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:51:30.697318    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:51:30.697338    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:51:33.236782    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:51:38.238957    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:51:38.243312    3966 out.go:177] 
	W0814 17:51:38.247326    3966 out.go:239] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: context deadline exceeded
	X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: context deadline exceeded
	W0814 17:51:38.247332    3966 out.go:239] * 
	* 
	W0814 17:51:38.247800    3966 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:51:38.258352    3966 out.go:177] 

                                                
                                                
** /stderr **
version_upgrade_test.go:132: upgrade from v1.26.0 to HEAD failed: out/minikube-darwin-arm64 start -p running-upgrade-987000 --memory=2200 --alsologtostderr -v=1 --driver=qemu2 : exit status 80
panic.go:626: *** TestRunningBinaryUpgrade FAILED at 2024-08-14 17:51:38.353426 -0700 PDT m=+2826.702538501
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p running-upgrade-987000 -n running-upgrade-987000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p running-upgrade-987000 -n running-upgrade-987000: exit status 2 (15.719819125s)

                                                
                                                
-- stdout --
	Running

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 2 (may be ok)
helpers_test.go:244: <<< TestRunningBinaryUpgrade FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestRunningBinaryUpgrade]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p running-upgrade-987000 logs -n 25
helpers_test.go:252: TestRunningBinaryUpgrade logs: 
-- stdout --
	
	==> Audit <==
	|---------|------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	| Command |                         Args                         |          Profile          |  User   | Version |     Start Time      |      End Time       |
	|---------|------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	| ssh     | -p cilium-672000 sudo                                | cilium-672000             | jenkins | v1.33.1 | 14 Aug 24 17:41 PDT |                     |
	|         | systemctl status cri-docker                          |                           |         |         |                     |                     |
	|         | --all --full --no-pager                              |                           |         |         |                     |                     |
	| ssh     | -p cilium-672000 sudo                                | cilium-672000             | jenkins | v1.33.1 | 14 Aug 24 17:41 PDT |                     |
	|         | systemctl cat cri-docker                             |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-672000 sudo cat                            | cilium-672000             | jenkins | v1.33.1 | 14 Aug 24 17:41 PDT |                     |
	|         | /etc/systemd/system/cri-docker.service.d/10-cni.conf |                           |         |         |                     |                     |
	| ssh     | -p cilium-672000 sudo cat                            | cilium-672000             | jenkins | v1.33.1 | 14 Aug 24 17:41 PDT |                     |
	|         | /usr/lib/systemd/system/cri-docker.service           |                           |         |         |                     |                     |
	| ssh     | -p cilium-672000 sudo                                | cilium-672000             | jenkins | v1.33.1 | 14 Aug 24 17:41 PDT |                     |
	|         | cri-dockerd --version                                |                           |         |         |                     |                     |
	| ssh     | -p cilium-672000 sudo                                | cilium-672000             | jenkins | v1.33.1 | 14 Aug 24 17:41 PDT |                     |
	|         | systemctl status containerd                          |                           |         |         |                     |                     |
	|         | --all --full --no-pager                              |                           |         |         |                     |                     |
	| ssh     | -p cilium-672000 sudo                                | cilium-672000             | jenkins | v1.33.1 | 14 Aug 24 17:41 PDT |                     |
	|         | systemctl cat containerd                             |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-672000 sudo cat                            | cilium-672000             | jenkins | v1.33.1 | 14 Aug 24 17:41 PDT |                     |
	|         | /lib/systemd/system/containerd.service               |                           |         |         |                     |                     |
	| ssh     | -p cilium-672000 sudo cat                            | cilium-672000             | jenkins | v1.33.1 | 14 Aug 24 17:41 PDT |                     |
	|         | /etc/containerd/config.toml                          |                           |         |         |                     |                     |
	| ssh     | -p cilium-672000 sudo                                | cilium-672000             | jenkins | v1.33.1 | 14 Aug 24 17:41 PDT |                     |
	|         | containerd config dump                               |                           |         |         |                     |                     |
	| ssh     | -p cilium-672000 sudo                                | cilium-672000             | jenkins | v1.33.1 | 14 Aug 24 17:41 PDT |                     |
	|         | systemctl status crio --all                          |                           |         |         |                     |                     |
	|         | --full --no-pager                                    |                           |         |         |                     |                     |
	| ssh     | -p cilium-672000 sudo                                | cilium-672000             | jenkins | v1.33.1 | 14 Aug 24 17:41 PDT |                     |
	|         | systemctl cat crio --no-pager                        |                           |         |         |                     |                     |
	| ssh     | -p cilium-672000 sudo find                           | cilium-672000             | jenkins | v1.33.1 | 14 Aug 24 17:41 PDT |                     |
	|         | /etc/crio -type f -exec sh -c                        |                           |         |         |                     |                     |
	|         | 'echo {}; cat {}' \;                                 |                           |         |         |                     |                     |
	| ssh     | -p cilium-672000 sudo crio                           | cilium-672000             | jenkins | v1.33.1 | 14 Aug 24 17:41 PDT |                     |
	|         | config                                               |                           |         |         |                     |                     |
	| delete  | -p cilium-672000                                     | cilium-672000             | jenkins | v1.33.1 | 14 Aug 24 17:41 PDT | 14 Aug 24 17:41 PDT |
	| start   | -p kubernetes-upgrade-077000                         | kubernetes-upgrade-077000 | jenkins | v1.33.1 | 14 Aug 24 17:41 PDT |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0                         |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=1                               |                           |         |         |                     |                     |
	|         | --driver=qemu2                                       |                           |         |         |                     |                     |
	| delete  | -p offline-docker-487000                             | offline-docker-487000     | jenkins | v1.33.1 | 14 Aug 24 17:41 PDT | 14 Aug 24 17:41 PDT |
	| start   | -p stopped-upgrade-504000                            | minikube                  | jenkins | v1.26.0 | 14 Aug 24 17:41 PDT | 14 Aug 24 17:42 PDT |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=qemu2                                    |                           |         |         |                     |                     |
	| stop    | -p kubernetes-upgrade-077000                         | kubernetes-upgrade-077000 | jenkins | v1.33.1 | 14 Aug 24 17:41 PDT | 14 Aug 24 17:41 PDT |
	| start   | -p kubernetes-upgrade-077000                         | kubernetes-upgrade-077000 | jenkins | v1.33.1 | 14 Aug 24 17:41 PDT |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.0                         |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=1                               |                           |         |         |                     |                     |
	|         | --driver=qemu2                                       |                           |         |         |                     |                     |
	| delete  | -p kubernetes-upgrade-077000                         | kubernetes-upgrade-077000 | jenkins | v1.33.1 | 14 Aug 24 17:41 PDT | 14 Aug 24 17:41 PDT |
	| start   | -p running-upgrade-987000                            | minikube                  | jenkins | v1.26.0 | 14 Aug 24 17:41 PDT | 14 Aug 24 17:42 PDT |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=qemu2                                    |                           |         |         |                     |                     |
	| stop    | stopped-upgrade-504000 stop                          | minikube                  | jenkins | v1.26.0 | 14 Aug 24 17:42 PDT | 14 Aug 24 17:42 PDT |
	| start   | -p stopped-upgrade-504000                            | stopped-upgrade-504000    | jenkins | v1.33.1 | 14 Aug 24 17:42 PDT |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=1                               |                           |         |         |                     |                     |
	|         | --driver=qemu2                                       |                           |         |         |                     |                     |
	| start   | -p running-upgrade-987000                            | running-upgrade-987000    | jenkins | v1.33.1 | 14 Aug 24 17:42 PDT |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=1                               |                           |         |         |                     |                     |
	|         | --driver=qemu2                                       |                           |         |         |                     |                     |
	|---------|------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/08/14 17:42:57
	Running on machine: MacOS-M1-Agent-2
	Binary: Built with gc go1.22.5 for darwin/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0814 17:42:57.276923    3966 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:42:57.277058    3966 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:42:57.277062    3966 out.go:304] Setting ErrFile to fd 2...
	I0814 17:42:57.277064    3966 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:42:57.277171    3966 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:42:57.278121    3966 out.go:298] Setting JSON to false
	I0814 17:42:57.294748    3966 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2540,"bootTime":1723680037,"procs":459,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:42:57.294822    3966 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:42:57.299746    3966 out.go:177] * [running-upgrade-987000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:42:57.307734    3966 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:42:57.307830    3966 notify.go:220] Checking for updates...
	I0814 17:42:57.315631    3966 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:42:57.319712    3966 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:42:57.322675    3966 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:42:57.325710    3966 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:42:57.328751    3966 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:42:57.330065    3966 config.go:182] Loaded profile config "running-upgrade-987000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I0814 17:42:57.332660    3966 out.go:177] * Kubernetes 1.31.0 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.0
	I0814 17:42:57.335671    3966 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:42:57.339600    3966 out.go:177] * Using the qemu2 driver based on existing profile
	I0814 17:42:57.346722    3966 start.go:297] selected driver: qemu2
	I0814 17:42:57.346727    3966 start.go:901] validating driver "qemu2" against &{Name:running-upgrade-987000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.26.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:50332 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:running-upgra
de-987000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizat
ions:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s}
	I0814 17:42:57.346773    3966 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:42:57.348862    3966 cni.go:84] Creating CNI manager for ""
	I0814 17:42:57.348881    3966 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:42:57.348901    3966 start.go:340] cluster config:
	{Name:running-upgrade-987000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.26.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:50332 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:running-upgrade-987000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerN
ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:
SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s}
	I0814 17:42:57.348947    3966 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:42:57.355658    3966 out.go:177] * Starting "running-upgrade-987000" primary control-plane node in "running-upgrade-987000" cluster
	I0814 17:42:57.359719    3966 preload.go:131] Checking if preload exists for k8s version v1.24.1 and runtime docker
	I0814 17:42:57.359731    3966 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-arm64.tar.lz4
	I0814 17:42:57.359738    3966 cache.go:56] Caching tarball of preloaded images
	I0814 17:42:57.359783    3966 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:42:57.359790    3966 cache.go:59] Finished verifying existence of preloaded tar for v1.24.1 on docker
	I0814 17:42:57.359839    3966 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/config.json ...
	I0814 17:42:57.360182    3966 start.go:360] acquireMachinesLock for running-upgrade-987000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:43:09.835360    3966 start.go:364] duration metric: took 12.476446959s to acquireMachinesLock for "running-upgrade-987000"
	I0814 17:43:09.835381    3966 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:43:09.835385    3966 fix.go:54] fixHost starting: 
	I0814 17:43:09.836359    3966 fix.go:112] recreateIfNeeded on running-upgrade-987000: state=Running err=<nil>
	W0814 17:43:09.836375    3966 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:43:09.839942    3966 out.go:177] * Updating the running qemu2 "running-upgrade-987000" VM ...
	I0814 17:43:08.847383    3955 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/config.json ...
	I0814 17:43:08.847680    3955 machine.go:94] provisionDockerMachine start ...
	I0814 17:43:08.847735    3955 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:08.847929    3955 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10482c5a0] 0x10482ee00 <nil>  [] 0s} localhost 50228 <nil> <nil>}
	I0814 17:43:08.847937    3955 main.go:141] libmachine: About to run SSH command:
	hostname
	I0814 17:43:08.918488    3955 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
	
	I0814 17:43:08.918507    3955 buildroot.go:166] provisioning hostname "stopped-upgrade-504000"
	I0814 17:43:08.918567    3955 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:08.918701    3955 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10482c5a0] 0x10482ee00 <nil>  [] 0s} localhost 50228 <nil> <nil>}
	I0814 17:43:08.918709    3955 main.go:141] libmachine: About to run SSH command:
	sudo hostname stopped-upgrade-504000 && echo "stopped-upgrade-504000" | sudo tee /etc/hostname
	I0814 17:43:08.991560    3955 main.go:141] libmachine: SSH cmd err, output: <nil>: stopped-upgrade-504000
	
	I0814 17:43:08.991616    3955 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:08.991744    3955 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10482c5a0] 0x10482ee00 <nil>  [] 0s} localhost 50228 <nil> <nil>}
	I0814 17:43:08.991752    3955 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sstopped-upgrade-504000' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 stopped-upgrade-504000/g' /etc/hosts;
				else 
					echo '127.0.1.1 stopped-upgrade-504000' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0814 17:43:09.060432    3955 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0814 17:43:09.060446    3955 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/19443-949/.minikube CaCertPath:/Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/19443-949/.minikube}
	I0814 17:43:09.060466    3955 buildroot.go:174] setting up certificates
	I0814 17:43:09.060472    3955 provision.go:84] configureAuth start
	I0814 17:43:09.060476    3955 provision.go:143] copyHostCerts
	I0814 17:43:09.060564    3955 exec_runner.go:144] found /Users/jenkins/minikube-integration/19443-949/.minikube/ca.pem, removing ...
	I0814 17:43:09.060570    3955 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19443-949/.minikube/ca.pem
	I0814 17:43:09.060682    3955 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/19443-949/.minikube/ca.pem (1078 bytes)
	I0814 17:43:09.060861    3955 exec_runner.go:144] found /Users/jenkins/minikube-integration/19443-949/.minikube/cert.pem, removing ...
	I0814 17:43:09.060864    3955 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19443-949/.minikube/cert.pem
	I0814 17:43:09.060921    3955 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/19443-949/.minikube/cert.pem (1123 bytes)
	I0814 17:43:09.061026    3955 exec_runner.go:144] found /Users/jenkins/minikube-integration/19443-949/.minikube/key.pem, removing ...
	I0814 17:43:09.061030    3955 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19443-949/.minikube/key.pem
	I0814 17:43:09.061075    3955 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/19443-949/.minikube/key.pem (1679 bytes)
	I0814 17:43:09.061160    3955 provision.go:117] generating server cert: /Users/jenkins/minikube-integration/19443-949/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca-key.pem org=jenkins.stopped-upgrade-504000 san=[127.0.0.1 localhost minikube stopped-upgrade-504000]
	I0814 17:43:09.141913    3955 provision.go:177] copyRemoteCerts
	I0814 17:43:09.141960    3955 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0814 17:43:09.141970    3955 sshutil.go:53] new ssh client: &{IP:localhost Port:50228 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/stopped-upgrade-504000/id_rsa Username:docker}
	I0814 17:43:09.178731    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0814 17:43:09.185205    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
	I0814 17:43:09.192477    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0814 17:43:09.199605    3955 provision.go:87] duration metric: took 139.1395ms to configureAuth
	I0814 17:43:09.199615    3955 buildroot.go:189] setting minikube options for container-runtime
	I0814 17:43:09.199727    3955 config.go:182] Loaded profile config "stopped-upgrade-504000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I0814 17:43:09.199765    3955 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:09.199855    3955 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10482c5a0] 0x10482ee00 <nil>  [] 0s} localhost 50228 <nil> <nil>}
	I0814 17:43:09.199860    3955 main.go:141] libmachine: About to run SSH command:
	df --output=fstype / | tail -n 1
	I0814 17:43:09.266544    3955 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs
	
	I0814 17:43:09.266555    3955 buildroot.go:70] root file system type: tmpfs
	I0814 17:43:09.266607    3955 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
	I0814 17:43:09.266656    3955 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:09.266772    3955 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10482c5a0] 0x10482ee00 <nil>  [] 0s} localhost 50228 <nil> <nil>}
	I0814 17:43:09.266805    3955 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	After=network.target  minikube-automount.service docker.socket
	Requires= minikube-automount.service docker.socket 
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP \$MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	" | sudo tee /lib/systemd/system/docker.service.new
	I0814 17:43:09.338721    3955 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	After=network.target  minikube-automount.service docker.socket
	Requires= minikube-automount.service docker.socket 
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP $MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	
	I0814 17:43:09.338775    3955 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:09.338892    3955 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10482c5a0] 0x10482ee00 <nil>  [] 0s} localhost 50228 <nil> <nil>}
	I0814 17:43:09.338902    3955 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
	I0814 17:43:09.714079    3955 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory
	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.
	
	I0814 17:43:09.714100    3955 machine.go:97] duration metric: took 866.479083ms to provisionDockerMachine
	I0814 17:43:09.714107    3955 start.go:293] postStartSetup for "stopped-upgrade-504000" (driver="qemu2")
	I0814 17:43:09.714116    3955 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0814 17:43:09.714184    3955 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0814 17:43:09.714196    3955 sshutil.go:53] new ssh client: &{IP:localhost Port:50228 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/stopped-upgrade-504000/id_rsa Username:docker}
	I0814 17:43:09.752009    3955 ssh_runner.go:195] Run: cat /etc/os-release
	I0814 17:43:09.754183    3955 info.go:137] Remote host: Buildroot 2021.02.12
	I0814 17:43:09.754190    3955 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19443-949/.minikube/addons for local assets ...
	I0814 17:43:09.754270    3955 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19443-949/.minikube/files for local assets ...
	I0814 17:43:09.754390    3955 filesync.go:149] local asset: /Users/jenkins/minikube-integration/19443-949/.minikube/files/etc/ssl/certs/14042.pem -> 14042.pem in /etc/ssl/certs
	I0814 17:43:09.754519    3955 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0814 17:43:09.756873    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/files/etc/ssl/certs/14042.pem --> /etc/ssl/certs/14042.pem (1708 bytes)
	I0814 17:43:09.764730    3955 start.go:296] duration metric: took 50.618625ms for postStartSetup
	I0814 17:43:09.764748    3955 fix.go:56] duration metric: took 21.7893275s for fixHost
	I0814 17:43:09.764794    3955 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:09.764908    3955 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10482c5a0] 0x10482ee00 <nil>  [] 0s} localhost 50228 <nil> <nil>}
	I0814 17:43:09.764914    3955 main.go:141] libmachine: About to run SSH command:
	date +%!s(MISSING).%!N(MISSING)
	I0814 17:43:09.835244    3955 main.go:141] libmachine: SSH cmd err, output: <nil>: 1723682590.078950463
	
	I0814 17:43:09.835256    3955 fix.go:216] guest clock: 1723682590.078950463
	I0814 17:43:09.835260    3955 fix.go:229] Guest: 2024-08-14 17:43:10.078950463 -0700 PDT Remote: 2024-08-14 17:43:09.76475 -0700 PDT m=+21.891397626 (delta=314.200463ms)
	I0814 17:43:09.835272    3955 fix.go:200] guest clock delta is within tolerance: 314.200463ms
	I0814 17:43:09.835275    3955 start.go:83] releasing machines lock for "stopped-upgrade-504000", held for 21.8598675s
	I0814 17:43:09.835354    3955 ssh_runner.go:195] Run: cat /version.json
	I0814 17:43:09.835367    3955 sshutil.go:53] new ssh client: &{IP:localhost Port:50228 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/stopped-upgrade-504000/id_rsa Username:docker}
	I0814 17:43:09.835502    3955 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0814 17:43:09.835543    3955 sshutil.go:53] new ssh client: &{IP:localhost Port:50228 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/stopped-upgrade-504000/id_rsa Username:docker}
	W0814 17:43:09.836157    3955 sshutil.go:64] dial failure (will retry): dial tcp [::1]:50228: connect: connection refused
	I0814 17:43:09.836206    3955 retry.go:31] will retry after 258.449934ms: dial tcp [::1]:50228: connect: connection refused
	W0814 17:43:09.870432    3955 start.go:419] Unable to open version.json: cat /version.json: Process exited with status 1
	stdout:
	
	stderr:
	cat: /version.json: No such file or directory
	I0814 17:43:09.870491    3955 ssh_runner.go:195] Run: systemctl --version
	I0814 17:43:09.872391    3955 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	W0814 17:43:09.874327    3955 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
	I0814 17:43:09.874370    3955 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%!p(MISSING), " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
	I0814 17:43:09.877465    3955 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%!p(MISSING), " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
	I0814 17:43:09.882661    3955 cni.go:308] configured [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
	I0814 17:43:09.882674    3955 start.go:495] detecting cgroup driver to use...
	I0814 17:43:09.882751    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0814 17:43:09.889803    3955 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.7"|' /etc/containerd/config.toml"
	I0814 17:43:09.893090    3955 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0814 17:43:09.896402    3955 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
	I0814 17:43:09.896424    3955 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0814 17:43:09.899647    3955 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0814 17:43:09.902665    3955 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0814 17:43:09.905628    3955 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0814 17:43:09.908820    3955 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0814 17:43:09.912475    3955 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0814 17:43:09.916096    3955 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
	I0814 17:43:09.919642    3955 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"
	I0814 17:43:09.922932    3955 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0814 17:43:09.925691    3955 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0814 17:43:09.928826    3955 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:43:10.010189    3955 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0814 17:43:10.016361    3955 start.go:495] detecting cgroup driver to use...
	I0814 17:43:10.016410    3955 ssh_runner.go:195] Run: sudo systemctl cat docker.service
	I0814 17:43:10.021707    3955 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0814 17:43:10.027853    3955 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0814 17:43:10.039293    3955 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0814 17:43:10.043913    3955 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0814 17:43:10.048303    3955 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0814 17:43:10.107052    3955 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0814 17:43:10.111504    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0814 17:43:10.117553    3955 ssh_runner.go:195] Run: which cri-dockerd
	I0814 17:43:10.119139    3955 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
	I0814 17:43:10.121829    3955 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
	I0814 17:43:10.126821    3955 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
	I0814 17:43:10.206222    3955 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
	I0814 17:43:10.289378    3955 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
	I0814 17:43:10.289448    3955 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
	I0814 17:43:10.294984    3955 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:43:10.380106    3955 ssh_runner.go:195] Run: sudo systemctl restart docker
	I0814 17:43:11.502649    3955 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.122607458s)
	I0814 17:43:11.502717    3955 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket
	I0814 17:43:11.507887    3955 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
	I0814 17:43:11.512828    3955 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
	I0814 17:43:11.596093    3955 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
	I0814 17:43:11.670970    3955 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:43:11.737288    3955 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
	I0814 17:43:11.743687    3955 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
	I0814 17:43:11.748155    3955 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:43:11.826649    3955 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service
	I0814 17:43:11.868068    3955 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock
	I0814 17:43:11.868143    3955 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
	I0814 17:43:11.871093    3955 start.go:563] Will wait 60s for crictl version
	I0814 17:43:11.871145    3955 ssh_runner.go:195] Run: which crictl
	I0814 17:43:11.872351    3955 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0814 17:43:11.886555    3955 start.go:579] Version:  0.1.0
	RuntimeName:  docker
	RuntimeVersion:  20.10.16
	RuntimeApiVersion:  1.41.0
	I0814 17:43:11.886625    3955 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I0814 17:43:11.901815    3955 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I0814 17:43:09.847788    3966 machine.go:94] provisionDockerMachine start ...
	I0814 17:43:09.847876    3966 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:09.848030    3966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1028f85a0] 0x1028fae00 <nil>  [] 0s} localhost 50265 <nil> <nil>}
	I0814 17:43:09.848035    3966 main.go:141] libmachine: About to run SSH command:
	hostname
	I0814 17:43:09.938855    3966 main.go:141] libmachine: SSH cmd err, output: <nil>: running-upgrade-987000
	
	I0814 17:43:09.938876    3966 buildroot.go:166] provisioning hostname "running-upgrade-987000"
	I0814 17:43:09.938923    3966 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:09.939054    3966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1028f85a0] 0x1028fae00 <nil>  [] 0s} localhost 50265 <nil> <nil>}
	I0814 17:43:09.939059    3966 main.go:141] libmachine: About to run SSH command:
	sudo hostname running-upgrade-987000 && echo "running-upgrade-987000" | sudo tee /etc/hostname
	I0814 17:43:10.016249    3966 main.go:141] libmachine: SSH cmd err, output: <nil>: running-upgrade-987000
	
	I0814 17:43:10.016311    3966 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:10.016451    3966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1028f85a0] 0x1028fae00 <nil>  [] 0s} localhost 50265 <nil> <nil>}
	I0814 17:43:10.016458    3966 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\srunning-upgrade-987000' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 running-upgrade-987000/g' /etc/hosts;
				else 
					echo '127.0.1.1 running-upgrade-987000' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0814 17:43:10.091287    3966 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0814 17:43:10.091310    3966 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/19443-949/.minikube CaCertPath:/Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/19443-949/.minikube}
	I0814 17:43:10.091322    3966 buildroot.go:174] setting up certificates
	I0814 17:43:10.091327    3966 provision.go:84] configureAuth start
	I0814 17:43:10.091332    3966 provision.go:143] copyHostCerts
	I0814 17:43:10.091407    3966 exec_runner.go:144] found /Users/jenkins/minikube-integration/19443-949/.minikube/cert.pem, removing ...
	I0814 17:43:10.091413    3966 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19443-949/.minikube/cert.pem
	I0814 17:43:10.091538    3966 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/19443-949/.minikube/cert.pem (1123 bytes)
	I0814 17:43:10.091710    3966 exec_runner.go:144] found /Users/jenkins/minikube-integration/19443-949/.minikube/key.pem, removing ...
	I0814 17:43:10.091713    3966 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19443-949/.minikube/key.pem
	I0814 17:43:10.091754    3966 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/19443-949/.minikube/key.pem (1679 bytes)
	I0814 17:43:10.091852    3966 exec_runner.go:144] found /Users/jenkins/minikube-integration/19443-949/.minikube/ca.pem, removing ...
	I0814 17:43:10.091855    3966 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19443-949/.minikube/ca.pem
	I0814 17:43:10.091895    3966 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/19443-949/.minikube/ca.pem (1078 bytes)
	I0814 17:43:10.091974    3966 provision.go:117] generating server cert: /Users/jenkins/minikube-integration/19443-949/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca-key.pem org=jenkins.running-upgrade-987000 san=[127.0.0.1 localhost minikube running-upgrade-987000]
	I0814 17:43:10.152178    3966 provision.go:177] copyRemoteCerts
	I0814 17:43:10.152224    3966 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0814 17:43:10.152238    3966 sshutil.go:53] new ssh client: &{IP:localhost Port:50265 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/running-upgrade-987000/id_rsa Username:docker}
	I0814 17:43:10.191207    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0814 17:43:10.200524    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
	I0814 17:43:10.207988    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0814 17:43:10.215039    3966 provision.go:87] duration metric: took 123.714292ms to configureAuth
	I0814 17:43:10.215051    3966 buildroot.go:189] setting minikube options for container-runtime
	I0814 17:43:10.215186    3966 config.go:182] Loaded profile config "running-upgrade-987000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I0814 17:43:10.215227    3966 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:10.215322    3966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1028f85a0] 0x1028fae00 <nil>  [] 0s} localhost 50265 <nil> <nil>}
	I0814 17:43:10.215326    3966 main.go:141] libmachine: About to run SSH command:
	df --output=fstype / | tail -n 1
	I0814 17:43:10.286559    3966 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs
	
	I0814 17:43:10.286571    3966 buildroot.go:70] root file system type: tmpfs
	I0814 17:43:10.286618    3966 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
	I0814 17:43:10.286669    3966 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:10.286788    3966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1028f85a0] 0x1028fae00 <nil>  [] 0s} localhost 50265 <nil> <nil>}
	I0814 17:43:10.286822    3966 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	After=network.target  minikube-automount.service docker.socket
	Requires= minikube-automount.service docker.socket 
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP \$MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	" | sudo tee /lib/systemd/system/docker.service.new
	I0814 17:43:10.362130    3966 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	After=network.target  minikube-automount.service docker.socket
	Requires= minikube-automount.service docker.socket 
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP $MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	
	I0814 17:43:10.362182    3966 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:10.362305    3966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1028f85a0] 0x1028fae00 <nil>  [] 0s} localhost 50265 <nil> <nil>}
	I0814 17:43:10.362313    3966 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
	I0814 17:43:10.435191    3966 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0814 17:43:10.435201    3966 machine.go:97] duration metric: took 587.448292ms to provisionDockerMachine
	I0814 17:43:10.435206    3966 start.go:293] postStartSetup for "running-upgrade-987000" (driver="qemu2")
	I0814 17:43:10.435213    3966 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0814 17:43:10.435260    3966 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0814 17:43:10.435269    3966 sshutil.go:53] new ssh client: &{IP:localhost Port:50265 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/running-upgrade-987000/id_rsa Username:docker}
	I0814 17:43:10.471901    3966 ssh_runner.go:195] Run: cat /etc/os-release
	I0814 17:43:10.473174    3966 info.go:137] Remote host: Buildroot 2021.02.12
	I0814 17:43:10.473181    3966 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19443-949/.minikube/addons for local assets ...
	I0814 17:43:10.473249    3966 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19443-949/.minikube/files for local assets ...
	I0814 17:43:10.473339    3966 filesync.go:149] local asset: /Users/jenkins/minikube-integration/19443-949/.minikube/files/etc/ssl/certs/14042.pem -> 14042.pem in /etc/ssl/certs
	I0814 17:43:10.473431    3966 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0814 17:43:10.476433    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/files/etc/ssl/certs/14042.pem --> /etc/ssl/certs/14042.pem (1708 bytes)
	I0814 17:43:10.482809    3966 start.go:296] duration metric: took 47.60075ms for postStartSetup
	I0814 17:43:10.482822    3966 fix.go:56] duration metric: took 647.485417ms for fixHost
	I0814 17:43:10.482854    3966 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:10.482963    3966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1028f85a0] 0x1028fae00 <nil>  [] 0s} localhost 50265 <nil> <nil>}
	I0814 17:43:10.482967    3966 main.go:141] libmachine: About to run SSH command:
	date +%!s(MISSING).%!N(MISSING)
	I0814 17:43:10.552545    3966 main.go:141] libmachine: SSH cmd err, output: <nil>: 1723682590.739823230
	
	I0814 17:43:10.552553    3966 fix.go:216] guest clock: 1723682590.739823230
	I0814 17:43:10.552558    3966 fix.go:229] Guest: 2024-08-14 17:43:10.73982323 -0700 PDT Remote: 2024-08-14 17:43:10.482823 -0700 PDT m=+13.227440085 (delta=257.00023ms)
	I0814 17:43:10.552569    3966 fix.go:200] guest clock delta is within tolerance: 257.00023ms
	I0814 17:43:10.552572    3966 start.go:83] releasing machines lock for "running-upgrade-987000", held for 717.255833ms
	I0814 17:43:10.552635    3966 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0814 17:43:10.552638    3966 ssh_runner.go:195] Run: cat /version.json
	I0814 17:43:10.552645    3966 sshutil.go:53] new ssh client: &{IP:localhost Port:50265 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/running-upgrade-987000/id_rsa Username:docker}
	I0814 17:43:10.552658    3966 sshutil.go:53] new ssh client: &{IP:localhost Port:50265 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/running-upgrade-987000/id_rsa Username:docker}
	W0814 17:43:10.553370    3966 sshutil.go:64] dial failure (will retry): dial tcp [::1]:50265: connect: connection refused
	I0814 17:43:10.553393    3966 retry.go:31] will retry after 159.58979ms: dial tcp [::1]:50265: connect: connection refused
	W0814 17:43:10.751710    3966 start.go:419] Unable to open version.json: cat /version.json: Process exited with status 1
	stdout:
	
	stderr:
	cat: /version.json: No such file or directory
	I0814 17:43:10.751781    3966 ssh_runner.go:195] Run: systemctl --version
	I0814 17:43:10.753761    3966 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	W0814 17:43:10.755558    3966 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
	I0814 17:43:10.755587    3966 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%!p(MISSING), " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
	I0814 17:43:10.758377    3966 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%!p(MISSING), " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
	I0814 17:43:10.763204    3966 cni.go:308] configured [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
	I0814 17:43:10.763211    3966 start.go:495] detecting cgroup driver to use...
	I0814 17:43:10.763279    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0814 17:43:10.768755    3966 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.7"|' /etc/containerd/config.toml"
	I0814 17:43:10.771913    3966 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0814 17:43:10.774716    3966 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
	I0814 17:43:10.774736    3966 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0814 17:43:10.777878    3966 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0814 17:43:10.781311    3966 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0814 17:43:10.784860    3966 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0814 17:43:10.787732    3966 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0814 17:43:10.790835    3966 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0814 17:43:10.794109    3966 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
	I0814 17:43:10.797444    3966 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"
	I0814 17:43:10.800472    3966 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0814 17:43:10.803183    3966 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0814 17:43:10.805810    3966 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:43:10.894078    3966 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0814 17:43:10.905139    3966 start.go:495] detecting cgroup driver to use...
	I0814 17:43:10.905219    3966 ssh_runner.go:195] Run: sudo systemctl cat docker.service
	I0814 17:43:10.910482    3966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0814 17:43:10.915207    3966 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0814 17:43:10.923301    3966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0814 17:43:10.928765    3966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0814 17:43:10.933321    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0814 17:43:10.938541    3966 ssh_runner.go:195] Run: which cri-dockerd
	I0814 17:43:10.939917    3966 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
	I0814 17:43:10.942760    3966 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
	I0814 17:43:10.948067    3966 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
	I0814 17:43:11.062303    3966 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
	I0814 17:43:11.169494    3966 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
	I0814 17:43:11.169546    3966 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
	I0814 17:43:11.174894    3966 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:43:11.278986    3966 ssh_runner.go:195] Run: sudo systemctl restart docker
	I0814 17:43:11.921160    3955 out.go:204] * Preparing Kubernetes v1.24.1 on Docker 20.10.16 ...
	I0814 17:43:11.921286    3955 ssh_runner.go:195] Run: grep 10.0.2.2	host.minikube.internal$ /etc/hosts
	I0814 17:43:11.922719    3955 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "10.0.2.2	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0814 17:43:11.926334    3955 kubeadm.go:883] updating cluster {Name:stopped-upgrade-504000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:50260 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName
:stopped-upgrade-504000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Di
sableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s} ...
	I0814 17:43:11.926379    3955 preload.go:131] Checking if preload exists for k8s version v1.24.1 and runtime docker
	I0814 17:43:11.926418    3955 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I0814 17:43:11.937400    3955 docker.go:685] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-apiserver:v1.24.1
	k8s.gcr.io/kube-proxy:v1.24.1
	k8s.gcr.io/kube-controller-manager:v1.24.1
	k8s.gcr.io/kube-scheduler:v1.24.1
	k8s.gcr.io/etcd:3.5.3-0
	k8s.gcr.io/pause:3.7
	k8s.gcr.io/coredns/coredns:v1.8.6
	k8s.gcr.io/pause:3.6
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I0814 17:43:11.937408    3955 docker.go:691] registry.k8s.io/kube-apiserver:v1.24.1 wasn't preloaded
	I0814 17:43:11.937465    3955 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I0814 17:43:11.940826    3955 ssh_runner.go:195] Run: which lz4
	I0814 17:43:11.942121    3955 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
	I0814 17:43:11.943357    3955 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/preloaded.tar.lz4': No such file or directory
	I0814 17:43:11.943366    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (359514331 bytes)
	I0814 17:43:12.926415    3955 docker.go:649] duration metric: took 984.396208ms to copy over tarball
	I0814 17:43:12.926470    3955 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
	I0814 17:43:14.093158    3955 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (1.166751875s)
	I0814 17:43:14.093173    3955 ssh_runner.go:146] rm: /preloaded.tar.lz4
	I0814 17:43:14.110151    3955 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I0814 17:43:14.113667    3955 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2523 bytes)
	I0814 17:43:14.119276    3955 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:43:14.197137    3955 ssh_runner.go:195] Run: sudo systemctl restart docker
	I0814 17:43:15.756157    3955 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.559099333s)
	I0814 17:43:15.756247    3955 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I0814 17:43:15.770312    3955 docker.go:685] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-apiserver:v1.24.1
	k8s.gcr.io/kube-proxy:v1.24.1
	k8s.gcr.io/kube-controller-manager:v1.24.1
	k8s.gcr.io/kube-scheduler:v1.24.1
	k8s.gcr.io/etcd:3.5.3-0
	k8s.gcr.io/pause:3.7
	k8s.gcr.io/coredns/coredns:v1.8.6
	<none>:<none>
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I0814 17:43:15.770320    3955 docker.go:691] registry.k8s.io/kube-apiserver:v1.24.1 wasn't preloaded
	I0814 17:43:15.770325    3955 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.24.1 registry.k8s.io/kube-controller-manager:v1.24.1 registry.k8s.io/kube-scheduler:v1.24.1 registry.k8s.io/kube-proxy:v1.24.1 registry.k8s.io/pause:3.7 registry.k8s.io/etcd:3.5.3-0 registry.k8s.io/coredns/coredns:v1.8.6 gcr.io/k8s-minikube/storage-provisioner:v5]
	I0814 17:43:15.774208    3955 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:43:15.775791    3955 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.24.1
	I0814 17:43:15.777715    3955 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:43:15.777741    3955 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.24.1
	I0814 17:43:15.780450    3955 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.24.1
	I0814 17:43:15.780548    3955 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.24.1
	I0814 17:43:15.782824    3955 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.24.1
	I0814 17:43:15.782901    3955 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.24.1
	I0814 17:43:15.784773    3955 image.go:135] retrieving image: registry.k8s.io/etcd:3.5.3-0
	I0814 17:43:15.785214    3955 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.24.1
	I0814 17:43:15.786753    3955 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.24.1
	I0814 17:43:15.786783    3955 image.go:135] retrieving image: registry.k8s.io/pause:3.7
	I0814 17:43:15.788304    3955 image.go:178] daemon lookup for registry.k8s.io/etcd:3.5.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.3-0
	I0814 17:43:15.788311    3955 image.go:135] retrieving image: registry.k8s.io/coredns/coredns:v1.8.6
	I0814 17:43:15.790531    3955 image.go:178] daemon lookup for registry.k8s.io/pause:3.7: Error response from daemon: No such image: registry.k8s.io/pause:3.7
	I0814 17:43:15.791780    3955 image.go:178] daemon lookup for registry.k8s.io/coredns/coredns:v1.8.6: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.8.6
	I0814 17:43:16.216028    3955 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.24.1
	I0814 17:43:16.225169    3955 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.24.1
	I0814 17:43:16.227747    3955 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.24.1" needs transfer: "registry.k8s.io/kube-proxy:v1.24.1" does not exist at hash "fcbd620bbac080b658602c597709b377cb2b3fec134a097a27f94cba9b2ed2fa" in container runtime
	I0814 17:43:16.227781    3955 docker.go:337] Removing image: registry.k8s.io/kube-proxy:v1.24.1
	I0814 17:43:16.227829    3955 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-proxy:v1.24.1
	I0814 17:43:16.238931    3955 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.24.1" needs transfer: "registry.k8s.io/kube-apiserver:v1.24.1" does not exist at hash "7c5896a75862a8bc252122185a929cec1393db2c525f6440137d4fbf46bbf6f9" in container runtime
	I0814 17:43:16.238951    3955 docker.go:337] Removing image: registry.k8s.io/kube-apiserver:v1.24.1
	I0814 17:43:16.238974    3955 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.24.1
	I0814 17:43:16.238976    3955 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-apiserver:v1.24.1
	I0814 17:43:16.240397    3955 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.1
	I0814 17:43:16.251691    3955 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.24.1" needs transfer: "registry.k8s.io/kube-scheduler:v1.24.1" does not exist at hash "000c19baf6bba51ff7ae5449f4c7a16d9190cef0263f58070dbf62cea9c4982f" in container runtime
	I0814 17:43:16.251725    3955 docker.go:337] Removing image: registry.k8s.io/kube-scheduler:v1.24.1
	I0814 17:43:16.251786    3955 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-scheduler:v1.24.1
	I0814 17:43:16.257687    3955 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.1
	I0814 17:43:16.263330    3955 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.24.1
	I0814 17:43:16.267139    3955 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.24.1
	I0814 17:43:16.276828    3955 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/etcd:3.5.3-0
	I0814 17:43:16.277634    3955 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.24.1" needs transfer: "registry.k8s.io/kube-controller-manager:v1.24.1" does not exist at hash "f61bbe9259d7caa580deb6c8e4bfd1780c7b5887efe3aa3adc7cc74f68a27c1b" in container runtime
	I0814 17:43:16.277662    3955 docker.go:337] Removing image: registry.k8s.io/kube-controller-manager:v1.24.1
	I0814 17:43:16.277707    3955 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-controller-manager:v1.24.1
	I0814 17:43:16.290123    3955 cache_images.go:116] "registry.k8s.io/etcd:3.5.3-0" needs transfer: "registry.k8s.io/etcd:3.5.3-0" does not exist at hash "a9a710bb96df080e6b9c720eb85dc5b832ff84abf77263548d74fedec6466a5a" in container runtime
	I0814 17:43:16.290149    3955 docker.go:337] Removing image: registry.k8s.io/etcd:3.5.3-0
	I0814 17:43:16.290194    3955 ssh_runner.go:195] Run: docker rmi registry.k8s.io/etcd:3.5.3-0
	I0814 17:43:16.290906    3955 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.1
	I0814 17:43:16.301594    3955 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0
	I0814 17:43:16.302565    3955 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/etcd_3.5.3-0
	I0814 17:43:16.304111    3955 ssh_runner.go:352] existence check for /var/lib/minikube/images/etcd_3.5.3-0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/etcd_3.5.3-0: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/images/etcd_3.5.3-0': No such file or directory
	I0814 17:43:16.304123    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0 --> /var/lib/minikube/images/etcd_3.5.3-0 (81117184 bytes)
	W0814 17:43:16.308289    3955 image.go:283] image registry.k8s.io/coredns/coredns:v1.8.6 arch mismatch: want arm64 got amd64. fixing
	I0814 17:43:16.308409    3955 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/coredns/coredns:v1.8.6
	I0814 17:43:16.330944    3955 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/pause:3.7
	I0814 17:43:16.338984    3955 cache_images.go:116] "registry.k8s.io/coredns/coredns:v1.8.6" needs transfer: "registry.k8s.io/coredns/coredns:v1.8.6" does not exist at hash "6af7f860a8197bfa3fdb7dec2061aa33870253e87a1e91c492d55b8a4fd38d14" in container runtime
	I0814 17:43:16.339012    3955 docker.go:337] Removing image: registry.k8s.io/coredns/coredns:v1.8.6
	I0814 17:43:16.339067    3955 ssh_runner.go:195] Run: docker rmi registry.k8s.io/coredns/coredns:v1.8.6
	I0814 17:43:16.364951    3955 cache_images.go:116] "registry.k8s.io/pause:3.7" needs transfer: "registry.k8s.io/pause:3.7" does not exist at hash "e5a475a0380575fb5df454b2e32bdec93e1ec0094d8a61e895b41567cb884550" in container runtime
	I0814 17:43:16.364984    3955 docker.go:337] Removing image: registry.k8s.io/pause:3.7
	I0814 17:43:16.365043    3955 ssh_runner.go:195] Run: docker rmi registry.k8s.io/pause:3.7
	I0814 17:43:16.370979    3955 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6
	I0814 17:43:16.371107    3955 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/coredns_v1.8.6
	W0814 17:43:16.383017    3955 image.go:283] image gcr.io/k8s-minikube/storage-provisioner:v5 arch mismatch: want arm64 got amd64. fixing
	I0814 17:43:16.383165    3955 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:43:16.406809    3955 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7
	I0814 17:43:16.406825    3955 ssh_runner.go:352] existence check for /var/lib/minikube/images/coredns_v1.8.6: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/coredns_v1.8.6: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/images/coredns_v1.8.6': No such file or directory
	I0814 17:43:16.406843    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6 --> /var/lib/minikube/images/coredns_v1.8.6 (12318720 bytes)
	I0814 17:43:16.406935    3955 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/pause_3.7
	I0814 17:43:16.431732    3955 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "66749159455b3f08c8318fe0233122f54d0f5889f9c5fdfb73c3fd9d99895b51" in container runtime
	I0814 17:43:16.431757    3955 docker.go:337] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:43:16.431815    3955 ssh_runner.go:195] Run: docker rmi gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:43:16.432630    3955 ssh_runner.go:352] existence check for /var/lib/minikube/images/pause_3.7: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/pause_3.7: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/images/pause_3.7': No such file or directory
	I0814 17:43:16.432648    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7 --> /var/lib/minikube/images/pause_3.7 (268288 bytes)
	I0814 17:43:16.471132    3955 docker.go:304] Loading image: /var/lib/minikube/images/pause_3.7
	I0814 17:43:16.471148    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/pause_3.7 | docker load"
	I0814 17:43:16.476173    3955 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5
	I0814 17:43:16.476306    3955 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/storage-provisioner_v5
	I0814 17:43:16.558400    3955 cache_images.go:321] Transferred and loaded /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7 from cache
	I0814 17:43:16.558422    3955 docker.go:304] Loading image: /var/lib/minikube/images/coredns_v1.8.6
	I0814 17:43:16.558429    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/coredns_v1.8.6 | docker load"
	I0814 17:43:16.558493    3955 ssh_runner.go:352] existence check for /var/lib/minikube/images/storage-provisioner_v5: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/storage-provisioner_v5: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/images/storage-provisioner_v5': No such file or directory
	I0814 17:43:16.558524    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 --> /var/lib/minikube/images/storage-provisioner_v5 (8035840 bytes)
	I0814 17:43:16.647053    3955 cache_images.go:321] Transferred and loaded /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6 from cache
	I0814 17:43:16.647074    3955 docker.go:304] Loading image: /var/lib/minikube/images/storage-provisioner_v5
	I0814 17:43:16.647080    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/storage-provisioner_v5 | docker load"
	I0814 17:43:16.987812    3955 cache_images.go:321] Transferred and loaded /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 from cache
	I0814 17:43:16.987829    3955 docker.go:304] Loading image: /var/lib/minikube/images/etcd_3.5.3-0
	I0814 17:43:16.987838    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/etcd_3.5.3-0 | docker load"
	I0814 17:43:17.144457    3955 cache_images.go:321] Transferred and loaded /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0 from cache
	I0814 17:43:17.144501    3955 cache_images.go:92] duration metric: took 1.374250291s to LoadCachedImages
	W0814 17:43:17.144541    3955 out.go:239] X Unable to load cached images: LoadCachedImages: stat /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.1: no such file or directory
	I0814 17:43:17.144545    3955 kubeadm.go:934] updating node { 10.0.2.15 8443 v1.24.1 docker true true} ...
	I0814 17:43:17.144599    3955 kubeadm.go:946] kubelet [Unit]
	Wants=docker.socket
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=stopped-upgrade-504000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=10.0.2.15
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.1 ClusterName:stopped-upgrade-504000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0814 17:43:17.144664    3955 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
	I0814 17:43:17.158108    3955 cni.go:84] Creating CNI manager for ""
	I0814 17:43:17.158122    3955 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:43:17.158131    3955 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0814 17:43:17.158141    3955 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:10.0.2.15 APIServerPort:8443 KubernetesVersion:v1.24.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:stopped-upgrade-504000 NodeName:stopped-upgrade-504000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "10.0.2.15"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:10.0.2.15 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/
etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0814 17:43:17.158200    3955 kubeadm.go:187] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 10.0.2.15
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/cri-dockerd.sock
	  name: "stopped-upgrade-504000"
	  kubeletExtraArgs:
	    node-ip: 10.0.2.15
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "10.0.2.15"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.1
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0814 17:43:17.158259    3955 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.1
	I0814 17:43:17.161085    3955 binaries.go:44] Found k8s binaries, skipping transfer
	I0814 17:43:17.161118    3955 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0814 17:43:17.164057    3955 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (380 bytes)
	I0814 17:43:17.169387    3955 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0814 17:43:17.174809    3955 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2096 bytes)
	I0814 17:43:17.180614    3955 ssh_runner.go:195] Run: grep 10.0.2.15	control-plane.minikube.internal$ /etc/hosts
	I0814 17:43:17.182186    3955 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "10.0.2.15	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0814 17:43:17.186005    3955 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:43:17.262096    3955 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0814 17:43:17.277122    3955 certs.go:68] Setting up /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000 for IP: 10.0.2.15
	I0814 17:43:17.277132    3955 certs.go:194] generating shared ca certs ...
	I0814 17:43:17.277141    3955 certs.go:226] acquiring lock for ca certs: {Name:mk9c8185fea6e56aae9b82059113ab288e9964dd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:43:17.277315    3955 certs.go:235] skipping valid "minikubeCA" ca cert: /Users/jenkins/minikube-integration/19443-949/.minikube/ca.key
	I0814 17:43:17.277365    3955 certs.go:235] skipping valid "proxyClientCA" ca cert: /Users/jenkins/minikube-integration/19443-949/.minikube/proxy-client-ca.key
	I0814 17:43:17.277369    3955 certs.go:256] generating profile certs ...
	I0814 17:43:17.277442    3955 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/client.key
	I0814 17:43:17.277457    3955 certs.go:363] generating signed profile cert for "minikube": /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/apiserver.key.f73c6db7
	I0814 17:43:17.277469    3955 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/apiserver.crt.f73c6db7 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 10.0.2.15]
	I0814 17:43:17.352523    3955 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/apiserver.crt.f73c6db7 ...
	I0814 17:43:17.352537    3955 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/apiserver.crt.f73c6db7: {Name:mk79a7a7bb3c08716fe925f5622ca2d9d2cdf7ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:43:17.353036    3955 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/apiserver.key.f73c6db7 ...
	I0814 17:43:17.353042    3955 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/apiserver.key.f73c6db7: {Name:mkf632f5cb8ac150482d347063fe285ac2c45556 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:43:17.353210    3955 certs.go:381] copying /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/apiserver.crt.f73c6db7 -> /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/apiserver.crt
	I0814 17:43:17.353359    3955 certs.go:385] copying /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/apiserver.key.f73c6db7 -> /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/apiserver.key
	I0814 17:43:17.353513    3955 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/proxy-client.key
	I0814 17:43:17.353652    3955 certs.go:484] found cert: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/1404.pem (1338 bytes)
	W0814 17:43:17.353681    3955 certs.go:480] ignoring /Users/jenkins/minikube-integration/19443-949/.minikube/certs/1404_empty.pem, impossibly tiny 0 bytes
	I0814 17:43:17.353687    3955 certs.go:484] found cert: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca-key.pem (1675 bytes)
	I0814 17:43:17.353707    3955 certs.go:484] found cert: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem (1078 bytes)
	I0814 17:43:17.353726    3955 certs.go:484] found cert: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem (1123 bytes)
	I0814 17:43:17.353745    3955 certs.go:484] found cert: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/key.pem (1679 bytes)
	I0814 17:43:17.353787    3955 certs.go:484] found cert: /Users/jenkins/minikube-integration/19443-949/.minikube/files/etc/ssl/certs/14042.pem (1708 bytes)
	I0814 17:43:17.354141    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0814 17:43:17.361051    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0814 17:43:17.368033    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0814 17:43:17.375309    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0814 17:43:17.382670    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
	I0814 17:43:17.389291    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0814 17:43:17.396556    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0814 17:43:17.404412    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0814 17:43:17.412513    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0814 17:43:17.420743    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/certs/1404.pem --> /usr/share/ca-certificates/1404.pem (1338 bytes)
	I0814 17:43:17.428206    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/files/etc/ssl/certs/14042.pem --> /usr/share/ca-certificates/14042.pem (1708 bytes)
	I0814 17:43:17.435730    3955 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0814 17:43:17.441362    3955 ssh_runner.go:195] Run: openssl version
	I0814 17:43:17.443353    3955 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0814 17:43:17.446483    3955 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0814 17:43:17.448135    3955 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 15 00:05 /usr/share/ca-certificates/minikubeCA.pem
	I0814 17:43:17.448169    3955 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0814 17:43:17.450472    3955 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0814 17:43:17.453725    3955 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1404.pem && ln -fs /usr/share/ca-certificates/1404.pem /etc/ssl/certs/1404.pem"
	I0814 17:43:17.456787    3955 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1404.pem
	I0814 17:43:17.458259    3955 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 15 00:12 /usr/share/ca-certificates/1404.pem
	I0814 17:43:17.458286    3955 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1404.pem
	I0814 17:43:17.460160    3955 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1404.pem /etc/ssl/certs/51391683.0"
	I0814 17:43:17.463700    3955 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14042.pem && ln -fs /usr/share/ca-certificates/14042.pem /etc/ssl/certs/14042.pem"
	I0814 17:43:17.467185    3955 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14042.pem
	I0814 17:43:17.468608    3955 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 15 00:12 /usr/share/ca-certificates/14042.pem
	I0814 17:43:17.468639    3955 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14042.pem
	I0814 17:43:17.471047    3955 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14042.pem /etc/ssl/certs/3ec20f2e.0"
	I0814 17:43:17.474481    3955 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0814 17:43:17.475983    3955 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0814 17:43:17.478255    3955 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0814 17:43:17.480142    3955 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0814 17:43:17.482260    3955 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0814 17:43:17.484414    3955 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0814 17:43:17.486495    3955 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0814 17:43:17.488443    3955 kubeadm.go:392] StartCluster: {Name:stopped-upgrade-504000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:50260 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:st
opped-upgrade-504000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disab
leOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s}
	I0814 17:43:17.488531    3955 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I0814 17:43:17.500508    3955 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0814 17:43:17.504248    3955 kubeadm.go:408] found existing configuration files, will attempt cluster restart
	I0814 17:43:17.504258    3955 kubeadm.go:593] restartPrimaryControlPlane start ...
	I0814 17:43:17.504297    3955 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0814 17:43:17.507887    3955 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0814 17:43:17.508123    3955 kubeconfig.go:47] verify endpoint returned: get endpoint: "stopped-upgrade-504000" does not appear in /Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:43:17.508172    3955 kubeconfig.go:62] /Users/jenkins/minikube-integration/19443-949/kubeconfig needs updating (will repair): [kubeconfig missing "stopped-upgrade-504000" cluster setting kubeconfig missing "stopped-upgrade-504000" context setting]
	I0814 17:43:17.508303    3955 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/kubeconfig: {Name:mke777513f7f5736c6804680b89db76bd98a8ac2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:43:17.508814    3955 kapi.go:59] client config for stopped-upgrade-504000: &rest.Config{Host:"https://10.0.2.15:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/client.key", CAFile:"/Users/jenkins/minikube-integration/19443-949/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8
(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x105de4f90), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0814 17:43:17.509129    3955 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0814 17:43:17.512309    3955 kubeadm.go:640] detected kubeadm config drift (will reconfigure cluster from new /var/tmp/minikube/kubeadm.yaml):
	-- stdout --
	--- /var/tmp/minikube/kubeadm.yaml
	+++ /var/tmp/minikube/kubeadm.yaml.new
	@@ -11,7 +11,7 @@
	       - signing
	       - authentication
	 nodeRegistration:
	-  criSocket: /var/run/cri-dockerd.sock
	+  criSocket: unix:///var/run/cri-dockerd.sock
	   name: "stopped-upgrade-504000"
	   kubeletExtraArgs:
	     node-ip: 10.0.2.15
	@@ -49,7 +49,9 @@
	 authentication:
	   x509:
	     clientCAFile: /var/lib/minikube/certs/ca.crt
	-cgroupDriver: systemd
	+cgroupDriver: cgroupfs
	+hairpinMode: hairpin-veth
	+runtimeRequestTimeout: 15m
	 clusterDomain: "cluster.local"
	 # disable disk resource management by default
	 imageGCHighThresholdPercent: 100
	
	-- /stdout --
	I0814 17:43:17.512315    3955 kubeadm.go:1160] stopping kube-system containers ...
	I0814 17:43:17.512359    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I0814 17:43:17.524657    3955 docker.go:483] Stopping containers: [886c89769d4d 8d68838819f9 b5246542fbb2 4f7295da5208 dc948f7a1a5b 6c24687f39f7 b6958c7276b1 aa3e71ab91c3]
	I0814 17:43:17.524720    3955 ssh_runner.go:195] Run: docker stop 886c89769d4d 8d68838819f9 b5246542fbb2 4f7295da5208 dc948f7a1a5b 6c24687f39f7 b6958c7276b1 aa3e71ab91c3
	I0814 17:43:17.537748    3955 ssh_runner.go:195] Run: sudo systemctl stop kubelet
	I0814 17:43:17.543753    3955 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0814 17:43:17.547536    3955 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0814 17:43:17.547546    3955 kubeadm.go:157] found existing configuration files:
	
	I0814 17:43:17.547601    3955 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/admin.conf
	I0814 17:43:17.550696    3955 kubeadm.go:163] "https://control-plane.minikube.internal:50260" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I0814 17:43:17.550743    3955 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I0814 17:43:17.553869    3955 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/kubelet.conf
	I0814 17:43:17.556620    3955 kubeadm.go:163] "https://control-plane.minikube.internal:50260" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I0814 17:43:17.556671    3955 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I0814 17:43:17.560590    3955 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/controller-manager.conf
	I0814 17:43:17.563650    3955 kubeadm.go:163] "https://control-plane.minikube.internal:50260" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I0814 17:43:17.563704    3955 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0814 17:43:17.567461    3955 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/scheduler.conf
	I0814 17:43:17.570532    3955 kubeadm.go:163] "https://control-plane.minikube.internal:50260" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I0814 17:43:17.570580    3955 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0814 17:43:17.573563    3955 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0814 17:43:17.576917    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
	I0814 17:43:17.603078    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
	I0814 17:43:17.905352    3966 ssh_runner.go:235] Completed: sudo systemctl restart docker: (6.626770458s)
	I0814 17:43:17.905415    3966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket
	I0814 17:43:17.910704    3966 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket
	I0814 17:43:17.918949    3966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
	I0814 17:43:17.924295    3966 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
	I0814 17:43:18.010386    3966 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
	I0814 17:43:18.100238    3966 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:43:18.188571    3966 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
	I0814 17:43:18.195765    3966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
	I0814 17:43:18.200488    3966 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:43:18.299512    3966 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service
	I0814 17:43:18.345087    3966 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock
	I0814 17:43:18.345162    3966 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
	I0814 17:43:18.348176    3966 start.go:563] Will wait 60s for crictl version
	I0814 17:43:18.348258    3966 ssh_runner.go:195] Run: which crictl
	I0814 17:43:18.350083    3966 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0814 17:43:18.363320    3966 start.go:579] Version:  0.1.0
	RuntimeName:  docker
	RuntimeVersion:  20.10.16
	RuntimeApiVersion:  1.41.0
	I0814 17:43:18.363385    3966 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I0814 17:43:18.379442    3966 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I0814 17:43:18.401502    3966 out.go:204] * Preparing Kubernetes v1.24.1 on Docker 20.10.16 ...
	I0814 17:43:18.401596    3966 ssh_runner.go:195] Run: grep 10.0.2.2	host.minikube.internal$ /etc/hosts
	I0814 17:43:18.403501    3966 kubeadm.go:883] updating cluster {Name:running-upgrade-987000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:50332 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName
:running-upgrade-987000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Di
sableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s} ...
	I0814 17:43:18.403558    3966 preload.go:131] Checking if preload exists for k8s version v1.24.1 and runtime docker
	I0814 17:43:18.403606    3966 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I0814 17:43:18.414813    3966 docker.go:685] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-apiserver:v1.24.1
	k8s.gcr.io/kube-proxy:v1.24.1
	k8s.gcr.io/kube-controller-manager:v1.24.1
	k8s.gcr.io/kube-scheduler:v1.24.1
	k8s.gcr.io/etcd:3.5.3-0
	k8s.gcr.io/pause:3.7
	k8s.gcr.io/coredns/coredns:v1.8.6
	k8s.gcr.io/pause:3.6
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I0814 17:43:18.414823    3966 docker.go:691] registry.k8s.io/kube-apiserver:v1.24.1 wasn't preloaded
	I0814 17:43:18.414873    3966 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I0814 17:43:18.418249    3966 ssh_runner.go:195] Run: which lz4
	I0814 17:43:18.419882    3966 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
	I0814 17:43:18.421272    3966 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/preloaded.tar.lz4': No such file or directory
	I0814 17:43:18.421297    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (359514331 bytes)
	I0814 17:43:19.543565    3966 docker.go:649] duration metric: took 1.123792166s to copy over tarball
	I0814 17:43:19.543626    3966 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
	I0814 17:43:20.621259    3966 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (1.077675375s)
	I0814 17:43:20.621273    3966 ssh_runner.go:146] rm: /preloaded.tar.lz4
	I0814 17:43:20.637061    3966 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I0814 17:43:20.640099    3966 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2523 bytes)
	I0814 17:43:20.645620    3966 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:43:20.735433    3966 ssh_runner.go:195] Run: sudo systemctl restart docker
	I0814 17:43:21.913445    3966 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.178045958s)
	I0814 17:43:21.913695    3966 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I0814 17:43:21.938831    3966 docker.go:685] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-apiserver:v1.24.1
	k8s.gcr.io/kube-proxy:v1.24.1
	k8s.gcr.io/kube-controller-manager:v1.24.1
	k8s.gcr.io/kube-scheduler:v1.24.1
	k8s.gcr.io/etcd:3.5.3-0
	k8s.gcr.io/pause:3.7
	k8s.gcr.io/coredns/coredns:v1.8.6
	<none>:<none>
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I0814 17:43:21.938840    3966 docker.go:691] registry.k8s.io/kube-apiserver:v1.24.1 wasn't preloaded
	I0814 17:43:21.938844    3966 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.24.1 registry.k8s.io/kube-controller-manager:v1.24.1 registry.k8s.io/kube-scheduler:v1.24.1 registry.k8s.io/kube-proxy:v1.24.1 registry.k8s.io/pause:3.7 registry.k8s.io/etcd:3.5.3-0 registry.k8s.io/coredns/coredns:v1.8.6 gcr.io/k8s-minikube/storage-provisioner:v5]
	I0814 17:43:21.942722    3966 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:43:21.944494    3966 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.24.1
	I0814 17:43:21.946281    3966 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:43:21.946314    3966 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.24.1
	I0814 17:43:21.948881    3966 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.24.1
	I0814 17:43:21.948875    3966 image.go:135] retrieving image: registry.k8s.io/etcd:3.5.3-0
	I0814 17:43:21.951064    3966 image.go:135] retrieving image: registry.k8s.io/pause:3.7
	I0814 17:43:21.951091    3966 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.24.1
	I0814 17:43:21.953344    3966 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.24.1
	I0814 17:43:21.953632    3966 image.go:178] daemon lookup for registry.k8s.io/etcd:3.5.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.3-0
	I0814 17:43:21.955266    3966 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.24.1
	I0814 17:43:21.955278    3966 image.go:178] daemon lookup for registry.k8s.io/pause:3.7: Error response from daemon: No such image: registry.k8s.io/pause:3.7
	I0814 17:43:21.956314    3966 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.24.1
	I0814 17:43:21.957020    3966 image.go:135] retrieving image: registry.k8s.io/coredns/coredns:v1.8.6
	I0814 17:43:21.958618    3966 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.24.1
	I0814 17:43:21.959745    3966 image.go:178] daemon lookup for registry.k8s.io/coredns/coredns:v1.8.6: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.8.6
	I0814 17:43:18.192455    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
	I0814 17:43:18.321398    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
	I0814 17:43:18.344110    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
	I0814 17:43:18.369226    3955 api_server.go:52] waiting for apiserver process to appear ...
	I0814 17:43:18.369322    3955 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0814 17:43:18.869474    3955 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0814 17:43:19.371343    3955 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0814 17:43:19.376120    3955 api_server.go:72] duration metric: took 1.006948291s to wait for apiserver process to appear ...
	I0814 17:43:19.376134    3955 api_server.go:88] waiting for apiserver healthz status ...
	I0814 17:43:19.376153    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:22.370497    3966 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.24.1
	I0814 17:43:22.377266    3966 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.24.1
	I0814 17:43:22.388165    3966 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/etcd:3.5.3-0
	I0814 17:43:22.395784    3966 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.24.1" needs transfer: "registry.k8s.io/kube-apiserver:v1.24.1" does not exist at hash "7c5896a75862a8bc252122185a929cec1393db2c525f6440137d4fbf46bbf6f9" in container runtime
	I0814 17:43:22.395820    3966 docker.go:337] Removing image: registry.k8s.io/kube-apiserver:v1.24.1
	I0814 17:43:22.395884    3966 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-apiserver:v1.24.1
	I0814 17:43:22.403113    3966 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.24.1" needs transfer: "registry.k8s.io/kube-proxy:v1.24.1" does not exist at hash "fcbd620bbac080b658602c597709b377cb2b3fec134a097a27f94cba9b2ed2fa" in container runtime
	I0814 17:43:22.403145    3966 docker.go:337] Removing image: registry.k8s.io/kube-proxy:v1.24.1
	I0814 17:43:22.403200    3966 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-proxy:v1.24.1
	I0814 17:43:22.406050    3966 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/pause:3.7
	I0814 17:43:22.411380    3966 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.24.1
	I0814 17:43:22.412646    3966 cache_images.go:116] "registry.k8s.io/etcd:3.5.3-0" needs transfer: "registry.k8s.io/etcd:3.5.3-0" does not exist at hash "a9a710bb96df080e6b9c720eb85dc5b832ff84abf77263548d74fedec6466a5a" in container runtime
	I0814 17:43:22.412669    3966 docker.go:337] Removing image: registry.k8s.io/etcd:3.5.3-0
	I0814 17:43:22.412702    3966 ssh_runner.go:195] Run: docker rmi registry.k8s.io/etcd:3.5.3-0
	I0814 17:43:22.430206    3966 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.1
	I0814 17:43:22.440041    3966 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.1
	I0814 17:43:22.442279    3966 cache_images.go:116] "registry.k8s.io/pause:3.7" needs transfer: "registry.k8s.io/pause:3.7" does not exist at hash "e5a475a0380575fb5df454b2e32bdec93e1ec0094d8a61e895b41567cb884550" in container runtime
	I0814 17:43:22.442313    3966 docker.go:337] Removing image: registry.k8s.io/pause:3.7
	I0814 17:43:22.442443    3966 ssh_runner.go:195] Run: docker rmi registry.k8s.io/pause:3.7
	I0814 17:43:22.444219    3966 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.24.1
	I0814 17:43:22.444774    3966 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.24.1" needs transfer: "registry.k8s.io/kube-scheduler:v1.24.1" does not exist at hash "000c19baf6bba51ff7ae5449f4c7a16d9190cef0263f58070dbf62cea9c4982f" in container runtime
	I0814 17:43:22.444823    3966 docker.go:337] Removing image: registry.k8s.io/kube-scheduler:v1.24.1
	I0814 17:43:22.444850    3966 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-scheduler:v1.24.1
	I0814 17:43:22.466135    3966 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.24.1" needs transfer: "registry.k8s.io/kube-controller-manager:v1.24.1" does not exist at hash "f61bbe9259d7caa580deb6c8e4bfd1780c7b5887efe3aa3adc7cc74f68a27c1b" in container runtime
	I0814 17:43:22.466160    3966 docker.go:337] Removing image: registry.k8s.io/kube-controller-manager:v1.24.1
	I0814 17:43:22.466209    3966 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-controller-manager:v1.24.1
	I0814 17:43:22.483110    3966 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0
	I0814 17:43:22.483219    3966 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/etcd_3.5.3-0
	I0814 17:43:22.483396    3966 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7
	I0814 17:43:22.483456    3966 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/pause_3.7
	I0814 17:43:22.484882    3966 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.24.1
	I0814 17:43:22.484921    3966 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.1
	I0814 17:43:22.486101    3966 ssh_runner.go:352] existence check for /var/lib/minikube/images/pause_3.7: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/pause_3.7: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/images/pause_3.7': No such file or directory
	I0814 17:43:22.486114    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7 --> /var/lib/minikube/images/pause_3.7 (268288 bytes)
	I0814 17:43:22.486361    3966 ssh_runner.go:352] existence check for /var/lib/minikube/images/etcd_3.5.3-0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/etcd_3.5.3-0: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/images/etcd_3.5.3-0': No such file or directory
	I0814 17:43:22.486373    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0 --> /var/lib/minikube/images/etcd_3.5.3-0 (81117184 bytes)
	W0814 17:43:22.491077    3966 image.go:283] image registry.k8s.io/coredns/coredns:v1.8.6 arch mismatch: want arm64 got amd64. fixing
	I0814 17:43:22.491203    3966 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/coredns/coredns:v1.8.6
	I0814 17:43:22.496529    3966 docker.go:304] Loading image: /var/lib/minikube/images/pause_3.7
	I0814 17:43:22.496542    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/pause_3.7 | docker load"
	W0814 17:43:22.556132    3966 image.go:283] image gcr.io/k8s-minikube/storage-provisioner:v5 arch mismatch: want arm64 got amd64. fixing
	I0814 17:43:22.556242    3966 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:43:22.563386    3966 cache_images.go:321] Transferred and loaded /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7 from cache
	I0814 17:43:22.563397    3966 cache_images.go:116] "registry.k8s.io/coredns/coredns:v1.8.6" needs transfer: "registry.k8s.io/coredns/coredns:v1.8.6" does not exist at hash "6af7f860a8197bfa3fdb7dec2061aa33870253e87a1e91c492d55b8a4fd38d14" in container runtime
	I0814 17:43:22.563416    3966 docker.go:337] Removing image: registry.k8s.io/coredns/coredns:v1.8.6
	I0814 17:43:22.563470    3966 ssh_runner.go:195] Run: docker rmi registry.k8s.io/coredns/coredns:v1.8.6
	I0814 17:43:22.582442    3966 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "66749159455b3f08c8318fe0233122f54d0f5889f9c5fdfb73c3fd9d99895b51" in container runtime
	I0814 17:43:22.582477    3966 docker.go:337] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:43:22.582535    3966 ssh_runner.go:195] Run: docker rmi gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:43:22.614139    3966 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6
	I0814 17:43:22.614255    3966 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/coredns_v1.8.6
	I0814 17:43:22.627948    3966 ssh_runner.go:352] existence check for /var/lib/minikube/images/coredns_v1.8.6: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/coredns_v1.8.6: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/images/coredns_v1.8.6': No such file or directory
	I0814 17:43:22.627995    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6 --> /var/lib/minikube/images/coredns_v1.8.6 (12318720 bytes)
	I0814 17:43:22.724609    3966 docker.go:304] Loading image: /var/lib/minikube/images/coredns_v1.8.6
	I0814 17:43:22.724624    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/coredns_v1.8.6 | docker load"
	I0814 17:43:22.824717    3966 cache_images.go:321] Transferred and loaded /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6 from cache
	I0814 17:43:22.843931    3966 docker.go:304] Loading image: /var/lib/minikube/images/etcd_3.5.3-0
	I0814 17:43:22.843945    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/etcd_3.5.3-0 | docker load"
	I0814 17:43:22.974405    3966 cache_images.go:321] Transferred and loaded /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0 from cache
	I0814 17:43:22.974441    3966 cache_images.go:92] duration metric: took 1.035640667s to LoadCachedImages
	W0814 17:43:22.974485    3966 out.go:239] X Unable to load cached images: LoadCachedImages: stat /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.1: no such file or directory
	I0814 17:43:22.974492    3966 kubeadm.go:934] updating node { 10.0.2.15 8443 v1.24.1 docker true true} ...
	I0814 17:43:22.974549    3966 kubeadm.go:946] kubelet [Unit]
	Wants=docker.socket
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=running-upgrade-987000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=10.0.2.15
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.1 ClusterName:running-upgrade-987000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0814 17:43:22.974610    3966 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
	I0814 17:43:22.988250    3966 cni.go:84] Creating CNI manager for ""
	I0814 17:43:22.988261    3966 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:43:22.988268    3966 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0814 17:43:22.988277    3966 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:10.0.2.15 APIServerPort:8443 KubernetesVersion:v1.24.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:running-upgrade-987000 NodeName:running-upgrade-987000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "10.0.2.15"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:10.0.2.15 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/
etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0814 17:43:22.988344    3966 kubeadm.go:187] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 10.0.2.15
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/cri-dockerd.sock
	  name: "running-upgrade-987000"
	  kubeletExtraArgs:
	    node-ip: 10.0.2.15
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "10.0.2.15"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.1
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0814 17:43:22.988405    3966 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.1
	I0814 17:43:22.991202    3966 binaries.go:44] Found k8s binaries, skipping transfer
	I0814 17:43:22.991228    3966 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0814 17:43:22.994548    3966 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (380 bytes)
	I0814 17:43:22.999765    3966 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0814 17:43:23.004742    3966 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2096 bytes)
	I0814 17:43:23.010432    3966 ssh_runner.go:195] Run: grep 10.0.2.15	control-plane.minikube.internal$ /etc/hosts
	I0814 17:43:23.011815    3966 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:43:23.100205    3966 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0814 17:43:23.105743    3966 certs.go:68] Setting up /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000 for IP: 10.0.2.15
	I0814 17:43:23.105753    3966 certs.go:194] generating shared ca certs ...
	I0814 17:43:23.105761    3966 certs.go:226] acquiring lock for ca certs: {Name:mk9c8185fea6e56aae9b82059113ab288e9964dd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:43:23.105904    3966 certs.go:235] skipping valid "minikubeCA" ca cert: /Users/jenkins/minikube-integration/19443-949/.minikube/ca.key
	I0814 17:43:23.105947    3966 certs.go:235] skipping valid "proxyClientCA" ca cert: /Users/jenkins/minikube-integration/19443-949/.minikube/proxy-client-ca.key
	I0814 17:43:23.105952    3966 certs.go:256] generating profile certs ...
	I0814 17:43:23.106026    3966 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/client.key
	I0814 17:43:23.106043    3966 certs.go:363] generating signed profile cert for "minikube": /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/apiserver.key.da6ee18f
	I0814 17:43:23.106053    3966 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/apiserver.crt.da6ee18f with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 10.0.2.15]
	I0814 17:43:23.154642    3966 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/apiserver.crt.da6ee18f ...
	I0814 17:43:23.154653    3966 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/apiserver.crt.da6ee18f: {Name:mk6ea616718b57f3fae48014281a3095b9e7e01a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:43:23.154926    3966 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/apiserver.key.da6ee18f ...
	I0814 17:43:23.154931    3966 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/apiserver.key.da6ee18f: {Name:mk2d63e654768c252419d794a1e039db650efc47 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:43:23.155063    3966 certs.go:381] copying /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/apiserver.crt.da6ee18f -> /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/apiserver.crt
	I0814 17:43:23.155199    3966 certs.go:385] copying /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/apiserver.key.da6ee18f -> /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/apiserver.key
	I0814 17:43:23.155341    3966 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/proxy-client.key
	I0814 17:43:23.155469    3966 certs.go:484] found cert: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/1404.pem (1338 bytes)
	W0814 17:43:23.155491    3966 certs.go:480] ignoring /Users/jenkins/minikube-integration/19443-949/.minikube/certs/1404_empty.pem, impossibly tiny 0 bytes
	I0814 17:43:23.155495    3966 certs.go:484] found cert: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca-key.pem (1675 bytes)
	I0814 17:43:23.155514    3966 certs.go:484] found cert: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem (1078 bytes)
	I0814 17:43:23.155531    3966 certs.go:484] found cert: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem (1123 bytes)
	I0814 17:43:23.155554    3966 certs.go:484] found cert: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/key.pem (1679 bytes)
	I0814 17:43:23.155594    3966 certs.go:484] found cert: /Users/jenkins/minikube-integration/19443-949/.minikube/files/etc/ssl/certs/14042.pem (1708 bytes)
	I0814 17:43:23.155953    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0814 17:43:23.163457    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0814 17:43:23.170501    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0814 17:43:23.178238    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0814 17:43:23.185502    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
	I0814 17:43:23.192252    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0814 17:43:23.199447    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0814 17:43:23.206753    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0814 17:43:23.214311    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0814 17:43:23.221247    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/certs/1404.pem --> /usr/share/ca-certificates/1404.pem (1338 bytes)
	I0814 17:43:23.228279    3966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/files/etc/ssl/certs/14042.pem --> /usr/share/ca-certificates/14042.pem (1708 bytes)
	I0814 17:43:23.235283    3966 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0814 17:43:23.240413    3966 ssh_runner.go:195] Run: openssl version
	I0814 17:43:23.242259    3966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14042.pem && ln -fs /usr/share/ca-certificates/14042.pem /etc/ssl/certs/14042.pem"
	I0814 17:43:23.245083    3966 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14042.pem
	I0814 17:43:23.246831    3966 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 15 00:12 /usr/share/ca-certificates/14042.pem
	I0814 17:43:23.246858    3966 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14042.pem
	I0814 17:43:23.248843    3966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14042.pem /etc/ssl/certs/3ec20f2e.0"
	I0814 17:43:23.251606    3966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0814 17:43:23.254954    3966 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0814 17:43:23.256419    3966 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 15 00:05 /usr/share/ca-certificates/minikubeCA.pem
	I0814 17:43:23.256438    3966 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0814 17:43:23.258316    3966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0814 17:43:23.261048    3966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1404.pem && ln -fs /usr/share/ca-certificates/1404.pem /etc/ssl/certs/1404.pem"
	I0814 17:43:23.264013    3966 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1404.pem
	I0814 17:43:23.265754    3966 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 15 00:12 /usr/share/ca-certificates/1404.pem
	I0814 17:43:23.265773    3966 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1404.pem
	I0814 17:43:23.267447    3966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1404.pem /etc/ssl/certs/51391683.0"
	I0814 17:43:23.270598    3966 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0814 17:43:23.272151    3966 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0814 17:43:23.274004    3966 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0814 17:43:23.275793    3966 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0814 17:43:23.277764    3966 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0814 17:43:23.280449    3966 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0814 17:43:23.282936    3966 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0814 17:43:23.285088    3966 kubeadm.go:392] StartCluster: {Name:running-upgrade-987000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:50332 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:ru
nning-upgrade-987000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disab
leOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s}
	I0814 17:43:23.285163    3966 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I0814 17:43:23.298125    3966 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0814 17:43:23.301697    3966 kubeadm.go:408] found existing configuration files, will attempt cluster restart
	I0814 17:43:23.301706    3966 kubeadm.go:593] restartPrimaryControlPlane start ...
	I0814 17:43:23.301738    3966 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0814 17:43:23.306387    3966 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0814 17:43:23.306690    3966 kubeconfig.go:47] verify endpoint returned: get endpoint: "running-upgrade-987000" does not appear in /Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:43:23.306790    3966 kubeconfig.go:62] /Users/jenkins/minikube-integration/19443-949/kubeconfig needs updating (will repair): [kubeconfig missing "running-upgrade-987000" cluster setting kubeconfig missing "running-upgrade-987000" context setting]
	I0814 17:43:23.306976    3966 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/kubeconfig: {Name:mke777513f7f5736c6804680b89db76bd98a8ac2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:43:23.307450    3966 kapi.go:59] client config for running-upgrade-987000: &rest.Config{Host:"https://10.0.2.15:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/client.key", CAFile:"/Users/jenkins/minikube-integration/19443-949/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8
(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x103eb0f90), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0814 17:43:23.307782    3966 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0814 17:43:23.311344    3966 kubeadm.go:640] detected kubeadm config drift (will reconfigure cluster from new /var/tmp/minikube/kubeadm.yaml):
	-- stdout --
	--- /var/tmp/minikube/kubeadm.yaml
	+++ /var/tmp/minikube/kubeadm.yaml.new
	@@ -11,7 +11,7 @@
	       - signing
	       - authentication
	 nodeRegistration:
	-  criSocket: /var/run/cri-dockerd.sock
	+  criSocket: unix:///var/run/cri-dockerd.sock
	   name: "running-upgrade-987000"
	   kubeletExtraArgs:
	     node-ip: 10.0.2.15
	@@ -49,7 +49,9 @@
	 authentication:
	   x509:
	     clientCAFile: /var/lib/minikube/certs/ca.crt
	-cgroupDriver: systemd
	+cgroupDriver: cgroupfs
	+hairpinMode: hairpin-veth
	+runtimeRequestTimeout: 15m
	 clusterDomain: "cluster.local"
	 # disable disk resource management by default
	 imageGCHighThresholdPercent: 100
	
	-- /stdout --
	I0814 17:43:23.311351    3966 kubeadm.go:1160] stopping kube-system containers ...
	I0814 17:43:23.311395    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I0814 17:43:23.329538    3966 docker.go:483] Stopping containers: [dd96d4eb3b67 9671e64239eb 1ab4864a2af9 29670631474a 55491ceb3162 9caa6cc21585 de3ef9e2b2d4 3fdb416cf0f2 5ad71bd0d968 cd8cd813fdd5 6e0da723e642 a751dc583108 af68cbe724cf 380e3572dce2 5cedaf3c3e7d 915af3c05d85 ad789586937d 8820d0cfb35a fae89c628969 d3b7f45f9c5a 01f8fc3ed27f 5fd5c2e62fb4 92e378181829]
	I0814 17:43:23.329615    3966 ssh_runner.go:195] Run: docker stop dd96d4eb3b67 9671e64239eb 1ab4864a2af9 29670631474a 55491ceb3162 9caa6cc21585 de3ef9e2b2d4 3fdb416cf0f2 5ad71bd0d968 cd8cd813fdd5 6e0da723e642 a751dc583108 af68cbe724cf 380e3572dce2 5cedaf3c3e7d 915af3c05d85 ad789586937d 8820d0cfb35a fae89c628969 d3b7f45f9c5a 01f8fc3ed27f 5fd5c2e62fb4 92e378181829
	I0814 17:43:23.342729    3966 ssh_runner.go:195] Run: sudo systemctl stop kubelet
	I0814 17:43:23.436233    3966 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0814 17:43:23.440000    3966 kubeadm.go:157] found existing configuration files:
	-rw------- 1 root root 5639 Aug 15 00:42 /etc/kubernetes/admin.conf
	-rw------- 1 root root 5653 Aug 15 00:42 /etc/kubernetes/controller-manager.conf
	-rw------- 1 root root 2027 Aug 15 00:42 /etc/kubernetes/kubelet.conf
	-rw------- 1 root root 5597 Aug 15 00:42 /etc/kubernetes/scheduler.conf
	
	I0814 17:43:23.440031    3966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/admin.conf
	I0814 17:43:23.443250    3966 kubeadm.go:163] "https://control-plane.minikube.internal:50332" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/admin.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0814 17:43:23.443274    3966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I0814 17:43:23.446578    3966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/kubelet.conf
	I0814 17:43:23.449458    3966 kubeadm.go:163] "https://control-plane.minikube.internal:50332" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/kubelet.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0814 17:43:23.449503    3966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I0814 17:43:23.452610    3966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/controller-manager.conf
	I0814 17:43:23.455817    3966 kubeadm.go:163] "https://control-plane.minikube.internal:50332" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/controller-manager.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0814 17:43:23.455847    3966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0814 17:43:23.458950    3966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/scheduler.conf
	I0814 17:43:23.461725    3966 kubeadm.go:163] "https://control-plane.minikube.internal:50332" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/scheduler.conf: Process exited with status 1
	stdout:
	
	stderr:
	I0814 17:43:23.461750    3966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0814 17:43:23.464297    3966 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0814 17:43:23.467745    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
	I0814 17:43:23.510061    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
	I0814 17:43:24.064466    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
	I0814 17:43:24.277384    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
	I0814 17:43:24.306310    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
	I0814 17:43:24.333327    3966 api_server.go:52] waiting for apiserver process to appear ...
	I0814 17:43:24.333412    3966 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0814 17:43:24.833784    3966 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0814 17:43:25.335535    3966 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0814 17:43:25.835165    3966 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0814 17:43:26.335370    3966 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0814 17:43:26.835338    3966 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0814 17:43:26.840000    3966 api_server.go:72] duration metric: took 2.506786041s to wait for apiserver process to appear ...
	I0814 17:43:26.840008    3966 api_server.go:88] waiting for apiserver healthz status ...
	I0814 17:43:26.840022    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:24.377998    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:24.378032    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:31.841927    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:31.841968    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:29.378056    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:29.378091    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:36.842041    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:36.842068    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:34.378354    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:34.378395    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:41.842233    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:41.842313    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:39.378803    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:39.378887    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:46.842602    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:46.842654    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:44.379516    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:44.379587    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:51.843135    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:51.843181    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:49.380613    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:49.380688    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:56.843829    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:56.843887    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:54.383014    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:54.383077    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:01.844909    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:01.844957    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:59.385039    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:59.385170    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:06.845503    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:06.845579    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:04.387718    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:04.387786    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:11.847638    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:11.847743    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:09.388582    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:09.388662    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:16.849876    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:16.849956    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:14.391108    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:14.391161    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:21.852322    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:21.852361    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:19.393393    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:19.393656    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:44:19.412467    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:44:19.412566    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:44:19.425530    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:44:19.425612    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:44:19.436697    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:44:19.436774    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:44:19.447787    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:44:19.447865    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:44:19.458137    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:44:19.458206    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:44:19.468287    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:44:19.468358    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:44:19.478421    3955 logs.go:276] 0 containers: []
	W0814 17:44:19.478431    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:44:19.478487    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:44:19.489043    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:44:19.489063    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:44:19.489069    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:44:19.568979    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:44:19.568992    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:44:19.584197    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:44:19.584211    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:44:19.611275    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:44:19.611288    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:44:19.622958    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:44:19.622970    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:44:19.634915    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:44:19.634929    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:44:19.650394    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:44:19.650408    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:44:19.654576    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:44:19.654584    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:44:19.672003    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:44:19.672016    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:44:19.684553    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:44:19.684572    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:44:19.696088    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:44:19.696100    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:44:19.713934    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:44:19.713947    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:44:19.725385    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:44:19.725398    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:44:19.737466    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:44:19.737477    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:44:19.777249    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:44:19.777261    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:44:19.803974    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:44:19.803987    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:44:19.818046    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:44:19.818057    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:44:22.331322    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:26.854533    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:26.854970    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:44:26.888556    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:44:26.888686    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:44:26.907912    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:44:26.908007    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:44:26.922616    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:44:26.922698    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:44:26.935323    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:44:26.935396    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:44:26.946226    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:44:26.946299    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:44:26.956266    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:44:26.956351    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:44:26.966882    3966 logs.go:276] 0 containers: []
	W0814 17:44:26.966893    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:44:26.966953    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:44:26.977856    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:44:26.977873    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:44:26.977878    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:44:26.989806    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:44:26.989816    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:44:27.057891    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:44:27.057902    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:44:27.083472    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:44:27.083486    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:44:27.100392    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:44:27.100403    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:44:27.115652    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:44:27.115667    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:44:27.136763    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:44:27.136774    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:44:27.179529    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:44:27.179544    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:44:27.191039    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:44:27.191048    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:44:27.208205    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:44:27.208221    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:44:27.221253    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:44:27.221267    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:44:27.234941    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:44:27.234952    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:44:27.250498    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:44:27.250529    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:44:27.267535    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:44:27.267546    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:44:27.333587    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:27.333680    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:44:27.345328    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:44:27.345402    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:44:27.356000    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:44:27.356081    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:44:27.366625    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:44:27.366690    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:44:27.377528    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:44:27.377599    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:44:27.387901    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:44:27.387966    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:44:27.398857    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:44:27.398922    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:44:27.409636    3955 logs.go:276] 0 containers: []
	W0814 17:44:27.409647    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:44:27.409709    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:44:27.420405    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:44:27.420421    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:44:27.420428    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:44:27.434709    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:44:27.434722    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:44:27.449791    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:44:27.449803    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:44:27.461017    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:44:27.461029    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:44:27.475678    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:44:27.475690    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:44:27.487384    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:44:27.487394    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:44:27.504573    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:44:27.504582    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:44:27.518482    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:44:27.518496    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:44:27.529970    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:44:27.529980    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:44:27.567613    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:44:27.567623    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:44:27.592308    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:44:27.592315    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:44:27.630234    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:44:27.630242    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:44:27.648706    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:44:27.648716    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:44:27.663228    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:44:27.663239    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:44:27.677287    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:44:27.677299    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:44:27.681497    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:44:27.681503    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:44:27.705931    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:44:27.705943    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:44:27.279010    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:44:27.279022    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:44:27.290806    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:44:27.290819    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:44:27.315922    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:44:27.315929    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:44:27.319918    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:44:27.319923    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:44:27.333021    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:44:27.333035    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:44:29.846118    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:30.219740    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:34.847770    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:34.848206    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:44:34.904346    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:44:34.904432    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:44:34.924364    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:44:34.924449    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:44:34.947145    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:44:34.947212    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:44:34.957738    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:44:34.957796    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:44:34.969258    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:44:34.969329    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:44:34.980228    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:44:34.980297    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:44:34.990909    3966 logs.go:276] 0 containers: []
	W0814 17:44:34.990922    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:44:34.990993    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:44:35.001639    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:44:35.001659    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:44:35.001666    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:44:35.045149    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:44:35.045165    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:44:35.064144    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:44:35.064158    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:44:35.075682    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:44:35.075693    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:44:35.087034    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:44:35.087048    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:44:35.099507    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:44:35.099523    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:44:35.116743    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:44:35.116755    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:44:35.138298    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:44:35.138314    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:44:35.154260    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:44:35.154273    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:44:35.166082    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:44:35.166092    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:44:35.177345    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:44:35.177357    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:44:35.188772    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:44:35.188781    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:44:35.199815    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:44:35.199830    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:44:35.204130    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:44:35.204136    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:44:35.243672    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:44:35.243684    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:44:35.259561    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:44:35.259571    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:44:35.273029    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:44:35.273041    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:44:35.286003    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:44:35.286016    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:44:35.304019    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:44:35.304036    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:44:35.221826    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:35.221910    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:44:35.233355    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:44:35.233436    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:44:35.244913    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:44:35.244981    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:44:35.256604    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:44:35.256681    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:44:35.269526    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:44:35.269600    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:44:35.281072    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:44:35.281146    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:44:35.293779    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:44:35.293879    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:44:35.304376    3955 logs.go:276] 0 containers: []
	W0814 17:44:35.304386    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:44:35.304452    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:44:35.315231    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:44:35.315252    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:44:35.315258    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:44:35.327477    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:44:35.327488    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:44:35.342804    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:44:35.342817    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:44:35.367638    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:44:35.367652    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:44:35.372146    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:44:35.372153    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:44:35.410326    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:44:35.410339    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:44:35.424235    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:44:35.424245    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:44:35.435661    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:44:35.435672    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:44:35.447406    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:44:35.447418    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:44:35.459931    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:44:35.459941    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:44:35.483735    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:44:35.483744    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:44:35.520316    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:44:35.520325    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:44:35.533276    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:44:35.533287    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:44:35.546944    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:44:35.546955    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:44:35.558655    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:44:35.558670    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:44:35.576080    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:44:35.576092    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:44:35.587222    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:44:35.587234    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:44:37.834782    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:38.103645    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:42.836523    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:42.836706    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:44:42.855557    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:44:42.855654    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:44:42.869540    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:44:42.869614    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:44:42.882616    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:44:42.882682    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:44:42.893585    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:44:42.893651    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:44:42.904511    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:44:42.904578    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:44:42.915386    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:44:42.915459    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:44:42.927114    3966 logs.go:276] 0 containers: []
	W0814 17:44:42.927126    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:44:42.927184    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:44:42.941842    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:44:42.941858    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:44:42.941863    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:44:42.963709    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:44:42.963720    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:44:42.976981    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:44:42.976991    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:44:42.994069    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:44:42.994080    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:44:43.037985    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:44:43.037995    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:44:43.049559    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:44:43.049570    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:44:43.061119    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:44:43.061130    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:44:43.078285    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:44:43.078295    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:44:43.091293    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:44:43.091305    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:44:43.096393    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:44:43.096400    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:44:43.136975    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:44:43.136988    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:44:43.154890    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:44:43.154909    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:44:43.167078    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:44:43.167094    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:44:43.196039    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:44:43.196052    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:44:43.211695    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:44:43.211711    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:44:43.224151    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:44:43.224165    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:44:43.244626    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:44:43.244637    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:44:43.257054    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:44:43.257067    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:44:43.270456    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:44:43.270469    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:44:45.786893    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:43.105500    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:43.105651    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:44:43.116790    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:44:43.116860    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:44:43.128104    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:44:43.128175    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:44:43.145162    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:44:43.145232    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:44:43.156047    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:44:43.156114    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:44:43.167147    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:44:43.167205    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:44:43.178369    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:44:43.178429    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:44:43.189082    3955 logs.go:276] 0 containers: []
	W0814 17:44:43.189094    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:44:43.189155    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:44:43.200000    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:44:43.200019    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:44:43.200025    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:44:43.213126    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:44:43.213133    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:44:43.228985    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:44:43.229002    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:44:43.245389    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:44:43.245402    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:44:43.258307    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:44:43.258316    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:44:43.276588    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:44:43.276599    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:44:43.301507    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:44:43.301519    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:44:43.342066    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:44:43.342078    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:44:43.357616    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:44:43.357627    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:44:43.369529    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:44:43.369541    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:44:43.395056    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:44:43.395065    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:44:43.420124    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:44:43.420135    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:44:43.431928    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:44:43.431939    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:44:43.436086    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:44:43.436093    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:44:43.471600    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:44:43.471612    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:44:43.485875    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:44:43.485885    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:44:43.497213    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:44:43.497223    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:44:46.010780    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:50.789115    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:50.789402    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:44:50.816943    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:44:50.817069    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:44:50.834829    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:44:50.834908    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:44:50.849928    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:44:50.850005    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:44:50.865328    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:44:50.865400    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:44:50.875984    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:44:50.876049    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:44:50.890684    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:44:50.890756    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:44:50.900908    3966 logs.go:276] 0 containers: []
	W0814 17:44:50.900922    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:44:50.900975    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:44:50.911589    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:44:50.911606    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:44:50.911611    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:44:50.928530    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:44:50.928541    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:44:50.939854    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:44:50.939867    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:44:50.952616    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:44:50.952626    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:44:50.978022    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:44:50.978032    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:44:50.992558    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:44:50.992569    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:44:51.008753    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:44:51.008764    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:44:51.023626    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:44:51.023638    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:44:51.035335    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:44:51.035349    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:44:51.047262    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:44:51.047275    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:44:51.092039    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:44:51.092054    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:44:51.106820    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:44:51.106835    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:44:51.121136    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:44:51.121150    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:44:51.135947    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:44:51.135959    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:44:51.156941    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:44:51.156953    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:44:51.161736    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:44:51.161748    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:44:51.199220    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:44:51.199233    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:44:51.215548    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:44:51.215561    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:44:51.230363    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:44:51.230375    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:44:51.013053    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:51.013133    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:44:51.024544    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:44:51.024617    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:44:51.036497    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:44:51.036568    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:44:51.051528    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:44:51.051602    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:44:51.062956    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:44:51.063030    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:44:51.073205    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:44:51.073273    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:44:51.083782    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:44:51.083852    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:44:51.096243    3955 logs.go:276] 0 containers: []
	W0814 17:44:51.096253    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:44:51.096317    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:44:51.107912    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:44:51.107928    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:44:51.107933    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:44:51.123753    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:44:51.123764    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:44:51.139099    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:44:51.139109    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:44:51.151260    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:44:51.151271    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:44:51.163809    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:44:51.163818    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:44:51.168419    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:44:51.168431    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:44:51.183300    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:44:51.183316    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:44:51.196547    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:44:51.196559    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:44:51.211733    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:44:51.211745    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:44:51.227096    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:44:51.227108    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:44:51.265341    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:44:51.265352    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:44:51.294483    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:44:51.294493    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:44:51.309171    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:44:51.309182    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:44:51.327418    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:44:51.327428    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:44:51.352351    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:44:51.352359    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:44:51.387023    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:44:51.387034    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:44:51.400810    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:44:51.400822    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:44:53.745547    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:53.914850    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:58.747778    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:58.747947    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:44:58.760546    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:44:58.760624    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:44:58.771597    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:44:58.771672    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:44:58.782262    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:44:58.782336    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:44:58.793770    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:44:58.793848    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:44:58.804177    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:44:58.804243    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:44:58.814566    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:44:58.814633    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:44:58.828077    3966 logs.go:276] 0 containers: []
	W0814 17:44:58.828089    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:44:58.828142    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:44:58.838459    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:44:58.838482    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:44:58.838488    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:44:58.879791    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:44:58.879801    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:44:58.893774    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:44:58.893788    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:44:58.908485    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:44:58.908498    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:44:58.920441    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:44:58.920452    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:44:58.938320    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:44:58.938333    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:44:58.950955    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:44:58.950970    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:44:58.979163    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:44:58.979177    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:44:58.984360    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:44:58.984373    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:44:59.005608    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:44:59.005623    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:44:59.018313    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:44:59.018325    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:44:59.030156    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:44:59.030168    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:44:59.042377    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:44:59.042388    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:44:59.054452    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:44:59.054464    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:44:59.092776    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:44:59.092789    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:44:59.108081    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:44:59.108098    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:44:59.126288    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:44:59.126301    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:44:59.161523    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:44:59.161538    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:44:59.179782    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:44:59.179795    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:01.701868    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:58.916978    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:58.917059    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:44:58.930978    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:44:58.931054    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:44:58.945675    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:44:58.945750    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:44:58.957424    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:44:58.957491    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:44:58.968238    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:44:58.968311    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:44:58.978660    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:44:58.978725    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:44:58.990363    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:44:58.990438    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:44:59.001327    3955 logs.go:276] 0 containers: []
	W0814 17:44:59.001338    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:44:59.001398    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:44:59.013317    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:44:59.013335    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:44:59.013341    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:44:59.052052    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:44:59.052071    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:44:59.067433    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:44:59.067444    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:44:59.080091    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:44:59.080102    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:44:59.092048    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:44:59.092059    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:44:59.096895    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:44:59.096907    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:44:59.137205    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:44:59.137218    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:44:59.152043    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:44:59.152062    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:44:59.165926    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:44:59.165945    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:44:59.185317    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:44:59.185337    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:44:59.206744    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:44:59.206758    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:44:59.220690    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:44:59.220700    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:44:59.231623    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:44:59.231633    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:44:59.243483    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:44:59.243494    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:44:59.255182    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:44:59.255194    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:44:59.280105    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:44:59.280115    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:44:59.291666    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:44:59.291676    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:01.818910    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:06.702490    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:06.702642    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:06.714149    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:45:06.714230    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:06.725280    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:45:06.725352    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:06.735895    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:45:06.735971    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:06.746606    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:45:06.746677    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:06.757183    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:45:06.757247    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:06.770921    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:45:06.770998    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:06.781859    3966 logs.go:276] 0 containers: []
	W0814 17:45:06.781873    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:06.781932    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:06.792901    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:45:06.792919    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:45:06.792924    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:45:06.804326    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:45:06.804342    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:45:06.815324    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:45:06.815338    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:45:06.826910    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:45:06.826922    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:45:06.842346    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:45:06.842362    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:45:06.857146    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:45:06.857155    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:45:06.869860    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:45:06.869873    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:45:06.882267    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:45:06.882279    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:45:06.894782    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:06.894793    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:06.920699    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:45:06.920710    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:45:06.935730    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:45:06.935740    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:45:06.948268    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:45:06.948280    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:45:06.965180    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:45:06.965188    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:45:06.985756    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:45:06.985768    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:45:07.009673    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:07.009681    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:07.055685    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:07.055699    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:07.061034    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:07.061046    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:07.099530    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:45:07.099542    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:45:07.113538    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:45:07.113551    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:06.821202    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:06.821354    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:06.832925    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:45:06.832996    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:06.844388    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:45:06.844458    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:06.855514    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:45:06.855601    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:06.867371    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:45:06.867445    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:06.879248    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:45:06.879323    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:06.890634    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:45:06.890708    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:06.905990    3955 logs.go:276] 0 containers: []
	W0814 17:45:06.906000    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:06.906061    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:06.916603    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:45:06.916620    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:45:06.916627    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:45:06.934920    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:06.934931    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:06.962389    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:06.962410    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:07.003333    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:07.003356    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:07.008066    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:45:07.008074    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:45:07.023285    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:45:07.023296    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:45:07.035432    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:45:07.035443    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:45:07.057307    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:45:07.057316    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:45:07.069842    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:45:07.069854    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:45:07.084495    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:45:07.084512    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:45:07.096704    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:45:07.096716    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:45:07.111892    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:45:07.111906    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:45:07.124596    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:45:07.124608    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:45:07.136761    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:45:07.136776    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:45:07.148819    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:45:07.148834    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:07.161652    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:07.161663    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:07.197968    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:45:07.197984    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:45:09.629063    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:09.724819    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:14.631258    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:14.631403    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:14.643288    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:45:14.643369    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:14.654030    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:45:14.654104    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:14.665524    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:45:14.665602    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:14.676767    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:45:14.676839    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:14.687692    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:45:14.687760    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:14.698454    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:45:14.698530    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:14.708323    3966 logs.go:276] 0 containers: []
	W0814 17:45:14.708335    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:14.708394    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:14.718465    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:45:14.718480    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:45:14.718485    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:45:14.733064    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:45:14.733080    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:45:14.751826    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:14.751838    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:14.779173    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:45:14.779190    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:14.792508    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:14.792520    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:14.797293    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:45:14.797306    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:45:14.809646    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:45:14.809660    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:45:14.821615    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:45:14.821630    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:45:14.836604    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:45:14.836619    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:45:14.848982    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:45:14.848993    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:45:14.861221    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:45:14.861233    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:45:14.879717    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:45:14.879730    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:45:14.891768    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:45:14.891779    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:45:14.903267    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:14.903277    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:14.948162    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:45:14.948176    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:45:14.962216    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:45:14.962227    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:45:14.976901    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:45:14.976916    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:45:14.991565    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:45:14.991578    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:45:15.003846    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:15.003859    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:14.726938    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:14.727023    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:14.738328    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:45:14.738406    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:14.752940    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:45:14.753008    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:14.764339    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:45:14.764404    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:14.775879    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:45:14.775954    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:14.787728    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:45:14.787805    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:14.799680    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:45:14.799755    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:14.811082    3955 logs.go:276] 0 containers: []
	W0814 17:45:14.811090    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:14.811152    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:14.822507    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:45:14.822524    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:14.822530    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:14.861774    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:45:14.861783    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:45:14.880657    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:45:14.880666    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:45:14.903509    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:45:14.903522    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:45:14.919120    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:45:14.919132    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:14.931510    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:14.931520    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:14.969837    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:45:14.969850    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:45:14.985191    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:45:14.985206    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:45:14.998107    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:45:14.998120    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:45:15.018839    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:45:15.018855    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:45:15.030924    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:15.030936    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:15.035538    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:45:15.035550    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:45:15.048929    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:45:15.048939    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:45:15.061688    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:45:15.061701    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:45:15.073439    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:15.073452    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:15.098722    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:45:15.098731    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:45:15.123845    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:45:15.123857    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:45:17.643061    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:17.549790    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:22.643178    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:22.643226    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:22.656050    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:45:22.656102    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:22.672036    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:45:22.672111    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:22.685477    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:45:22.685542    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:22.698311    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:45:22.698383    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:22.713020    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:45:22.713086    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:22.725090    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:45:22.725164    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:22.735816    3955 logs.go:276] 0 containers: []
	W0814 17:45:22.735829    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:22.735888    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:22.748245    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:45:22.748265    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:22.748270    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:22.784091    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:45:22.784100    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:45:22.798120    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:45:22.798137    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:45:22.809860    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:22.809873    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:22.836061    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:22.836070    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:22.840726    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:45:22.840737    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:45:22.856092    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:45:22.856101    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:45:22.868326    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:45:22.868335    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:45:22.552087    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:22.552334    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:22.582837    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:45:22.582955    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:22.601284    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:45:22.601369    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:22.615654    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:45:22.615733    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:22.627854    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:45:22.627920    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:22.643030    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:45:22.643100    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:22.654711    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:45:22.654780    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:22.665861    3966 logs.go:276] 0 containers: []
	W0814 17:45:22.665873    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:22.665931    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:22.681193    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:45:22.681208    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:45:22.681214    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:45:22.694400    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:45:22.694415    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:45:22.713443    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:45:22.713453    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:45:22.725883    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:45:22.725892    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:45:22.738267    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:22.738283    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:22.782923    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:22.782937    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:22.821491    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:45:22.821503    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:45:22.833375    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:45:22.833388    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:45:22.854861    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:45:22.854873    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:45:22.867213    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:45:22.867224    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:45:22.879358    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:22.879370    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:22.904712    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:45:22.904722    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:45:22.922063    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:45:22.922075    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:45:22.940459    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:45:22.940471    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:22.953466    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:22.953481    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:22.958497    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:45:22.958504    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:45:22.973379    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:45:22.973391    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:45:22.989333    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:45:22.989346    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:45:23.002128    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:45:23.002141    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:45:25.517521    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:22.891038    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:45:22.891052    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:22.903505    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:45:22.903517    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:45:22.917828    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:45:22.917840    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:45:22.932836    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:45:22.932848    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:45:22.959144    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:45:22.959153    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:45:22.976719    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:45:22.976729    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:45:22.989254    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:45:22.989266    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:45:23.004866    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:45:23.004875    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:45:23.016716    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:23.016726    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:25.557761    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:30.519584    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:30.519732    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:30.531221    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:45:30.531300    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:30.544374    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:45:30.544443    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:30.554811    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:45:30.554910    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:30.565814    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:45:30.565884    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:30.577767    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:45:30.577840    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:30.592395    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:45:30.592474    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:30.603762    3966 logs.go:276] 0 containers: []
	W0814 17:45:30.603773    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:30.603835    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:30.620538    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:45:30.620556    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:45:30.620562    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:45:30.632832    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:45:30.632842    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:30.647161    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:45:30.647178    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:45:30.662580    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:45:30.662593    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:45:30.682207    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:45:30.682224    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:45:30.694828    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:45:30.694841    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:45:30.707933    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:45:30.707945    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:45:30.719884    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:45:30.719897    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:45:30.732104    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:45:30.732117    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:45:30.744887    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:45:30.744900    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:45:30.763138    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:30.763155    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:30.799611    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:45:30.799622    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:45:30.813942    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:45:30.813955    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:45:30.829588    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:45:30.829601    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:45:30.841676    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:45:30.841690    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:45:30.854550    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:45:30.854562    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:45:30.866631    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:30.866645    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:30.893758    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:30.893778    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:30.937687    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:30.937707    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:30.559833    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:30.559896    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:30.571591    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:45:30.571663    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:30.584977    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:45:30.585054    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:30.597625    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:45:30.597696    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:30.609586    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:45:30.609661    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:30.620851    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:45:30.620920    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:30.632563    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:45:30.632637    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:30.643228    3955 logs.go:276] 0 containers: []
	W0814 17:45:30.643241    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:30.643306    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:30.656621    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:45:30.656640    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:30.656649    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:30.697355    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:30.697370    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:30.701968    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:45:30.701979    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:45:30.723430    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:45:30.723440    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:45:30.738321    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:45:30.738335    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:45:30.751519    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:45:30.751532    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:45:30.763495    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:30.763503    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:30.804676    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:45:30.804694    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:45:30.817611    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:45:30.817622    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:45:30.835669    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:45:30.835682    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:45:30.848658    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:30.848670    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:30.873323    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:45:30.873334    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:30.886521    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:45:30.886537    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:45:30.912618    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:45:30.912630    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:45:30.928985    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:45:30.928996    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:45:30.942923    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:45:30.942934    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:45:30.961306    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:45:30.961316    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:45:33.443576    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:33.477321    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:38.445828    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:38.446087    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:38.473178    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:45:38.473280    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:38.489805    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:45:38.489884    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:38.503985    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:45:38.504066    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:38.520389    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:45:38.520462    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:38.531863    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:45:38.531932    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:38.543551    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:45:38.543626    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:38.558623    3966 logs.go:276] 0 containers: []
	W0814 17:45:38.558634    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:38.558694    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:38.570370    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:45:38.570386    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:45:38.570392    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:45:38.586148    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:45:38.586157    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:45:38.599707    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:45:38.599718    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:45:38.612131    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:45:38.612145    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:45:38.627626    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:38.627640    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:38.632773    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:38.632785    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:38.669972    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:45:38.669981    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:45:38.686254    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:45:38.686262    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:45:38.705640    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:45:38.705652    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:38.718907    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:45:38.718916    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:45:38.734198    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:45:38.734212    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:45:38.746674    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:45:38.746687    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:45:38.759852    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:45:38.759862    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:45:38.772634    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:45:38.772645    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:45:38.785430    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:38.785443    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:38.811724    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:38.811734    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:38.858053    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:45:38.858068    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:45:38.870122    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:45:38.870133    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:45:38.888431    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:45:38.888442    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:45:41.407127    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:38.479347    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:38.479438    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:38.494637    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:45:38.494716    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:38.509660    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:45:38.509735    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:38.521260    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:45:38.521298    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:38.538379    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:45:38.538454    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:38.549909    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:45:38.549982    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:38.561489    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:45:38.561560    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:38.572210    3955 logs.go:276] 0 containers: []
	W0814 17:45:38.572221    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:38.572282    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:38.585967    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:45:38.585985    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:38.585991    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:38.628131    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:45:38.628141    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:45:38.642961    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:45:38.642974    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:45:38.669591    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:45:38.669604    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:45:38.684325    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:45:38.684336    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:45:38.702586    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:45:38.702598    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:45:38.718296    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:45:38.718309    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:45:38.737365    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:45:38.737375    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:45:38.758112    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:45:38.758124    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:38.770769    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:38.770783    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:38.812343    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:45:38.812355    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:45:38.827598    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:45:38.827610    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:45:38.841110    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:38.841120    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:38.865635    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:38.865646    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:38.870985    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:45:38.870992    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:45:38.886735    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:45:38.886746    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:45:38.902389    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:45:38.902401    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:45:41.415502    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:46.409559    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:46.409926    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:46.448215    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:45:46.448267    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:46.465119    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:45:46.465199    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:46.479031    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:45:46.479102    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:46.494860    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:45:46.494922    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:46.506806    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:45:46.506864    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:46.522543    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:45:46.522613    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:46.533433    3966 logs.go:276] 0 containers: []
	W0814 17:45:46.533446    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:46.533501    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:46.545784    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:45:46.545802    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:45:46.545807    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:45:46.563214    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:45:46.563232    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:45:46.575291    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:45:46.575303    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:46.589453    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:45:46.589463    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:45:46.601369    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:45:46.601384    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:45:46.613998    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:45:46.614011    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:45:46.626021    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:45:46.626030    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:45:46.638066    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:45:46.638080    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:45:46.660308    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:45:46.660326    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:45:46.672732    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:46.672742    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:46.677837    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:46.677848    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:46.715111    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:45:46.715124    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:45:46.741202    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:45:46.741216    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:45:46.758480    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:45:46.758494    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:45:46.770836    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:46.770847    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:46.797851    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:46.797862    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:46.843598    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:45:46.843610    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:45:46.856128    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:45:46.856141    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:45:46.871019    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:45:46.871032    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:45:46.417168    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:46.417536    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:46.447053    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:45:46.447144    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:46.468823    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:45:46.468898    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:46.481576    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:45:46.481634    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:46.492730    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:45:46.492803    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:46.504175    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:45:46.504247    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:46.515609    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:45:46.515682    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:46.526963    3955 logs.go:276] 0 containers: []
	W0814 17:45:46.526975    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:46.527029    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:46.538502    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:45:46.538522    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:45:46.538527    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:45:46.553648    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:45:46.553660    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:45:46.568448    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:45:46.568464    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:45:46.588586    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:45:46.588600    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:45:46.604590    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:46.604601    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:46.609275    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:45:46.609285    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:45:46.625711    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:45:46.625725    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:45:46.638165    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:45:46.638176    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:45:46.650259    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:45:46.650272    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:45:46.672074    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:45:46.672086    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:45:46.698576    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:45:46.698589    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:45:46.711856    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:45:46.711868    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:45:46.725029    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:46.725041    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:46.767984    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:45:46.767997    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:45:46.784674    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:46.784685    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:46.809961    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:45:46.809970    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:46.824599    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:46.824610    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:49.385179    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:49.366561    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:54.387427    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:54.387714    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:54.423390    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:45:54.423480    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:54.441040    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:45:54.441128    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:54.455404    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:45:54.455481    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:54.467594    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:45:54.467668    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:54.479009    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:45:54.479075    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:54.490382    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:45:54.490453    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:54.501331    3966 logs.go:276] 0 containers: []
	W0814 17:45:54.501347    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:54.501403    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:54.513089    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:45:54.513100    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:54.513105    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:54.558025    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:45:54.558046    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:45:54.577251    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:54.577266    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:54.581882    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:45:54.581889    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:45:54.595578    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:45:54.595591    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:54.608470    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:45:54.608482    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:45:54.625845    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:45:54.625862    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:45:54.638771    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:45:54.638784    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:45:54.650761    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:45:54.650773    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:45:54.671712    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:45:54.671721    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:45:54.685228    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:54.685239    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:54.721480    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:45:54.721491    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:45:54.735872    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:45:54.735883    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:45:54.747614    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:45:54.747626    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:45:54.760046    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:54.760057    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:54.786745    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:45:54.786759    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:45:54.799411    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:45:54.799427    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:45:54.811582    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:45:54.811595    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:45:54.827370    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:45:54.827380    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:45:54.369187    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:54.369655    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:54.414475    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:45:54.414587    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:54.435201    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:45:54.435297    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:54.449650    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:45:54.449733    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:54.462363    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:45:54.462435    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:54.474035    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:45:54.474104    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:54.485535    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:45:54.485607    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:54.496587    3955 logs.go:276] 0 containers: []
	W0814 17:45:54.496599    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:54.496656    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:54.512658    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:45:54.512677    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:45:54.512685    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:45:54.528285    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:45:54.528296    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:45:54.547467    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:45:54.547479    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:45:54.560483    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:54.560494    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:54.585046    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:54.585089    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:54.589838    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:45:54.589849    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:45:54.616706    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:45:54.616720    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:45:54.631946    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:45:54.631958    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:45:54.651475    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:45:54.651484    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:45:54.667608    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:45:54.667620    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:54.681369    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:54.681381    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:54.721963    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:54.721975    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:54.760284    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:45:54.760293    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:45:54.775573    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:45:54.775584    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:45:54.792478    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:45:54.792492    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:45:54.809356    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:45:54.809368    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:45:54.827413    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:45:54.827420    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:45:57.342500    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:57.340879    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:02.343523    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:02.343678    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:02.371662    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:46:02.371723    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:02.393049    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:46:02.393122    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:02.407109    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:46:02.407184    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:02.419551    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:46:02.419630    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:02.431242    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:46:02.431317    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:02.443170    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:46:02.443240    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:02.454953    3955 logs.go:276] 0 containers: []
	W0814 17:46:02.454964    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:02.455026    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:02.466585    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:46:02.466603    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:46:02.466609    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:46:02.479866    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:46:02.479879    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:46:02.495027    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:46:02.495045    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:02.507807    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:46:02.507820    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:46:02.520104    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:46:02.520117    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:46:02.532755    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:02.532767    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:02.556691    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:02.556702    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:02.597420    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:46:02.597439    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:46:02.613048    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:46:02.613058    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:46:02.632912    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:46:02.632926    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:46:02.646755    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:46:02.646766    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:46:02.664688    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:02.664697    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:02.669003    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:46:02.669013    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:46:02.685504    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:46:02.685514    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:46:02.697646    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:02.697661    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:02.735630    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:46:02.735641    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:46:02.750283    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:46:02.750293    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:46:02.342280    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:02.342602    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:02.371188    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:46:02.371300    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:02.389522    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:46:02.389602    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:02.407134    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:46:02.407184    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:02.419918    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:46:02.419956    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:02.431722    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:46:02.431757    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:02.448836    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:46:02.448913    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:02.460088    3966 logs.go:276] 0 containers: []
	W0814 17:46:02.460099    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:02.460167    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:02.471548    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:46:02.471564    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:46:02.471569    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:46:02.483373    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:46:02.483388    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:02.495847    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:46:02.495856    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:46:02.510376    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:46:02.510385    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:46:02.522738    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:46:02.522750    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:46:02.541338    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:46:02.541351    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:46:02.553516    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:02.553527    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:02.591087    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:46:02.591099    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:46:02.610008    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:46:02.610020    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:46:02.622846    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:02.622860    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:02.670718    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:46:02.670731    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:46:02.692614    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:46:02.692625    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:46:02.704842    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:46:02.704858    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:46:02.717148    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:46:02.717159    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:46:02.729237    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:02.729250    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:02.754422    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:02.754432    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:02.759079    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:46:02.759089    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:46:02.774161    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:46:02.774171    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:46:02.785684    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:46:02.785700    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:46:05.304949    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:05.278307    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:10.305893    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:10.306031    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:10.325019    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:46:10.325062    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:10.338952    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:46:10.338994    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:10.350495    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:46:10.350533    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:10.362159    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:46:10.362195    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:10.374840    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:46:10.374898    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:10.386162    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:46:10.386236    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:10.396661    3966 logs.go:276] 0 containers: []
	W0814 17:46:10.396671    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:10.396730    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:10.410240    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:46:10.410257    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:10.410264    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:10.457648    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:46:10.457674    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:46:10.469842    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:46:10.469856    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:46:10.482970    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:46:10.482983    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:46:10.500774    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:46:10.500787    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:46:10.513906    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:46:10.513918    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:46:10.526261    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:46:10.526273    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:46:10.538437    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:46:10.538449    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:46:10.558539    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:10.558551    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:10.563037    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:10.563047    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:10.600417    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:46:10.600430    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:46:10.616074    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:46:10.616087    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:46:10.632036    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:46:10.632049    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:46:10.663250    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:46:10.663259    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:46:10.680972    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:46:10.680984    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:46:10.694244    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:46:10.694255    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:46:10.709949    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:46:10.709961    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:46:10.726618    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:10.726629    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:10.749660    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:46:10.749668    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:10.280773    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:10.281015    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:10.306492    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:46:10.306569    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:10.324837    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:46:10.324926    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:10.338342    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:46:10.338420    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:10.350304    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:46:10.350384    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:10.362061    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:46:10.362135    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:10.373131    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:46:10.373203    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:10.383842    3955 logs.go:276] 0 containers: []
	W0814 17:46:10.383878    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:10.383950    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:10.397636    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:46:10.397650    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:46:10.397655    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:46:10.423823    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:46:10.423839    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:46:10.435332    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:46:10.435343    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:46:10.448004    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:46:10.448016    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:10.460884    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:46:10.460894    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:46:10.475496    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:46:10.475509    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:46:10.490812    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:46:10.490826    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:46:10.503381    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:10.503393    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:10.544106    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:10.544123    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:10.548794    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:10.548826    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:10.586283    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:46:10.586296    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:46:10.605396    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:46:10.605406    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:46:10.625446    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:46:10.625471    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:46:10.638131    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:10.638145    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:10.662795    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:46:10.662825    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:46:10.675171    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:46:10.675184    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:46:10.690907    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:46:10.690919    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:46:13.263941    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:13.205552    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:18.266000    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:18.266073    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:18.278621    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:46:18.278686    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:18.290004    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:46:18.290072    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:18.301682    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:46:18.301750    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:18.313256    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:46:18.313324    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:18.324255    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:46:18.324327    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:18.335084    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:46:18.335152    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:18.346226    3966 logs.go:276] 0 containers: []
	W0814 17:46:18.346237    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:18.346301    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:18.358311    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:46:18.358327    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:46:18.358333    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:46:18.372559    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:46:18.372570    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:46:18.391197    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:46:18.391207    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:46:18.404905    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:46:18.404918    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:18.418547    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:18.418555    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:18.464601    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:46:18.464620    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:46:18.479875    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:46:18.479888    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:46:18.496013    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:46:18.496025    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:46:18.508666    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:46:18.508679    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:46:18.520843    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:46:18.520858    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:46:18.533901    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:46:18.533913    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:46:18.546800    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:18.546812    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:18.572621    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:18.572631    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:18.577550    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:46:18.577563    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:46:18.590117    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:46:18.590130    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:46:18.605831    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:46:18.605845    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:46:18.618455    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:46:18.618469    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:46:18.636689    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:18.636701    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:18.680496    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:46:18.680506    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:46:21.194332    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:18.206171    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:18.206335    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:18.220936    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:46:18.221007    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:18.231443    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:46:18.231509    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:18.242154    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:46:18.242222    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:18.252181    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:46:18.252246    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:18.262276    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:46:18.262344    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:18.273338    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:46:18.273411    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:18.284224    3955 logs.go:276] 0 containers: []
	W0814 17:46:18.284236    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:18.284289    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:18.295398    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:46:18.295420    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:18.295427    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:18.336266    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:46:18.336280    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:46:18.348520    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:46:18.348531    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:46:18.363461    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:46:18.363473    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:46:18.389364    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:46:18.389377    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:46:18.405099    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:46:18.405109    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:46:18.417828    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:46:18.417843    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:46:18.430785    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:46:18.430797    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:46:18.445732    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:46:18.445743    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:46:18.457175    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:18.457184    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:18.495239    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:46:18.495254    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:46:18.510783    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:46:18.510793    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:46:18.529646    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:46:18.529659    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:46:18.542746    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:18.542758    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:18.567016    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:18.567026    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:18.571575    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:46:18.571583    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:46:18.591284    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:46:18.591293    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:21.106064    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:26.196462    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:26.196543    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:26.208223    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:46:26.208295    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:26.219333    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:46:26.219404    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:26.238730    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:46:26.238802    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:26.250215    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:46:26.250287    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:26.262137    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:46:26.262213    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:26.273810    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:46:26.273882    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:26.285186    3966 logs.go:276] 0 containers: []
	W0814 17:46:26.285203    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:26.285267    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:26.296383    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:46:26.296399    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:26.296404    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:26.343271    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:46:26.343282    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:46:26.358351    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:46:26.358360    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:46:26.370569    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:46:26.370583    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:46:26.387416    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:46:26.387429    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:46:26.402012    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:46:26.402023    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:46:26.420232    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:46:26.420247    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:46:26.442907    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:26.442921    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:26.479304    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:46:26.479317    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:46:26.497532    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:46:26.497545    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:46:26.511514    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:26.511528    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:26.516773    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:46:26.516783    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:46:26.534152    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:46:26.534163    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:46:26.545554    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:46:26.545567    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:46:26.562473    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:46:26.562483    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:46:26.581879    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:46:26.581893    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:46:26.594705    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:46:26.594718    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:46:26.610985    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:26.610997    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:26.637573    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:46:26.637590    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:26.108276    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:26.108413    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:26.121169    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:46:26.121256    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:26.132456    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:46:26.132539    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:26.143130    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:46:26.143195    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:26.154179    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:46:26.154256    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:26.164344    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:46:26.164418    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:26.174973    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:46:26.175041    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:26.190383    3955 logs.go:276] 0 containers: []
	W0814 17:46:26.190394    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:26.190454    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:26.201394    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:46:26.201413    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:26.201421    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:26.238933    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:46:26.238941    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:46:26.251870    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:46:26.251880    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:46:26.265527    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:46:26.265541    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:46:26.292822    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:46:26.292837    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:46:26.308700    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:46:26.308710    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:26.322247    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:26.322259    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:26.327254    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:46:26.327261    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:46:26.342244    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:46:26.342254    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:46:26.357547    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:46:26.357557    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:46:26.373015    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:46:26.373024    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:46:26.399953    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:46:26.399968    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:46:26.413134    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:46:26.413147    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:46:26.425810    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:26.425822    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:26.449724    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:26.449735    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:26.488792    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:46:26.488810    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:46:26.502052    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:46:26.502062    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:46:29.150970    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:29.016077    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:34.151714    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:34.151808    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:34.169586    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:46:34.169661    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:34.180380    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:46:34.180458    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:34.195850    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:46:34.195931    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:34.207467    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:46:34.207540    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:34.219096    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:46:34.219170    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:34.230391    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:46:34.230461    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:34.241890    3966 logs.go:276] 0 containers: []
	W0814 17:46:34.241904    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:34.241967    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:34.254007    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:46:34.254023    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:34.254030    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:34.291420    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:46:34.291433    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:46:34.304734    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:46:34.304750    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:46:34.322444    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:46:34.322454    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:46:34.335338    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:46:34.335349    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:46:34.347864    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:46:34.347875    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:46:34.362737    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:46:34.362746    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:46:34.374798    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:46:34.374810    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:46:34.386330    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:46:34.386341    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:46:34.401624    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:46:34.401632    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:46:34.415228    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:46:34.415236    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:46:34.433929    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:34.433937    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:34.438525    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:46:34.438537    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:46:34.453596    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:46:34.453610    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:46:34.465892    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:34.465905    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:34.488644    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:46:34.488652    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:34.500441    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:34.500452    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:34.544401    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:46:34.544411    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:46:34.558978    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:46:34.558988    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:46:37.073784    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:34.018432    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:34.018786    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:34.049733    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:46:34.049869    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:34.068821    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:46:34.068920    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:34.082943    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:46:34.083021    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:34.101764    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:46:34.101842    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:34.113428    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:46:34.113496    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:34.124483    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:46:34.124552    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:34.136070    3955 logs.go:276] 0 containers: []
	W0814 17:46:34.136083    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:34.136146    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:34.152083    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:46:34.152100    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:34.152105    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:34.176525    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:34.176545    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:34.214507    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:46:34.214519    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:46:34.229628    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:46:34.229644    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:46:34.245021    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:46:34.245031    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:46:34.260273    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:46:34.260288    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:46:34.272978    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:46:34.272990    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:46:34.288346    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:34.288362    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:34.293067    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:46:34.293075    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:46:34.305635    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:46:34.305644    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:46:34.317811    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:34.317823    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:34.359313    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:46:34.359328    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:46:34.386745    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:46:34.386755    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:46:34.401233    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:46:34.401247    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:46:34.414052    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:46:34.414067    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:46:34.432203    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:46:34.432217    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:46:34.444785    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:46:34.444797    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:36.960103    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:42.076126    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:42.076200    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:42.087601    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:46:42.087638    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:42.100364    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:46:42.100438    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:42.123026    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:46:42.123099    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:42.134600    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:46:42.134670    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:42.146522    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:46:42.146594    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:42.158623    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:46:42.158696    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:42.171136    3966 logs.go:276] 0 containers: []
	W0814 17:46:42.171150    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:42.171213    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:42.190056    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:46:42.190074    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:46:42.190080    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:46:42.205246    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:46:42.205258    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:46:42.219425    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:46:42.219438    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:46:42.237976    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:46:42.237988    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:46:42.250774    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:46:42.250785    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:46:42.265369    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:46:42.265385    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:46:41.962477    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:41.962901    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:42.000249    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:46:42.000381    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:42.025490    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:46:42.025565    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:42.042019    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:46:42.042093    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:42.053572    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:46:42.053633    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:42.064513    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:46:42.064572    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:42.075402    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:46:42.075476    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:42.086913    3955 logs.go:276] 0 containers: []
	W0814 17:46:42.086925    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:42.086981    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:42.101297    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:46:42.101312    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:46:42.101317    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:46:42.116728    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:46:42.116741    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:46:42.129718    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:46:42.129732    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:46:42.150588    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:42.150604    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:42.214206    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:46:42.214218    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:46:42.229072    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:46:42.229085    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:46:42.257823    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:46:42.257841    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:46:42.281972    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:46:42.281983    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:46:42.294722    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:46:42.294732    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:46:42.307041    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:42.307052    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:42.348360    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:46:42.348382    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:46:42.363616    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:46:42.363629    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:46:42.377663    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:46:42.377674    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:46:42.392948    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:46:42.392960    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:42.406180    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:42.406192    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:42.411078    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:46:42.411084    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:46:42.425264    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:42.425278    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:42.277846    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:46:42.277861    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:46:42.293297    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:46:42.293314    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:46:42.305616    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:46:42.305629    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:42.318699    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:42.318714    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:42.357871    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:46:42.357882    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:46:42.376586    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:46:42.376600    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:46:42.388963    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:42.388974    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:42.413190    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:46:42.413204    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:46:42.425921    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:46:42.425930    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:46:42.438082    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:42.438096    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:42.482990    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:42.483009    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:42.488141    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:46:42.488148    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:46:42.499168    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:46:42.499180    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:46:45.013107    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:44.952028    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:50.015491    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:50.015576    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:50.028943    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:46:50.029018    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:50.040714    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:46:50.040783    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:50.052160    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:46:50.052234    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:50.063391    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:46:50.063465    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:50.074739    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:46:50.074817    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:50.086257    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:46:50.086339    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:50.097407    3966 logs.go:276] 0 containers: []
	W0814 17:46:50.097420    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:50.097482    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:50.109370    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:46:50.109386    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:46:50.109392    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:46:50.133958    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:46:50.133969    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:46:50.146047    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:50.146058    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:50.182798    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:46:50.182815    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:46:50.197615    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:46:50.197631    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:46:50.217170    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:46:50.217191    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:46:50.234635    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:46:50.234647    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:46:50.252265    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:46:50.252280    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:46:50.272296    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:46:50.272308    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:50.285415    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:50.285428    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:50.290308    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:46:50.290319    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:46:50.302640    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:50.302648    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:50.327614    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:46:50.327627    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:46:50.344025    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:46:50.344033    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:46:50.356276    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:46:50.356289    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:46:50.378212    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:46:50.378226    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:46:50.391414    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:50.391428    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:50.436659    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:46:50.436675    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:46:50.448216    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:46:50.448227    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:46:49.954378    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:49.954767    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:49.985019    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:46:49.985153    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:50.005960    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:46:50.006055    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:50.020180    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:46:50.020255    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:50.034738    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:46:50.034816    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:50.048128    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:46:50.048196    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:50.060293    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:46:50.060362    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:50.071623    3955 logs.go:276] 0 containers: []
	W0814 17:46:50.071637    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:50.071698    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:50.083337    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:46:50.083355    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:46:50.083361    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:46:50.096796    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:46:50.096809    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:46:50.111525    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:46:50.111534    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:46:50.125338    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:46:50.125350    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:46:50.137354    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:46:50.137364    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:46:50.157282    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:46:50.157299    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:50.170357    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:50.170369    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:50.209621    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:46:50.209638    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:46:50.242844    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:46:50.242863    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:46:50.258146    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:46:50.258161    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:46:50.275426    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:46:50.275438    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:46:50.289013    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:46:50.289026    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:46:50.301259    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:50.301274    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:50.342895    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:50.342908    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:50.347778    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:50.347794    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:50.372011    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:46:50.372028    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:46:50.392722    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:46:50.392733    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:46:52.961384    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:52.908301    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:57.963756    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:57.963967    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:57.982214    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:46:57.982302    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:57.996904    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:46:57.996976    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:58.008447    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:46:58.008526    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:58.020660    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:46:58.020699    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:58.032422    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:46:58.032494    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:58.043776    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:46:58.043852    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:58.055013    3966 logs.go:276] 0 containers: []
	W0814 17:46:58.055027    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:58.055087    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:58.073747    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:46:58.073763    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:58.073768    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:58.120655    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:58.120679    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:58.157992    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:46:58.158003    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:46:58.170859    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:46:58.170873    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:46:58.183909    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:46:58.183922    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:46:58.199149    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:46:58.199162    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:46:58.211213    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:46:58.211224    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:46:58.226978    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:46:58.226991    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:46:58.242389    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:46:58.242400    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:46:58.254339    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:46:58.254351    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:46:58.274728    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:46:58.274740    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:46:58.287662    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:46:58.287674    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:46:58.299604    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:58.299615    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:58.325224    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:58.325238    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:58.330069    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:46:58.330077    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:46:58.341536    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:46:58.341548    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:46:58.354053    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:46:58.354067    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:46:58.372283    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:46:58.372297    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:46:58.384156    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:46:58.384167    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:47:00.901001    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:57.910836    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:57.911294    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:57.951099    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:46:57.951242    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:57.973526    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:46:57.973657    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:57.993906    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:46:57.993983    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:58.008705    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:46:58.008744    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:58.020511    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:46:58.020587    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:58.034027    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:46:58.034081    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:58.046818    3955 logs.go:276] 0 containers: []
	W0814 17:46:58.046848    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:58.046907    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:58.059062    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:46:58.059079    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:58.059084    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:58.099283    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:46:58.099295    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:46:58.111704    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:46:58.111717    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:58.125375    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:46:58.125386    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:46:58.143688    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:46:58.143700    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:46:58.158458    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:46:58.158468    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:46:58.172002    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:46:58.172011    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:46:58.187186    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:58.187194    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:58.210716    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:46:58.210731    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:46:58.223585    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:46:58.223599    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:46:58.238811    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:46:58.238824    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:46:58.254734    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:46:58.254742    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:46:58.267607    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:58.267620    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:58.308123    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:58.308137    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:58.312545    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:46:58.312555    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:46:58.338549    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:46:58.338566    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:46:58.354539    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:46:58.354547    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:47:00.874453    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:05.903389    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:05.903603    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:47:05.929591    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:47:05.929685    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:47:05.946703    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:47:05.946781    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:47:05.960621    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:47:05.960701    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:47:05.972883    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:47:05.972984    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:47:05.985166    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:47:05.985241    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:47:05.998316    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:47:05.998397    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:47:06.009393    3966 logs.go:276] 0 containers: []
	W0814 17:47:06.009404    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:47:06.009468    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:47:06.020766    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:47:06.020793    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:47:06.020805    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:47:06.032766    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:47:06.032775    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:47:06.045209    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:47:06.045220    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:47:06.058147    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:47:06.058158    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:47:06.076137    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:47:06.076152    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:47:06.088857    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:47:06.088869    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:47:06.101519    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:47:06.101531    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:47:06.116196    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:47:06.116208    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:47:06.163361    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:47:06.163379    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:47:06.178474    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:47:06.178485    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:47:06.195091    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:47:06.195101    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:47:06.220785    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:47:06.220802    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:47:06.235427    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:47:06.235443    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:47:06.247811    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:47:06.247823    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:47:06.265574    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:47:06.265588    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:47:06.285882    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:47:06.285895    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:47:06.301761    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:47:06.301771    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:47:06.343669    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:47:06.343688    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:47:06.357533    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:47:06.357545    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:47:05.875559    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:05.875997    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:47:05.917042    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:47:05.917186    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:47:05.938410    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:47:05.938505    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:47:05.953335    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:47:05.953414    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:47:05.966825    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:47:05.966905    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:47:05.979363    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:47:05.979428    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:47:05.990672    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:47:05.990742    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:47:06.002790    3955 logs.go:276] 0 containers: []
	W0814 17:47:06.002803    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:47:06.002867    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:47:06.015001    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:47:06.015036    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:47:06.015044    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:47:06.019622    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:47:06.019633    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:47:06.032212    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:47:06.032228    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:47:06.044987    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:47:06.045001    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:47:06.060760    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:47:06.060769    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:47:06.073263    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:47:06.073275    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:47:06.086077    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:47:06.086090    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:47:06.105661    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:47:06.105670    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:47:06.117940    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:47:06.117949    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:47:06.154667    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:47:06.154679    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:47:06.174797    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:47:06.174815    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:47:06.190202    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:47:06.190218    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:47:06.206464    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:47:06.206475    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:47:06.230306    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:47:06.230320    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:47:06.273692    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:47:06.273712    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:47:06.300141    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:47:06.300157    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:47:06.321474    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:47:06.321487    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:47:08.864132    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:08.847520    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:13.866131    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:13.866312    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:47:13.883323    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:47:13.883401    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:47:13.897607    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:47:13.897686    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:47:13.909312    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:47:13.909383    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:47:13.921021    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:47:13.921094    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:47:13.931986    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:47:13.932060    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:47:13.943524    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:47:13.943599    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:47:13.956293    3966 logs.go:276] 0 containers: []
	W0814 17:47:13.956307    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:47:13.956364    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:47:13.967692    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:47:13.967709    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:47:13.967714    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:47:13.980373    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:47:13.980384    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:47:14.025602    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:47:14.025614    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:47:14.067712    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:47:14.067724    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:47:14.083036    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:47:14.083054    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:47:14.095886    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:47:14.095898    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:47:14.109768    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:47:14.109780    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:47:14.122593    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:47:14.122605    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:47:14.134659    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:47:14.134673    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:47:14.149913    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:47:14.149930    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:47:14.166349    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:47:14.166360    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:47:14.179111    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:47:14.179125    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:47:14.194392    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:47:14.194409    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:47:14.216646    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:47:14.216657    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:47:14.239466    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:47:14.239478    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:47:14.253087    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:47:14.253100    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:47:14.257425    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:47:14.257431    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:47:14.270054    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:47:14.270066    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:47:14.292645    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:47:14.292660    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:47:16.808466    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:13.849040    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:13.849281    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:47:13.872685    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:47:13.872782    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:47:13.889011    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:47:13.889088    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:47:13.901952    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:47:13.902034    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:47:13.914528    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:47:13.914627    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:47:13.925377    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:47:13.925448    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:47:13.936521    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:47:13.936593    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:47:13.947461    3955 logs.go:276] 0 containers: []
	W0814 17:47:13.947473    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:47:13.947532    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:47:13.959873    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:47:13.959889    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:47:13.959895    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:47:13.972986    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:47:13.972998    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:47:14.003052    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:47:14.003063    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:47:14.019203    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:47:14.019213    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:47:14.034387    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:47:14.034402    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:47:14.057738    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:47:14.057757    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:47:14.073476    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:47:14.073488    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:47:14.093336    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:47:14.093348    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:47:14.105767    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:47:14.105780    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:47:14.125245    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:47:14.125254    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:47:14.137913    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:47:14.137925    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:47:14.175224    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:47:14.175237    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:47:14.188363    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:47:14.188379    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:47:14.201418    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:47:14.201430    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:47:14.222275    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:47:14.222285    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:47:14.262865    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:47:14.262883    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:47:14.267459    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:47:14.267470    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:47:16.795277    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:21.808887    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:21.809127    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:47:21.826989    3966 logs.go:276] 2 containers: [304fd8b7061a dd96d4eb3b67]
	I0814 17:47:21.827073    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:47:21.841701    3966 logs.go:276] 2 containers: [6738c97ff0e1 de3ef9e2b2d4]
	I0814 17:47:21.841773    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:47:21.858427    3966 logs.go:276] 2 containers: [b4a1b111dbef 5cedaf3c3e7d]
	I0814 17:47:21.858508    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:47:21.869975    3966 logs.go:276] 2 containers: [c4a08c35d05e 55491ceb3162]
	I0814 17:47:21.870051    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:47:21.881032    3966 logs.go:276] 2 containers: [a12b8bdfce85 5ad71bd0d968]
	I0814 17:47:21.881113    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:47:21.891868    3966 logs.go:276] 2 containers: [f6b5230fee19 a751dc583108]
	I0814 17:47:21.891940    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:47:21.902443    3966 logs.go:276] 0 containers: []
	W0814 17:47:21.902454    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:47:21.902511    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:47:21.913208    3966 logs.go:276] 2 containers: [9f5be0e3e188 6e0da723e642]
	I0814 17:47:21.913225    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:47:21.913231    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:47:21.953772    3966 logs.go:123] Gathering logs for kube-apiserver [304fd8b7061a] ...
	I0814 17:47:21.953787    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304fd8b7061a"
	I0814 17:47:21.969123    3966 logs.go:123] Gathering logs for coredns [b4a1b111dbef] ...
	I0814 17:47:21.969137    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b4a1b111dbef"
	I0814 17:47:21.981366    3966 logs.go:123] Gathering logs for storage-provisioner [6e0da723e642] ...
	I0814 17:47:21.981379    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6e0da723e642"
	I0814 17:47:21.994038    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:47:21.994052    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:47:22.018313    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:47:22.018330    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:47:22.065721    3966 logs.go:123] Gathering logs for kube-scheduler [55491ceb3162] ...
	I0814 17:47:22.065742    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55491ceb3162"
	I0814 17:47:22.083774    3966 logs.go:123] Gathering logs for kube-proxy [5ad71bd0d968] ...
	I0814 17:47:22.083789    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ad71bd0d968"
	I0814 17:47:22.096509    3966 logs.go:123] Gathering logs for storage-provisioner [9f5be0e3e188] ...
	I0814 17:47:22.096522    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9f5be0e3e188"
	I0814 17:47:22.109346    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:47:22.109359    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:47:22.124879    3966 logs.go:123] Gathering logs for etcd [6738c97ff0e1] ...
	I0814 17:47:22.124892    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6738c97ff0e1"
	I0814 17:47:22.140395    3966 logs.go:123] Gathering logs for etcd [de3ef9e2b2d4] ...
	I0814 17:47:22.140409    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 de3ef9e2b2d4"
	I0814 17:47:22.156666    3966 logs.go:123] Gathering logs for coredns [5cedaf3c3e7d] ...
	I0814 17:47:22.156681    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5cedaf3c3e7d"
	I0814 17:47:22.169504    3966 logs.go:123] Gathering logs for kube-scheduler [c4a08c35d05e] ...
	I0814 17:47:22.169519    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c4a08c35d05e"
	I0814 17:47:22.182212    3966 logs.go:123] Gathering logs for kube-proxy [a12b8bdfce85] ...
	I0814 17:47:22.182224    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a12b8bdfce85"
	I0814 17:47:22.195281    3966 logs.go:123] Gathering logs for kube-controller-manager [f6b5230fee19] ...
	I0814 17:47:22.195294    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6b5230fee19"
	I0814 17:47:22.214024    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:47:22.214038    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:47:22.218653    3966 logs.go:123] Gathering logs for kube-controller-manager [a751dc583108] ...
	I0814 17:47:22.218665    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a751dc583108"
	I0814 17:47:22.231537    3966 logs.go:123] Gathering logs for kube-apiserver [dd96d4eb3b67] ...
	I0814 17:47:22.231548    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dd96d4eb3b67"
	I0814 17:47:21.796915    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:21.796984    3955 kubeadm.go:597] duration metric: took 4m4.299766708s to restartPrimaryControlPlane
	W0814 17:47:21.797044    3955 out.go:239] ! Unable to restart control-plane node(s), will reset cluster: <no value>
	I0814 17:47:21.797076    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force"
	I0814 17:47:22.830868    3955 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force": (1.033809625s)
	I0814 17:47:22.830936    3955 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0814 17:47:22.835980    3955 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0814 17:47:22.838828    3955 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0814 17:47:22.841682    3955 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0814 17:47:22.841687    3955 kubeadm.go:157] found existing configuration files:
	
	I0814 17:47:22.841706    3955 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/admin.conf
	I0814 17:47:22.844665    3955 kubeadm.go:163] "https://control-plane.minikube.internal:50260" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I0814 17:47:22.844685    3955 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I0814 17:47:22.847438    3955 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/kubelet.conf
	I0814 17:47:22.850204    3955 kubeadm.go:163] "https://control-plane.minikube.internal:50260" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I0814 17:47:22.850225    3955 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I0814 17:47:22.853357    3955 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/controller-manager.conf
	I0814 17:47:22.856102    3955 kubeadm.go:163] "https://control-plane.minikube.internal:50260" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I0814 17:47:22.856127    3955 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0814 17:47:22.858560    3955 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/scheduler.conf
	I0814 17:47:22.861579    3955 kubeadm.go:163] "https://control-plane.minikube.internal:50260" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I0814 17:47:22.861601    3955 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0814 17:47:22.864540    3955 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
	I0814 17:47:22.883113    3955 kubeadm.go:310] [init] Using Kubernetes version: v1.24.1
	I0814 17:47:22.883153    3955 kubeadm.go:310] [preflight] Running pre-flight checks
	I0814 17:47:22.932807    3955 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0814 17:47:22.932867    3955 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0814 17:47:22.932921    3955 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0814 17:47:22.981171    3955 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0814 17:47:22.985372    3955 out.go:204]   - Generating certificates and keys ...
	I0814 17:47:22.985410    3955 kubeadm.go:310] [certs] Using existing ca certificate authority
	I0814 17:47:22.985443    3955 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
	I0814 17:47:22.985485    3955 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
	I0814 17:47:22.985519    3955 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
	I0814 17:47:22.985555    3955 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
	I0814 17:47:22.985584    3955 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
	I0814 17:47:22.985615    3955 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
	I0814 17:47:22.985669    3955 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
	I0814 17:47:22.985712    3955 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
	I0814 17:47:22.985761    3955 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
	I0814 17:47:22.985785    3955 kubeadm.go:310] [certs] Using the existing "sa" key
	I0814 17:47:22.985814    3955 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0814 17:47:23.058371    3955 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0814 17:47:23.131171    3955 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0814 17:47:23.174294    3955 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0814 17:47:23.216077    3955 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0814 17:47:23.244512    3955 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0814 17:47:23.244922    3955 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0814 17:47:23.244942    3955 kubeadm.go:310] [kubelet-start] Starting the kubelet
	I0814 17:47:23.329700    3955 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0814 17:47:24.746726    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:23.337673    3955 out.go:204]   - Booting up control plane ...
	I0814 17:47:23.337723    3955 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0814 17:47:23.337767    3955 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0814 17:47:23.337809    3955 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0814 17:47:23.337862    3955 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0814 17:47:23.338008    3955 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I0814 17:47:27.834270    3955 kubeadm.go:310] [apiclient] All control plane components are healthy after 4.501957 seconds
	I0814 17:47:27.834330    3955 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0814 17:47:27.837535    3955 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0814 17:47:28.348716    3955 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
	I0814 17:47:28.348873    3955 kubeadm.go:310] [mark-control-plane] Marking the node stopped-upgrade-504000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0814 17:47:28.852392    3955 kubeadm.go:310] [bootstrap-token] Using token: a7be3r.z8ykpssn5hbg2xb2
	I0814 17:47:28.858666    3955 out.go:204]   - Configuring RBAC rules ...
	I0814 17:47:28.858735    3955 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0814 17:47:28.858786    3955 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0814 17:47:28.865354    3955 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0814 17:47:28.866490    3955 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0814 17:47:28.867367    3955 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0814 17:47:28.868167    3955 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0814 17:47:28.871230    3955 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0814 17:47:29.024331    3955 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
	I0814 17:47:29.256161    3955 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
	I0814 17:47:29.256535    3955 kubeadm.go:310] 
	I0814 17:47:29.256566    3955 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
	I0814 17:47:29.256570    3955 kubeadm.go:310] 
	I0814 17:47:29.256606    3955 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
	I0814 17:47:29.256609    3955 kubeadm.go:310] 
	I0814 17:47:29.256622    3955 kubeadm.go:310]   mkdir -p $HOME/.kube
	I0814 17:47:29.256650    3955 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0814 17:47:29.256683    3955 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0814 17:47:29.256689    3955 kubeadm.go:310] 
	I0814 17:47:29.256719    3955 kubeadm.go:310] Alternatively, if you are the root user, you can run:
	I0814 17:47:29.256724    3955 kubeadm.go:310] 
	I0814 17:47:29.256748    3955 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0814 17:47:29.256752    3955 kubeadm.go:310] 
	I0814 17:47:29.256783    3955 kubeadm.go:310] You should now deploy a pod network to the cluster.
	I0814 17:47:29.256826    3955 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0814 17:47:29.256867    3955 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0814 17:47:29.256871    3955 kubeadm.go:310] 
	I0814 17:47:29.256914    3955 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
	I0814 17:47:29.256958    3955 kubeadm.go:310] and service account keys on each node and then running the following as root:
	I0814 17:47:29.256962    3955 kubeadm.go:310] 
	I0814 17:47:29.257005    3955 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token a7be3r.z8ykpssn5hbg2xb2 \
	I0814 17:47:29.257059    3955 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:957dccc044ee8898881693e1bb8f325b1f0a5c6f5463b6f7c0e6b1456e2d6ac2 \
	I0814 17:47:29.257070    3955 kubeadm.go:310] 	--control-plane 
	I0814 17:47:29.257073    3955 kubeadm.go:310] 
	I0814 17:47:29.257117    3955 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
	I0814 17:47:29.257120    3955 kubeadm.go:310] 
	I0814 17:47:29.257160    3955 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token a7be3r.z8ykpssn5hbg2xb2 \
	I0814 17:47:29.257217    3955 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:957dccc044ee8898881693e1bb8f325b1f0a5c6f5463b6f7c0e6b1456e2d6ac2 
	I0814 17:47:29.257383    3955 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0814 17:47:29.257447    3955 cni.go:84] Creating CNI manager for ""
	I0814 17:47:29.257459    3955 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:47:29.261668    3955 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
	I0814 17:47:29.268566    3955 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
	I0814 17:47:29.271503    3955 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)
	I0814 17:47:29.276262    3955 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0814 17:47:29.276301    3955 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0814 17:47:29.276321    3955 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes stopped-upgrade-504000 minikube.k8s.io/updated_at=2024_08_14T17_47_29_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=a560a51f794134545edbbeb49e1ab4a0b1355168 minikube.k8s.io/name=stopped-upgrade-504000 minikube.k8s.io/primary=true
	I0814 17:47:29.321596    3955 kubeadm.go:1113] duration metric: took 45.32725ms to wait for elevateKubeSystemPrivileges
	I0814 17:47:29.321615    3955 ops.go:34] apiserver oom_adj: -16
	I0814 17:47:29.321620    3955 kubeadm.go:394] duration metric: took 4m11.840430459s to StartCluster
	I0814 17:47:29.321630    3955 settings.go:142] acquiring lock: {Name:mkcf010cb030fc0976e1870794cf1a021579ed31 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:47:29.321719    3955 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:47:29.322093    3955 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/kubeconfig: {Name:mke777513f7f5736c6804680b89db76bd98a8ac2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:47:29.322275    3955 start.go:235] Will wait 6m0s for node &{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:47:29.322324    3955 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I0814 17:47:29.322364    3955 config.go:182] Loaded profile config "stopped-upgrade-504000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I0814 17:47:29.322370    3955 addons.go:69] Setting storage-provisioner=true in profile "stopped-upgrade-504000"
	I0814 17:47:29.322438    3955 addons.go:234] Setting addon storage-provisioner=true in "stopped-upgrade-504000"
	W0814 17:47:29.322446    3955 addons.go:243] addon storage-provisioner should already be in state true
	I0814 17:47:29.322460    3955 host.go:66] Checking if "stopped-upgrade-504000" exists ...
	I0814 17:47:29.322397    3955 addons.go:69] Setting default-storageclass=true in profile "stopped-upgrade-504000"
	I0814 17:47:29.322500    3955 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "stopped-upgrade-504000"
	I0814 17:47:29.326621    3955 out.go:177] * Verifying Kubernetes components...
	I0814 17:47:29.327299    3955 kapi.go:59] client config for stopped-upgrade-504000: &rest.Config{Host:"https://10.0.2.15:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/client.key", CAFile:"/Users/jenkins/minikube-integration/19443-949/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8
(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x105de4f90), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0814 17:47:29.330814    3955 addons.go:234] Setting addon default-storageclass=true in "stopped-upgrade-504000"
	W0814 17:47:29.330819    3955 addons.go:243] addon default-storageclass should already be in state true
	I0814 17:47:29.330828    3955 host.go:66] Checking if "stopped-upgrade-504000" exists ...
	I0814 17:47:29.331344    3955 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
	I0814 17:47:29.331349    3955 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0814 17:47:29.331354    3955 sshutil.go:53] new ssh client: &{IP:localhost Port:50228 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/stopped-upgrade-504000/id_rsa Username:docker}
	I0814 17:47:29.334525    3955 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:47:29.748835    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:29.748872    3966 kubeadm.go:597] duration metric: took 4m6.454122958s to restartPrimaryControlPlane
	W0814 17:47:29.748906    3966 out.go:239] ! Unable to restart control-plane node(s), will reset cluster: <no value>
	I0814 17:47:29.748923    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force"
	I0814 17:47:30.804622    3966 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force": (1.05571675s)
	I0814 17:47:30.804701    3966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0814 17:47:30.809713    3966 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0814 17:47:30.812383    3966 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0814 17:47:30.815103    3966 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0814 17:47:30.815110    3966 kubeadm.go:157] found existing configuration files:
	
	I0814 17:47:30.815129    3966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/admin.conf
	I0814 17:47:30.817537    3966 kubeadm.go:163] "https://control-plane.minikube.internal:50332" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I0814 17:47:30.817562    3966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I0814 17:47:30.820100    3966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/kubelet.conf
	I0814 17:47:30.823222    3966 kubeadm.go:163] "https://control-plane.minikube.internal:50332" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I0814 17:47:30.823246    3966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I0814 17:47:30.825997    3966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/controller-manager.conf
	I0814 17:47:30.828322    3966 kubeadm.go:163] "https://control-plane.minikube.internal:50332" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I0814 17:47:30.828340    3966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0814 17:47:30.831263    3966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/scheduler.conf
	I0814 17:47:30.833897    3966 kubeadm.go:163] "https://control-plane.minikube.internal:50332" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:50332 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I0814 17:47:30.833918    3966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0814 17:47:30.836315    3966 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
	I0814 17:47:30.853704    3966 kubeadm.go:310] [init] Using Kubernetes version: v1.24.1
	I0814 17:47:30.853768    3966 kubeadm.go:310] [preflight] Running pre-flight checks
	I0814 17:47:30.912413    3966 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0814 17:47:30.912470    3966 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0814 17:47:30.912519    3966 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0814 17:47:30.962104    3966 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0814 17:47:30.966232    3966 out.go:204]   - Generating certificates and keys ...
	I0814 17:47:30.966272    3966 kubeadm.go:310] [certs] Using existing ca certificate authority
	I0814 17:47:30.966307    3966 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
	I0814 17:47:30.966350    3966 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
	I0814 17:47:30.966382    3966 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
	I0814 17:47:30.966413    3966 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
	I0814 17:47:30.966444    3966 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
	I0814 17:47:30.966477    3966 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
	I0814 17:47:30.966548    3966 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
	I0814 17:47:30.966585    3966 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
	I0814 17:47:30.966618    3966 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
	I0814 17:47:30.966637    3966 kubeadm.go:310] [certs] Using the existing "sa" key
	I0814 17:47:30.966685    3966 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0814 17:47:31.064603    3966 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0814 17:47:31.262263    3966 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0814 17:47:31.309384    3966 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0814 17:47:31.356121    3966 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0814 17:47:31.386591    3966 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0814 17:47:31.386798    3966 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0814 17:47:31.386894    3966 kubeadm.go:310] [kubelet-start] Starting the kubelet
	I0814 17:47:31.479692    3966 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0814 17:47:31.486837    3966 out.go:204]   - Booting up control plane ...
	I0814 17:47:31.486888    3966 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0814 17:47:31.486939    3966 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0814 17:47:31.486974    3966 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0814 17:47:31.487014    3966 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0814 17:47:31.487085    3966 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I0814 17:47:29.338615    3955 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:47:29.341618    3955 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0814 17:47:29.341624    3955 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0814 17:47:29.341630    3955 sshutil.go:53] new ssh client: &{IP:localhost Port:50228 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/stopped-upgrade-504000/id_rsa Username:docker}
	I0814 17:47:29.437690    3955 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0814 17:47:29.443142    3955 api_server.go:52] waiting for apiserver process to appear ...
	I0814 17:47:29.443184    3955 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0814 17:47:29.447844    3955 api_server.go:72] duration metric: took 125.560709ms to wait for apiserver process to appear ...
	I0814 17:47:29.447852    3955 api_server.go:88] waiting for apiserver healthz status ...
	I0814 17:47:29.447859    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:29.496998    3955 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0814 17:47:29.506246    3955 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0814 17:47:29.875764    3955 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
	I0814 17:47:29.875778    3955 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
	I0814 17:47:35.989710    3966 kubeadm.go:310] [apiclient] All control plane components are healthy after 4.502377 seconds
	I0814 17:47:35.989788    3966 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0814 17:47:35.993989    3966 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0814 17:47:36.503474    3966 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
	I0814 17:47:36.503584    3966 kubeadm.go:310] [mark-control-plane] Marking the node running-upgrade-987000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0814 17:47:37.007806    3966 kubeadm.go:310] [bootstrap-token] Using token: kv1hgy.cybwvwwdsbzloxiy
	I0814 17:47:37.012388    3966 out.go:204]   - Configuring RBAC rules ...
	I0814 17:47:37.012449    3966 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0814 17:47:37.014313    3966 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0814 17:47:37.019982    3966 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0814 17:47:37.020922    3966 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0814 17:47:37.021719    3966 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0814 17:47:37.022624    3966 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0814 17:47:37.026750    3966 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0814 17:47:37.217861    3966 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
	I0814 17:47:37.416733    3966 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
	I0814 17:47:37.416750    3966 kubeadm.go:310] 
	I0814 17:47:37.416784    3966 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
	I0814 17:47:37.416787    3966 kubeadm.go:310] 
	I0814 17:47:37.416824    3966 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
	I0814 17:47:37.416828    3966 kubeadm.go:310] 
	I0814 17:47:37.416840    3966 kubeadm.go:310]   mkdir -p $HOME/.kube
	I0814 17:47:37.416869    3966 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0814 17:47:37.416898    3966 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0814 17:47:37.416901    3966 kubeadm.go:310] 
	I0814 17:47:37.416926    3966 kubeadm.go:310] Alternatively, if you are the root user, you can run:
	I0814 17:47:37.416928    3966 kubeadm.go:310] 
	I0814 17:47:37.416953    3966 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0814 17:47:37.416958    3966 kubeadm.go:310] 
	I0814 17:47:37.416983    3966 kubeadm.go:310] You should now deploy a pod network to the cluster.
	I0814 17:47:37.417020    3966 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0814 17:47:37.417080    3966 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0814 17:47:37.417087    3966 kubeadm.go:310] 
	I0814 17:47:37.417129    3966 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
	I0814 17:47:37.417177    3966 kubeadm.go:310] and service account keys on each node and then running the following as root:
	I0814 17:47:37.417182    3966 kubeadm.go:310] 
	I0814 17:47:37.417230    3966 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token kv1hgy.cybwvwwdsbzloxiy \
	I0814 17:47:37.417286    3966 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:957dccc044ee8898881693e1bb8f325b1f0a5c6f5463b6f7c0e6b1456e2d6ac2 \
	I0814 17:47:37.417300    3966 kubeadm.go:310] 	--control-plane 
	I0814 17:47:37.417304    3966 kubeadm.go:310] 
	I0814 17:47:37.417350    3966 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
	I0814 17:47:37.417353    3966 kubeadm.go:310] 
	I0814 17:47:37.417398    3966 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token kv1hgy.cybwvwwdsbzloxiy \
	I0814 17:47:37.417452    3966 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:957dccc044ee8898881693e1bb8f325b1f0a5c6f5463b6f7c0e6b1456e2d6ac2 
	I0814 17:47:37.417505    3966 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0814 17:47:37.417513    3966 cni.go:84] Creating CNI manager for ""
	I0814 17:47:37.417521    3966 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:47:37.421308    3966 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
	I0814 17:47:37.427361    3966 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
	I0814 17:47:37.430700    3966 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)
	I0814 17:47:37.435515    3966 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0814 17:47:37.435585    3966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0814 17:47:37.435587    3966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes running-upgrade-987000 minikube.k8s.io/updated_at=2024_08_14T17_47_37_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=a560a51f794134545edbbeb49e1ab4a0b1355168 minikube.k8s.io/name=running-upgrade-987000 minikube.k8s.io/primary=true
	I0814 17:47:37.480256    3966 ops.go:34] apiserver oom_adj: -16
	I0814 17:47:37.480271    3966 kubeadm.go:1113] duration metric: took 44.725375ms to wait for elevateKubeSystemPrivileges
	I0814 17:47:37.480281    3966 kubeadm.go:394] duration metric: took 4m14.202365291s to StartCluster
	I0814 17:47:37.480290    3966 settings.go:142] acquiring lock: {Name:mkcf010cb030fc0976e1870794cf1a021579ed31 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:47:37.480365    3966 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:47:37.480759    3966 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/kubeconfig: {Name:mke777513f7f5736c6804680b89db76bd98a8ac2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:47:37.480972    3966 start.go:235] Will wait 6m0s for node &{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:47:37.481003    3966 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I0814 17:47:37.481045    3966 addons.go:69] Setting storage-provisioner=true in profile "running-upgrade-987000"
	I0814 17:47:37.481059    3966 addons.go:234] Setting addon storage-provisioner=true in "running-upgrade-987000"
	I0814 17:47:37.481061    3966 config.go:182] Loaded profile config "running-upgrade-987000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I0814 17:47:37.481064    3966 addons.go:69] Setting default-storageclass=true in profile "running-upgrade-987000"
	I0814 17:47:37.481072    3966 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "running-upgrade-987000"
	W0814 17:47:37.481062    3966 addons.go:243] addon storage-provisioner should already be in state true
	I0814 17:47:37.481095    3966 host.go:66] Checking if "running-upgrade-987000" exists ...
	I0814 17:47:37.482061    3966 kapi.go:59] client config for running-upgrade-987000: &rest.Config{Host:"https://10.0.2.15:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/19443-949/.minikube/profiles/running-upgrade-987000/client.key", CAFile:"/Users/jenkins/minikube-integration/19443-949/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8
(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x103eb0f90), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0814 17:47:37.482182    3966 addons.go:234] Setting addon default-storageclass=true in "running-upgrade-987000"
	W0814 17:47:37.482186    3966 addons.go:243] addon default-storageclass should already be in state true
	I0814 17:47:37.482194    3966 host.go:66] Checking if "running-upgrade-987000" exists ...
	I0814 17:47:37.484383    3966 out.go:177] * Verifying Kubernetes components...
	I0814 17:47:37.484694    3966 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
	I0814 17:47:37.488480    3966 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0814 17:47:37.488487    3966 sshutil.go:53] new ssh client: &{IP:localhost Port:50265 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/running-upgrade-987000/id_rsa Username:docker}
	I0814 17:47:37.492272    3966 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:47:34.449838    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": dial tcp 10.0.2.15:8443: i/o timeout (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:34.449859    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:37.496180    3966 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:47:37.500317    3966 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0814 17:47:37.500323    3966 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0814 17:47:37.500329    3966 sshutil.go:53] new ssh client: &{IP:localhost Port:50265 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/running-upgrade-987000/id_rsa Username:docker}
	I0814 17:47:37.590341    3966 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0814 17:47:37.595326    3966 api_server.go:52] waiting for apiserver process to appear ...
	I0814 17:47:37.595369    3966 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0814 17:47:37.599796    3966 api_server.go:72] duration metric: took 118.816083ms to wait for apiserver process to appear ...
	I0814 17:47:37.599805    3966 api_server.go:88] waiting for apiserver healthz status ...
	I0814 17:47:37.599811    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:37.605080    3966 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0814 17:47:37.659728    3966 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0814 17:47:37.972097    3966 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
	I0814 17:47:37.972109    3966 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
	I0814 17:47:39.449996    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:39.450030    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:42.601775    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:42.601898    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:44.450258    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:44.450282    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:47.602207    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:47.602238    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:49.450521    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:49.450540    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:52.602481    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:52.602502    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:54.450914    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:54.450951    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:59.451507    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:59.451551    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	W0814 17:47:59.877259    3955 out.go:239] ! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error listing StorageClasses: Get "https://10.0.2.15:8443/apis/storage.k8s.io/v1/storageclasses": dial tcp 10.0.2.15:8443: i/o timeout]
	I0814 17:47:59.881448    3955 out.go:177] * Enabled addons: storage-provisioner
	I0814 17:47:57.602813    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:57.602837    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:59.893390    3955 addons.go:510] duration metric: took 30.57191625s for enable addons: enabled=[storage-provisioner]
	I0814 17:48:02.603639    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:02.603676    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:04.452489    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:04.452518    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:07.604382    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:07.604406    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	W0814 17:48:07.973289    3966 out.go:239] ! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error listing StorageClasses: Get "https://10.0.2.15:8443/apis/storage.k8s.io/v1/storageclasses": dial tcp 10.0.2.15:8443: i/o timeout]
	I0814 17:48:07.977461    3966 out.go:177] * Enabled addons: storage-provisioner
	I0814 17:48:07.991457    3966 addons.go:510] duration metric: took 30.511279375s for enable addons: enabled=[storage-provisioner]
	I0814 17:48:09.453496    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:09.453531    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:12.605338    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:12.605361    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:14.454826    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:14.454879    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:17.606581    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:17.606628    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:19.456593    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:19.456635    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:22.608206    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:22.608253    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:24.458766    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:24.458816    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:27.610302    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:27.610325    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:29.459287    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:29.459463    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:48:29.470126    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:48:29.470212    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:48:29.480935    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:48:29.481004    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:48:29.491036    3955 logs.go:276] 2 containers: [bfe8ad4481d2 5580c1df3209]
	I0814 17:48:29.491100    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:48:29.501674    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:48:29.501735    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:48:29.511998    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:48:29.512065    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:48:29.522571    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:48:29.522642    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:48:29.533057    3955 logs.go:276] 0 containers: []
	W0814 17:48:29.533068    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:48:29.533125    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:48:29.543793    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:48:29.543810    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:48:29.543818    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:48:29.555735    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:48:29.555747    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:48:29.591760    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:48:29.591774    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:48:29.607021    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:48:29.607031    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:48:29.618618    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:48:29.618633    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:48:29.633772    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:48:29.633783    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:48:29.648863    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:48:29.648876    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:48:29.666328    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:48:29.666339    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:48:29.692421    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:48:29.692434    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:48:29.727690    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:48:29.727699    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:48:29.731983    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:48:29.731990    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:48:29.747197    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:48:29.747207    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:48:29.762294    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:48:29.762306    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:48:32.275402    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:32.612338    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:32.612360    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:37.277576    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:37.277722    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:48:37.292330    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:48:37.292412    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:48:37.303791    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:48:37.303863    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:48:37.314354    3955 logs.go:276] 2 containers: [bfe8ad4481d2 5580c1df3209]
	I0814 17:48:37.314421    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:48:37.325346    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:48:37.325411    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:48:37.335862    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:48:37.335930    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:48:37.346279    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:48:37.346350    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:48:37.356907    3955 logs.go:276] 0 containers: []
	W0814 17:48:37.356918    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:48:37.356980    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:48:37.368026    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:48:37.368042    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:48:37.368048    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:48:37.407710    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:48:37.407721    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:48:37.425419    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:48:37.425432    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:48:37.439553    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:48:37.439561    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:48:37.454717    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:48:37.454730    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:48:37.467718    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:48:37.467729    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:48:37.479541    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:48:37.479552    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:48:37.514421    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:48:37.514439    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:48:37.518806    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:48:37.518813    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:48:37.530281    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:48:37.530295    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:48:37.548017    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:48:37.548031    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:48:37.573514    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:48:37.573523    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:48:37.585482    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:48:37.585494    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:48:37.614434    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:37.614576    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:48:37.625546    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:48:37.625612    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:48:37.636003    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:48:37.636069    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:48:37.645956    3966 logs.go:276] 2 containers: [e503088d4f61 f805e836332e]
	I0814 17:48:37.646035    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:48:37.660016    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:48:37.660086    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:48:37.671051    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:48:37.671121    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:48:37.681944    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:48:37.682012    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:48:37.691879    3966 logs.go:276] 0 containers: []
	W0814 17:48:37.691889    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:48:37.691945    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:48:37.701930    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:48:37.701946    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:48:37.701951    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:48:37.716765    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:48:37.716780    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:48:37.728375    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:48:37.728385    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:48:37.751660    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:48:37.751672    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:48:37.786489    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:48:37.786500    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:48:37.800019    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:48:37.800029    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:48:37.811485    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:48:37.811498    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:48:37.823192    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:48:37.823205    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:48:37.842007    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:48:37.842017    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:48:37.853648    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:48:37.853660    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:48:37.889342    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:48:37.889351    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:48:37.893548    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:48:37.893555    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:48:37.908322    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:48:37.908333    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:48:40.427821    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:40.100572    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:45.430001    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:45.430097    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:48:45.441860    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:48:45.441931    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:48:45.452986    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:48:45.453049    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:48:45.463646    3966 logs.go:276] 2 containers: [e503088d4f61 f805e836332e]
	I0814 17:48:45.463718    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:48:45.474275    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:48:45.474342    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:48:45.484685    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:48:45.484755    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:48:45.495084    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:48:45.495147    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:48:45.506265    3966 logs.go:276] 0 containers: []
	W0814 17:48:45.506277    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:48:45.506331    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:48:45.517691    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:48:45.517709    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:48:45.517714    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:48:45.552390    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:48:45.552402    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:48:45.567021    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:48:45.567032    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:48:45.581055    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:48:45.581066    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:48:45.592709    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:48:45.592721    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:48:45.611233    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:48:45.611244    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:48:45.636032    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:48:45.636044    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:48:45.640982    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:48:45.640987    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:48:45.674591    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:48:45.674602    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:48:45.686343    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:48:45.686355    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:48:45.702477    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:48:45.702487    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:48:45.719367    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:48:45.719377    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:48:45.732059    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:48:45.732070    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:48:45.102844    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:45.103051    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:48:45.127674    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:48:45.127755    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:48:45.143622    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:48:45.143694    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:48:45.158099    3955 logs.go:276] 2 containers: [bfe8ad4481d2 5580c1df3209]
	I0814 17:48:45.158165    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:48:45.168867    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:48:45.168925    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:48:45.179626    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:48:45.179701    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:48:45.190145    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:48:45.190214    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:48:45.200297    3955 logs.go:276] 0 containers: []
	W0814 17:48:45.200308    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:48:45.200368    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:48:45.210793    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:48:45.210808    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:48:45.210813    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:48:45.224753    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:48:45.224764    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:48:45.236635    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:48:45.236646    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:48:45.254503    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:48:45.254513    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:48:45.276867    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:48:45.276878    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:48:45.288607    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:48:45.288617    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:48:45.322725    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:48:45.322735    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:48:45.327362    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:48:45.327370    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:48:45.362561    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:48:45.362573    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:48:45.387495    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:48:45.387503    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:48:45.398415    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:48:45.398425    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:48:45.421412    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:48:45.421425    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:48:45.433109    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:48:45.433119    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:48:48.244385    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:47.949884    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:53.244953    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:53.245107    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:48:53.256887    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:48:53.256956    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:48:53.267958    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:48:53.268024    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:48:53.279475    3966 logs.go:276] 2 containers: [e503088d4f61 f805e836332e]
	I0814 17:48:53.279540    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:48:53.293231    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:48:53.293297    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:48:53.306170    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:48:53.306241    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:48:53.317024    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:48:53.317092    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:48:53.337896    3966 logs.go:276] 0 containers: []
	W0814 17:48:53.337910    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:48:53.337969    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:48:53.348551    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:48:53.348565    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:48:53.348570    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:48:53.372754    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:48:53.372765    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:48:53.383703    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:48:53.383721    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:48:53.388175    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:48:53.388182    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:48:53.423209    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:48:53.423220    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:48:53.437731    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:48:53.437740    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:48:53.451382    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:48:53.451397    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:48:53.463361    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:48:53.463375    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:48:53.478011    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:48:53.478021    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:48:53.512637    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:48:53.512646    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:48:53.524423    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:48:53.524436    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:48:53.538831    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:48:53.538842    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:48:53.556682    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:48:53.556693    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:48:56.070312    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:52.950846    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:52.951195    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:48:52.983082    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:48:52.983205    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:48:53.002088    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:48:53.002167    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:48:53.016318    3955 logs.go:276] 2 containers: [bfe8ad4481d2 5580c1df3209]
	I0814 17:48:53.016394    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:48:53.029098    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:48:53.029172    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:48:53.039889    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:48:53.039966    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:48:53.055038    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:48:53.055104    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:48:53.065535    3955 logs.go:276] 0 containers: []
	W0814 17:48:53.065546    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:48:53.065608    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:48:53.076682    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:48:53.076696    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:48:53.076702    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:48:53.110664    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:48:53.110675    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:48:53.115114    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:48:53.115121    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:48:53.151317    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:48:53.151328    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:48:53.163390    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:48:53.163403    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:48:53.179069    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:48:53.179081    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:48:53.196427    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:48:53.196438    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:48:53.207844    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:48:53.207859    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:48:53.224656    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:48:53.224665    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:48:53.238787    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:48:53.238796    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:48:53.251346    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:48:53.251359    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:48:53.268411    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:48:53.268419    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:48:53.281719    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:48:53.281729    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:48:55.810383    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:01.072465    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:01.072569    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:01.084092    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:49:01.084161    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:01.100096    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:49:01.100168    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:01.113385    3966 logs.go:276] 2 containers: [e503088d4f61 f805e836332e]
	I0814 17:49:01.113457    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:01.124158    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:49:01.124231    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:01.138200    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:49:01.138293    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:01.150914    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:49:01.150988    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:01.161773    3966 logs.go:276] 0 containers: []
	W0814 17:49:01.161785    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:01.161841    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:01.172333    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:49:01.172347    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:49:01.172352    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:49:01.183926    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:49:01.183935    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:49:01.195421    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:49:01.195433    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:49:01.214905    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:49:01.214919    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:49:01.232286    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:01.232299    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:01.267085    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:49:01.267098    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:49:01.281517    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:49:01.281529    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:49:01.296087    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:49:01.296097    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:49:01.310045    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:49:01.310056    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:49:01.323661    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:01.323672    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:01.346860    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:49:01.346871    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:01.359902    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:01.359914    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:01.395758    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:01.395767    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:00.812506    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:00.812654    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:00.826602    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:49:00.826681    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:00.838559    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:49:00.838627    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:00.849540    3955 logs.go:276] 2 containers: [bfe8ad4481d2 5580c1df3209]
	I0814 17:49:00.849610    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:00.860166    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:49:00.860239    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:00.873157    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:49:00.873229    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:00.883612    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:49:00.883682    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:00.895461    3955 logs.go:276] 0 containers: []
	W0814 17:49:00.895471    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:00.895528    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:00.906841    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:49:00.906856    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:00.906861    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:00.940300    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:49:00.940308    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:49:00.952494    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:49:00.952504    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:49:00.967454    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:49:00.967463    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:49:00.979251    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:49:00.979262    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:49:00.996495    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:49:00.996504    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:01.008068    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:01.008077    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:01.012399    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:01.012407    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:01.048848    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:49:01.048861    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:49:01.063900    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:49:01.063914    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:49:01.078000    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:49:01.078012    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:49:01.090907    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:49:01.090919    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:49:01.103607    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:01.103622    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:03.902427    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:03.630614    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:08.904543    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:08.904638    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:08.915090    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:49:08.915159    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:08.926170    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:49:08.926235    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:08.937696    3966 logs.go:276] 2 containers: [e503088d4f61 f805e836332e]
	I0814 17:49:08.937767    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:08.949114    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:49:08.949187    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:08.959961    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:49:08.960031    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:08.978534    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:49:08.978606    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:08.989220    3966 logs.go:276] 0 containers: []
	W0814 17:49:08.989231    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:08.989291    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:08.999960    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:49:08.999975    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:49:08.999980    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:49:09.014860    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:49:09.014869    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:49:09.026944    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:49:09.026954    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:49:09.044431    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:09.044442    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:09.069426    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:09.069434    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:09.074062    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:49:09.074070    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:49:09.088273    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:49:09.088284    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:49:09.104964    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:49:09.104974    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:49:09.116194    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:49:09.116204    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:49:09.128032    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:49:09.128044    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:49:09.147824    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:49:09.147835    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:09.159668    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:09.159677    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:09.196594    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:09.196605    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:11.737418    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:08.632809    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:08.632992    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:08.655780    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:49:08.655890    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:08.671635    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:49:08.671706    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:08.684268    3955 logs.go:276] 2 containers: [bfe8ad4481d2 5580c1df3209]
	I0814 17:49:08.684335    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:08.695303    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:49:08.695369    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:08.708516    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:49:08.708580    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:08.720259    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:49:08.720326    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:08.733454    3955 logs.go:276] 0 containers: []
	W0814 17:49:08.733463    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:08.733512    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:08.744534    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:49:08.744551    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:49:08.744557    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:08.757266    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:08.757281    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:08.793684    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:49:08.793697    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:49:08.806433    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:49:08.806446    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:49:08.820005    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:49:08.820021    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:49:08.832595    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:49:08.832606    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:49:08.844458    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:49:08.844472    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:49:08.863463    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:08.863473    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:08.886441    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:08.886447    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:08.920616    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:08.920629    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:08.926070    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:49:08.926083    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:49:08.942274    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:49:08.942285    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:49:08.957713    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:49:08.957724    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:49:11.476673    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:16.739639    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:16.739733    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:16.753651    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:49:16.753724    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:16.767634    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:49:16.767705    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:16.779544    3966 logs.go:276] 2 containers: [e503088d4f61 f805e836332e]
	I0814 17:49:16.779611    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:16.790762    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:49:16.790832    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:16.801946    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:49:16.802015    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:16.812852    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:49:16.812921    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:16.822965    3966 logs.go:276] 0 containers: []
	W0814 17:49:16.822975    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:16.823031    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:16.837432    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:49:16.837447    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:49:16.837452    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:49:16.849578    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:16.849592    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:16.854142    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:16.854151    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:16.888537    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:49:16.888547    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:49:16.902769    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:49:16.902782    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:49:16.914902    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:49:16.914917    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:49:16.926417    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:49:16.926426    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:49:16.945709    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:16.945723    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:16.981584    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:49:16.981592    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:49:16.995592    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:49:16.995606    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:49:17.013174    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:49:17.013189    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:49:17.028790    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:17.028805    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:17.054012    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:49:17.054020    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:16.478928    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:16.479074    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:16.491882    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:49:16.491953    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:16.503312    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:49:16.503379    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:16.514752    3955 logs.go:276] 2 containers: [bfe8ad4481d2 5580c1df3209]
	I0814 17:49:16.514825    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:16.526093    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:49:16.526165    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:16.537263    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:49:16.537333    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:16.548737    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:49:16.548813    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:16.559927    3955 logs.go:276] 0 containers: []
	W0814 17:49:16.559937    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:16.559998    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:16.570958    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:49:16.570974    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:49:16.570981    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:49:16.583366    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:16.583377    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:16.608124    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:49:16.608132    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:16.620692    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:16.620703    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:16.656399    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:16.656410    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:16.662214    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:49:16.662221    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:49:16.677025    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:49:16.677035    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:49:16.691817    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:49:16.691827    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:49:16.707879    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:16.707890    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:16.746316    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:49:16.746327    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:49:16.760742    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:49:16.760754    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:49:16.773997    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:49:16.774011    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:49:16.793587    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:49:16.793597    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:49:19.567319    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:19.309061    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:24.569425    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:24.569508    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:24.580742    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:49:24.580813    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:24.592262    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:49:24.592336    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:24.604158    3966 logs.go:276] 2 containers: [e503088d4f61 f805e836332e]
	I0814 17:49:24.604248    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:24.615944    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:49:24.616015    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:24.627817    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:49:24.627889    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:24.639471    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:49:24.639543    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:24.651003    3966 logs.go:276] 0 containers: []
	W0814 17:49:24.651015    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:24.651078    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:24.667717    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:49:24.667731    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:49:24.667738    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:49:24.680692    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:49:24.680704    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:49:24.699774    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:49:24.699788    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:49:24.716922    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:24.716936    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:24.753110    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:24.753120    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:24.757489    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:24.757495    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:24.807787    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:49:24.807802    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:49:24.826637    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:49:24.826646    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:49:24.840442    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:49:24.840454    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:49:24.858340    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:24.858353    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:24.883090    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:49:24.883098    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:24.894436    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:49:24.894445    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:49:24.911060    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:49:24.911070    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:49:24.311187    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:24.311471    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:24.336484    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:49:24.336588    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:24.353322    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:49:24.353403    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:24.372817    3955 logs.go:276] 2 containers: [bfe8ad4481d2 5580c1df3209]
	I0814 17:49:24.372887    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:24.383412    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:49:24.383479    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:24.394593    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:49:24.394659    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:24.406171    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:49:24.406237    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:24.417303    3955 logs.go:276] 0 containers: []
	W0814 17:49:24.417314    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:24.417370    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:24.428419    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:49:24.428437    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:49:24.428442    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:49:24.443925    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:49:24.443939    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:49:24.456246    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:49:24.456257    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:49:24.467986    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:24.467997    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:24.496781    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:49:24.496791    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:24.509522    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:49:24.509533    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:49:24.526295    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:49:24.526306    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:49:24.548490    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:24.548504    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:24.584136    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:24.584151    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:24.588843    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:24.588856    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:24.629871    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:49:24.629881    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:49:24.646440    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:49:24.646451    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:49:24.660023    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:49:24.660035    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:49:27.179189    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:27.427659    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:32.181358    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:32.181505    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:32.194604    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:49:32.194684    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:32.205255    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:49:32.205327    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:32.216434    3955 logs.go:276] 2 containers: [bfe8ad4481d2 5580c1df3209]
	I0814 17:49:32.216501    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:32.227130    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:49:32.227193    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:32.237730    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:49:32.237796    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:32.248121    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:49:32.248197    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:32.258457    3955 logs.go:276] 0 containers: []
	W0814 17:49:32.258473    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:32.258529    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:32.274078    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:49:32.274093    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:49:32.274098    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:49:32.286445    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:49:32.286456    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:49:32.297964    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:49:32.297976    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:49:32.313342    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:49:32.313353    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:49:32.330685    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:32.330695    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:32.355786    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:32.355795    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:32.359977    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:32.359985    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:32.393575    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:49:32.393588    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:49:32.418457    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:49:32.418467    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:49:32.430150    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:49:32.430161    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:32.442834    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:32.442842    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:32.480478    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:49:32.480499    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:49:32.496433    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:49:32.496443    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:49:32.429379    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:32.429475    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:32.441382    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:49:32.441455    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:32.457983    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:49:32.458058    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:32.472839    3966 logs.go:276] 2 containers: [e503088d4f61 f805e836332e]
	I0814 17:49:32.472914    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:32.484255    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:49:32.484326    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:32.495614    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:49:32.495681    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:32.506732    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:49:32.506807    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:32.518274    3966 logs.go:276] 0 containers: []
	W0814 17:49:32.518286    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:32.518345    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:32.528726    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:49:32.528740    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:32.528745    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:32.533384    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:32.533396    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:32.569037    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:49:32.569050    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:49:32.583339    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:49:32.583348    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:49:32.594714    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:49:32.594727    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:32.610824    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:32.610834    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:32.645309    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:49:32.645318    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:49:32.657638    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:49:32.657648    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:49:32.668671    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:49:32.668682    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:49:32.683291    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:49:32.683302    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:49:32.694434    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:49:32.694442    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:49:32.711743    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:32.711753    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:32.734850    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:49:32.734857    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:49:35.251889    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:35.011504    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:40.253935    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:40.254022    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:40.265820    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:49:40.265897    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:40.277070    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:49:40.277149    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:40.289036    3966 logs.go:276] 2 containers: [e503088d4f61 f805e836332e]
	I0814 17:49:40.289107    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:40.301585    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:49:40.301655    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:40.312296    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:49:40.312371    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:40.324388    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:49:40.324465    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:40.334753    3966 logs.go:276] 0 containers: []
	W0814 17:49:40.334766    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:40.334826    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:40.345414    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:49:40.345430    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:49:40.345435    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:40.357453    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:49:40.357467    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:49:40.371908    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:49:40.371916    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:49:40.385726    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:49:40.385741    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:49:40.396996    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:49:40.397005    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:49:40.411732    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:49:40.411742    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:49:40.428530    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:49:40.428544    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:49:40.440528    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:40.440539    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:40.463971    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:40.463981    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:40.498338    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:40.498354    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:40.503585    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:40.503593    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:40.538161    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:49:40.538176    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:49:40.550298    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:49:40.550308    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:49:40.013632    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:40.013765    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:40.029095    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:49:40.029167    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:40.040391    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:49:40.040464    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:40.050955    3955 logs.go:276] 2 containers: [bfe8ad4481d2 5580c1df3209]
	I0814 17:49:40.051023    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:40.061861    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:49:40.061923    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:40.072707    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:49:40.072779    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:40.082605    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:49:40.082668    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:40.093251    3955 logs.go:276] 0 containers: []
	W0814 17:49:40.093264    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:40.093322    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:40.103549    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:49:40.103564    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:49:40.103569    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:40.114879    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:40.114890    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:40.148339    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:49:40.148349    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:49:40.162762    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:49:40.162772    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:49:40.173990    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:49:40.174003    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:49:40.185117    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:49:40.185131    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:49:40.196364    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:40.196373    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:40.219811    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:40.219819    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:40.223744    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:40.223750    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:40.259023    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:49:40.259036    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:49:40.276822    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:49:40.276836    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:49:40.292606    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:49:40.292620    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:49:40.311392    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:49:40.311410    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:49:42.826682    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:43.064273    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:47.828798    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:47.829075    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:47.862748    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:49:47.862867    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:47.878782    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:49:47.878877    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:48.066403    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": dial tcp 10.0.2.15:8443: i/o timeout (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:48.066487    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:48.077668    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:49:48.077741    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:48.088779    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:49:48.088852    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:48.100301    3966 logs.go:276] 2 containers: [e503088d4f61 f805e836332e]
	I0814 17:49:48.100367    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:48.112080    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:49:48.112153    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:48.123868    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:49:48.123947    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:48.136698    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:49:48.136766    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:48.148610    3966 logs.go:276] 0 containers: []
	W0814 17:49:48.148622    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:48.148686    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:48.164064    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:49:48.164080    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:49:48.164084    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:49:48.175737    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:49:48.175749    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:48.190969    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:48.190981    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:48.227938    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:48.227952    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:48.232679    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:48.232686    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:48.268734    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:49:48.268745    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:49:48.282732    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:49:48.282745    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:49:48.294584    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:48.294595    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:48.317963    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:49:48.317971    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:49:48.338126    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:49:48.338165    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:49:48.350033    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:49:48.350047    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:49:48.365731    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:49:48.365742    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:49:48.388389    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:49:48.388400    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:49:50.907774    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:47.891925    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:49:47.891997    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:47.903272    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:49:47.903342    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:47.915983    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:49:47.916051    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:47.926642    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:49:47.926716    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:47.937266    3955 logs.go:276] 0 containers: []
	W0814 17:49:47.937278    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:47.937336    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:47.947813    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:49:47.947833    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:47.947839    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:47.982981    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:49:47.982991    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:49:47.998470    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:49:47.998481    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:48.010235    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:49:48.010245    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:49:48.022009    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:49:48.022021    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:49:48.033405    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:49:48.033418    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:49:48.045383    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:49:48.045395    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:49:48.057361    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:49:48.057371    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:49:48.075344    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:49:48.075357    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:49:48.091481    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:48.091493    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:48.095991    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:49:48.096002    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:49:48.114980    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:48.114993    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:48.140638    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:48.140654    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:48.176593    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:49:48.176609    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:49:48.192983    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:49:48.192992    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:49:50.708132    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:55.910093    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:55.910182    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:55.921853    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:49:55.921926    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:55.932624    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:49:55.932696    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:55.943689    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:49:55.943764    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:55.954840    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:49:55.954908    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:55.965981    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:49:55.966058    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:55.977763    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:49:55.977840    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:55.995719    3966 logs.go:276] 0 containers: []
	W0814 17:49:55.995733    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:55.995797    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:56.007212    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:49:56.007230    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:49:56.007236    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:49:56.022649    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:49:56.022662    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:49:56.039302    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:56.039313    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:56.064814    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:49:56.064829    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:56.077216    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:56.077228    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:56.081584    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:49:56.081590    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:49:56.096527    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:49:56.096537    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:49:56.108220    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:56.108231    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:56.152291    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:49:56.152306    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:49:56.166245    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:49:56.166256    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:49:56.177924    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:49:56.177934    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:49:56.189436    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:49:56.189447    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:49:56.201606    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:49:56.201621    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:49:56.217988    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:56.218000    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:56.253951    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:49:56.253961    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:49:55.710371    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:55.710512    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:55.724029    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:49:55.724112    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:55.735270    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:49:55.735346    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:55.746102    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:49:55.746174    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:55.757909    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:49:55.757980    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:55.768208    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:49:55.768279    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:55.778864    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:49:55.778931    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:55.789033    3955 logs.go:276] 0 containers: []
	W0814 17:49:55.789044    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:55.789102    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:55.799107    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:49:55.799124    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:49:55.799132    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:49:55.810288    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:49:55.810298    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:49:55.821797    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:49:55.821810    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:55.834319    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:49:55.834333    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:49:55.845763    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:55.845777    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:55.881095    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:49:55.881103    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:49:55.895178    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:49:55.895188    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:49:55.912501    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:55.912511    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:55.938360    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:55.938374    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:55.979830    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:49:55.979843    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:49:55.996659    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:49:55.996668    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:49:56.015127    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:49:56.015139    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:49:56.031258    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:56.031274    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:56.035765    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:49:56.035774    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:49:56.051028    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:49:56.051038    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:49:58.768497    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:58.574287    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:03.769010    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:03.769094    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:03.781024    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:50:03.781105    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:03.792945    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:50:03.793016    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:03.804899    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:50:03.804979    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:03.816220    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:50:03.816291    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:03.827757    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:50:03.827828    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:03.839197    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:50:03.839266    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:03.851032    3966 logs.go:276] 0 containers: []
	W0814 17:50:03.851045    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:03.851108    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:03.867209    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:50:03.867230    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:50:03.867234    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:50:03.883121    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:03.883130    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:03.908890    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:03.908907    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:03.913844    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:50:03.913856    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:50:03.926830    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:50:03.926841    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:50:03.946047    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:50:03.946058    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:50:03.957728    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:50:03.957739    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:03.969284    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:03.969295    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:04.003891    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:04.003899    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:04.079950    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:50:04.079964    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:50:04.095092    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:50:04.095103    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:50:04.107367    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:50:04.107379    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:50:04.129777    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:50:04.129793    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:50:04.155481    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:50:04.155493    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:50:04.166502    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:50:04.166511    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:50:06.679930    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:03.576489    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:03.576690    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:03.590593    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:50:03.590675    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:03.602293    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:50:03.602366    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:03.620558    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:50:03.620628    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:03.631610    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:50:03.631676    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:03.642030    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:50:03.642092    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:03.652253    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:50:03.652318    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:03.662585    3955 logs.go:276] 0 containers: []
	W0814 17:50:03.662595    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:03.662647    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:03.672616    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:50:03.672632    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:03.672638    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:03.706475    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:03.706483    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:03.742536    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:50:03.742550    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:50:03.757507    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:50:03.757518    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:50:03.771198    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:50:03.771211    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:50:03.783816    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:50:03.783828    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:50:03.800912    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:50:03.800928    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:50:03.813959    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:03.813972    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:03.840751    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:03.840767    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:03.845957    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:50:03.845969    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:50:03.868824    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:50:03.868833    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:50:03.880841    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:50:03.880856    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:50:03.892739    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:50:03.892751    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:50:03.905370    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:50:03.905381    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:50:03.924032    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:50:03.924045    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:06.438688    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:11.681190    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:11.681285    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:11.692735    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:50:11.692808    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:11.703666    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:50:11.703737    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:11.715844    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:50:11.715918    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:11.727839    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:50:11.727913    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:11.739008    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:50:11.739079    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:11.750128    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:50:11.750196    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:11.760613    3966 logs.go:276] 0 containers: []
	W0814 17:50:11.760624    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:11.760680    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:11.771888    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:50:11.771905    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:11.771911    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:11.777026    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:50:11.777035    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:50:11.789154    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:50:11.789165    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:50:11.802327    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:50:11.802336    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:50:11.815216    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:50:11.815227    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:11.827861    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:11.827876    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:11.863983    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:50:11.863991    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:50:11.878579    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:50:11.878593    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:50:11.890220    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:50:11.890232    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:50:11.902184    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:50:11.902198    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:50:11.914566    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:11.914575    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:11.950900    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:50:11.950912    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:50:11.966306    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:11.966320    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:11.991733    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:50:11.991742    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:50:12.005701    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:50:12.005715    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:50:11.440955    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:11.441203    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:11.466259    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:50:11.466374    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:11.482724    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:50:11.482798    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:11.497607    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:50:11.497698    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:11.508426    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:50:11.508496    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:11.518751    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:50:11.518814    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:11.529321    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:50:11.529386    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:11.539411    3955 logs.go:276] 0 containers: []
	W0814 17:50:11.539425    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:11.539478    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:11.550166    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:50:11.550184    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:11.550189    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:11.554809    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:50:11.554815    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:50:11.566332    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:50:11.566346    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:50:11.578475    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:50:11.578488    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:50:11.593943    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:50:11.593956    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:50:11.606016    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:50:11.606028    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:50:11.623991    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:11.624005    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:11.659778    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:50:11.659786    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:50:11.670946    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:50:11.670957    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:50:11.683058    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:11.683068    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:11.721547    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:50:11.721558    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:50:11.737019    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:50:11.737035    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:50:11.760701    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:50:11.760709    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:50:11.773928    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:11.773938    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:11.801000    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:50:11.801013    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:14.529911    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:14.315969    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:19.531965    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:19.532056    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:19.543767    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:50:19.543838    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:19.556753    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:50:19.556823    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:19.568829    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:50:19.568906    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:19.581906    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:50:19.581979    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:19.592834    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:50:19.592902    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:19.603899    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:50:19.603963    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:19.614838    3966 logs.go:276] 0 containers: []
	W0814 17:50:19.614850    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:19.614915    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:19.626882    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:50:19.626902    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:50:19.626907    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:19.639378    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:50:19.639389    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:50:19.655245    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:50:19.655258    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:50:19.667954    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:50:19.667968    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:50:19.680187    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:50:19.680199    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:50:19.691820    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:19.691830    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:19.716736    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:19.716744    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:19.752383    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:50:19.752394    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:50:19.764519    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:50:19.764534    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:50:19.776545    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:19.776560    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:19.781025    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:19.781032    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:19.816339    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:50:19.816351    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:50:19.830581    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:50:19.830589    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:50:19.842122    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:50:19.842138    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:50:19.859851    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:50:19.859862    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:50:19.318155    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:19.318353    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:19.334542    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:50:19.334624    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:19.355943    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:50:19.356014    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:19.366634    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:50:19.366709    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:19.377272    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:50:19.377343    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:19.388489    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:50:19.388556    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:19.399009    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:50:19.399076    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:19.409007    3955 logs.go:276] 0 containers: []
	W0814 17:50:19.409017    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:19.409074    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:19.419180    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:50:19.419198    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:50:19.419204    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:50:19.433420    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:50:19.433430    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:50:19.445120    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:50:19.445131    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:50:19.458981    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:50:19.458992    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:19.470640    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:19.470649    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:19.503889    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:19.503896    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:19.508221    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:50:19.508232    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:50:19.524631    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:50:19.524643    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:50:19.536807    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:50:19.536821    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:50:19.552109    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:50:19.552121    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:50:19.564167    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:50:19.564180    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:50:19.576617    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:19.576631    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:19.603501    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:19.603514    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:19.645294    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:50:19.645307    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:50:19.662387    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:50:19.662400    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:50:22.183629    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:22.376519    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:27.185806    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:27.185993    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:27.203015    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:50:27.203106    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:27.217093    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:50:27.217173    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:27.228563    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:50:27.228639    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:27.243531    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:50:27.243602    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:27.254616    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:50:27.254692    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:27.267211    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:50:27.267281    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:27.278416    3955 logs.go:276] 0 containers: []
	W0814 17:50:27.278428    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:27.278488    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:27.289466    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:50:27.289485    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:27.289491    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:27.323399    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:50:27.323410    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:50:27.337449    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:50:27.337460    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:50:27.351487    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:50:27.351498    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:50:27.362749    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:27.362759    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:27.366910    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:50:27.366918    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:50:27.378634    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:50:27.378642    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:50:27.395231    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:27.395243    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:27.421606    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:27.421619    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:27.460703    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:50:27.460717    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:50:27.473686    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:50:27.473699    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:50:27.485947    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:50:27.485961    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:27.498553    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:50:27.498565    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:50:27.512498    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:50:27.512511    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:50:27.524695    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:50:27.524708    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:50:27.378043    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": dial tcp 10.0.2.15:8443: i/o timeout (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:27.378130    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:27.390157    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:50:27.390224    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:27.401593    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:50:27.401661    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:27.412699    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:50:27.412773    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:27.423742    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:50:27.423807    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:27.435272    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:50:27.435347    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:27.446545    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:50:27.446621    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:27.457264    3966 logs.go:276] 0 containers: []
	W0814 17:50:27.457277    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:27.457340    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:27.468640    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:50:27.468661    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:27.468668    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:27.513043    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:50:27.513052    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:50:27.527931    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:50:27.527942    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:50:27.545528    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:50:27.545541    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:50:27.557295    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:50:27.557310    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:50:27.571683    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:50:27.571697    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:50:27.584107    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:50:27.584117    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:50:27.601816    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:27.601829    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:27.625587    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:50:27.625595    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:27.637430    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:27.637440    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:27.671663    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:27.671671    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:27.676025    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:50:27.676031    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:50:27.687752    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:50:27.687762    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:50:27.699278    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:50:27.699287    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:50:27.718365    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:50:27.718375    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:50:30.231914    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:30.045411    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:35.233936    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:35.234037    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:35.246159    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:50:35.246237    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:35.258304    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:50:35.258369    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:35.270315    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:50:35.270388    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:35.281961    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:50:35.282043    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:35.293078    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:50:35.293143    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:35.305227    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:50:35.305294    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:35.316258    3966 logs.go:276] 0 containers: []
	W0814 17:50:35.316269    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:35.316328    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:35.329537    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:50:35.329556    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:50:35.329562    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:50:35.348503    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:35.348519    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:35.374857    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:35.374873    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:35.418600    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:50:35.418609    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:50:35.433459    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:50:35.433467    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:50:35.448301    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:50:35.448308    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:50:35.461292    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:35.461303    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:35.495375    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:35.495384    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:35.499812    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:50:35.499819    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:50:35.514631    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:50:35.514642    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:50:35.529742    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:50:35.529755    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:50:35.541711    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:50:35.541724    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:50:35.554016    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:50:35.554027    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:50:35.568750    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:50:35.568760    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:50:35.579867    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:50:35.579878    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:35.047511    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:35.047813    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:35.073736    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:50:35.073857    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:35.091035    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:50:35.091123    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:35.104628    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:50:35.104708    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:35.116378    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:50:35.116442    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:35.129352    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:50:35.129427    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:35.140678    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:50:35.140750    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:35.150823    3955 logs.go:276] 0 containers: []
	W0814 17:50:35.150836    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:35.150895    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:35.161704    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:50:35.161721    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:50:35.161728    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:50:35.174851    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:50:35.174862    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:50:35.187491    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:50:35.187501    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:50:35.205701    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:50:35.205711    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:50:35.217471    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:50:35.217482    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:50:35.231249    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:50:35.231259    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:50:35.243939    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:50:35.243952    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:50:35.256936    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:50:35.256949    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:35.270289    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:35.270304    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:35.295886    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:35.295898    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:35.331912    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:35.331922    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:35.336677    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:35.336687    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:35.415735    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:50:35.415749    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:50:35.431533    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:50:35.431544    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:50:35.447111    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:50:35.447122    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:50:38.093599    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:37.963506    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:43.095614    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:43.095731    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:43.107174    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:50:43.107245    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:43.118631    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:50:43.118699    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:43.131025    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:50:43.131101    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:43.144401    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:50:43.144468    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:43.155241    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:50:43.155312    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:43.166602    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:50:43.166671    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:43.177404    3966 logs.go:276] 0 containers: []
	W0814 17:50:43.177411    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:43.177468    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:43.191625    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:50:43.191641    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:50:43.191646    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:50:43.204367    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:50:43.204376    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:50:43.217422    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:50:43.217429    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:50:43.230530    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:50:43.230544    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:43.244538    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:43.244551    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:43.249329    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:50:43.249337    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:50:43.261818    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:50:43.261826    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:50:43.274591    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:50:43.274603    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:50:43.287045    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:43.287056    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:43.325548    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:43.325563    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:43.356889    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:43.356903    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:43.391677    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:50:43.391692    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:50:43.411202    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:50:43.411214    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:50:43.425695    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:50:43.425706    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:50:43.440404    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:50:43.440415    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:50:45.960136    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:42.965601    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:42.965760    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:42.978604    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:50:42.978678    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:42.989513    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:50:42.989587    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:43.000369    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:50:43.000445    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:43.011233    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:50:43.011301    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:43.024512    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:50:43.024579    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:43.035147    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:50:43.035220    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:43.045891    3955 logs.go:276] 0 containers: []
	W0814 17:50:43.045906    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:43.045967    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:43.057210    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:50:43.057228    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:50:43.057233    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:50:43.068634    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:50:43.068645    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:50:43.080415    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:43.080424    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:43.125410    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:50:43.125422    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:50:43.141407    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:50:43.141419    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:50:43.158315    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:50:43.158325    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:50:43.176636    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:50:43.176653    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:50:43.189091    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:50:43.189103    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:50:43.204224    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:50:43.204236    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:50:43.217402    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:50:43.217414    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:50:43.231824    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:50:43.231832    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:50:43.248131    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:50:43.248141    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:43.261643    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:43.261655    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:43.300869    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:43.300882    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:43.306341    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:43.306350    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:45.834560    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:50.962213    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:50.962293    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:50.974039    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:50:50.974111    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:50.986074    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:50:50.986149    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:50.997388    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:50:50.997462    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:51.008666    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:50:51.008737    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:51.020218    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:50:51.020285    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:51.034018    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:50:51.034087    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:51.045354    3966 logs.go:276] 0 containers: []
	W0814 17:50:51.045365    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:51.045427    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:51.056696    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:50:51.056717    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:50:51.056723    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:50:51.069233    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:50:51.069244    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:50:51.081922    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:50:51.081934    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:50:51.098625    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:50:51.098640    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:51.111549    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:51.111562    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:51.151888    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:50:51.151900    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:50:51.164842    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:51.164858    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:51.191478    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:50:51.191492    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:50:51.206213    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:50:51.206229    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:50:51.224248    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:50:51.224260    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:50:51.236316    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:50:51.236332    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:50:51.250779    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:50:51.250790    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:50:51.263035    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:50:51.263047    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:50:51.275141    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:51.275153    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:51.312269    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:51.312284    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:50.836655    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:50.836920    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:50.855124    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:50:50.855208    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:50.868506    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:50:50.868582    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:50.880663    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:50:50.880732    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:50.891409    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:50:50.891473    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:50.901579    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:50:50.901637    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:50.911863    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:50:50.911930    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:50.922033    3955 logs.go:276] 0 containers: []
	W0814 17:50:50.922043    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:50.922093    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:50.933103    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:50:50.933122    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:50.933126    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:50.959260    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:50:50.959271    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:50:50.973744    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:50:50.973756    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:50:50.989914    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:50:50.989926    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:50:51.005380    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:51.005391    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:51.042668    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:50:51.042682    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:50:51.062547    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:50:51.062558    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:50:51.075156    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:50:51.075173    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:50:51.088631    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:51.088643    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:51.093216    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:51.093226    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:51.132672    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:50:51.132684    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:50:51.145557    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:50:51.145569    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:51.158374    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:50:51.158385    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:50:51.176996    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:50:51.177011    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:50:51.189698    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:50:51.189708    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:50:53.818766    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:53.706677    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:58.820598    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:58.820651    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:58.831926    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:50:58.831992    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:58.843060    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:50:58.843130    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:58.854898    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:50:58.854967    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:58.865856    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:50:58.865930    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:58.881078    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:50:58.881144    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:58.900658    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:50:58.900728    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:58.911046    3966 logs.go:276] 0 containers: []
	W0814 17:50:58.911059    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:58.911121    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:58.923066    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:50:58.923086    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:50:58.923091    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:50:58.936246    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:50:58.936260    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:50:58.952726    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:58.952737    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:58.990702    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:50:58.990726    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:50:59.004162    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:59.004175    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:59.008653    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:50:59.008664    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:50:59.032871    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:50:59.032883    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:50:59.045194    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:50:59.045207    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:50:59.058402    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:50:59.058412    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:50:59.071439    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:50:59.071455    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:59.083854    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:59.083868    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:59.121241    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:50:59.121252    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:50:59.133509    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:50:59.133520    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:50:59.151994    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:59.152004    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:59.176461    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:50:59.176468    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:51:01.691836    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:58.708998    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:58.709374    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:58.742375    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:50:58.742509    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:58.763606    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:50:58.763719    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:58.777807    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:50:58.777898    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:58.795089    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:50:58.795162    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:58.807495    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:50:58.807558    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:58.818981    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:50:58.819046    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:58.830024    3955 logs.go:276] 0 containers: []
	W0814 17:50:58.830037    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:58.830099    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:58.842034    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:50:58.842055    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:50:58.842061    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:50:58.854824    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:58.854838    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:58.879944    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:58.879960    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:58.918065    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:50:58.918082    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:50:58.933384    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:50:58.933400    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:50:58.946010    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:50:58.946023    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:58.958494    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:58.958506    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:58.997299    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:50:58.997312    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:50:59.010397    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:50:59.010406    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:50:59.022951    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:50:59.022962    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:50:59.036920    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:50:59.036934    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:50:59.056247    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:59.056260    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:59.061496    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:50:59.061506    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:50:59.076882    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:50:59.076896    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:50:59.091629    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:50:59.091641    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:51:01.609283    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:51:06.693936    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:51:06.694011    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:51:06.708534    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:51:06.708596    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:51:06.720019    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:51:06.720089    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:51:06.732988    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:51:06.733067    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:51:06.749007    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:51:06.749068    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:51:06.759855    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:51:06.759924    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:51:06.777013    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:51:06.777083    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:51:06.788332    3966 logs.go:276] 0 containers: []
	W0814 17:51:06.788670    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:51:06.788797    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:51:06.808315    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:51:06.808338    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:51:06.808344    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:51:06.826412    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:51:06.826423    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:51:06.838905    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:51:06.838919    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:51:06.875829    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:51:06.875850    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:51:06.880783    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:51:06.880790    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:51:06.896027    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:51:06.896045    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:51:06.907974    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:51:06.907986    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:51:06.923965    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:51:06.923984    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:51:06.939085    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:51:06.939096    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:51:06.964867    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:51:06.964880    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:51:07.001606    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:51:07.001617    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:51:07.013238    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:51:07.013253    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:51:07.025027    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:51:07.025038    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:51:07.041528    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:51:07.041540    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:51:07.055951    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:51:07.055961    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:51:06.611407    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:51:06.611515    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:51:06.623478    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:51:06.623546    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:51:06.637972    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:51:06.638036    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:51:06.648364    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:51:06.648433    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:51:06.658928    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:51:06.658988    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:51:06.675225    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:51:06.675288    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:51:06.691301    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:51:06.691369    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:51:06.702265    3955 logs.go:276] 0 containers: []
	W0814 17:51:06.702278    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:51:06.702332    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:51:06.713817    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:51:06.713835    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:51:06.713840    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:51:06.727486    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:51:06.727498    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:51:06.752132    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:51:06.752144    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:51:06.765174    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:51:06.765185    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:51:06.777892    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:51:06.777901    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:51:06.790995    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:51:06.791006    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:51:06.803547    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:51:06.803558    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:51:06.822167    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:51:06.822181    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:51:06.827148    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:51:06.827155    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:51:06.864496    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:51:06.864512    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:51:06.879965    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:51:06.879974    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:51:06.916083    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:51:06.916105    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:51:06.936141    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:51:06.936153    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:51:06.950972    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:51:06.950987    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:51:06.963116    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:51:06.963127    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:51:09.569539    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:51:09.478412    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:51:14.571629    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:51:14.571710    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:51:14.582854    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:51:14.582924    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:51:14.594274    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:51:14.594345    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:51:14.606160    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:51:14.606235    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:51:14.618276    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:51:14.618345    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:51:14.629689    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:51:14.629754    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:51:14.641557    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:51:14.641631    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:51:14.652927    3966 logs.go:276] 0 containers: []
	W0814 17:51:14.652939    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:51:14.652995    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:51:14.664152    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:51:14.664170    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:51:14.664176    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:51:14.668882    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:51:14.668892    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:51:14.706974    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:51:14.706987    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:51:14.719967    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:51:14.719979    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:51:14.756449    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:51:14.756462    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:51:14.776295    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:51:14.776306    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:51:14.791293    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:51:14.791308    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:51:14.804378    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:51:14.804389    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:51:14.816959    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:51:14.816970    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:51:14.829278    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:51:14.829290    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:51:14.841713    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:51:14.841726    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:51:14.853578    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:51:14.853589    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:51:14.869409    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:51:14.869420    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:51:14.887172    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:51:14.887182    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:51:14.898816    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:51:14.898829    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:51:14.480573    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:51:14.480689    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:51:14.491840    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:51:14.491919    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:51:14.502571    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:51:14.502643    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:51:14.513736    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:51:14.513813    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:51:14.525292    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:51:14.525369    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:51:14.537293    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:51:14.537374    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:51:14.548977    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:51:14.549050    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:51:14.562950    3955 logs.go:276] 0 containers: []
	W0814 17:51:14.562961    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:51:14.563022    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:51:14.574405    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:51:14.574421    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:51:14.574427    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:51:14.589043    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:51:14.589055    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:51:14.602432    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:51:14.602444    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:51:14.615006    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:51:14.615021    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:51:14.630469    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:51:14.630479    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:51:14.642797    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:51:14.642805    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:51:14.662095    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:51:14.662112    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:51:14.677913    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:51:14.677926    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:51:14.682471    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:51:14.682481    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:51:14.721319    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:51:14.721326    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:51:14.737718    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:51:14.737729    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:51:14.756651    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:51:14.756659    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:51:14.781775    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:51:14.781793    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:51:14.794701    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:51:14.794715    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:51:14.830436    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:51:14.830451    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:51:17.345768    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:51:17.424780    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:51:22.348050    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:51:22.348336    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:51:22.374125    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:51:22.374246    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:51:22.390441    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:51:22.390521    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:51:22.403894    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:51:22.403967    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:51:22.416664    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:51:22.416735    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:51:22.427467    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:51:22.427499    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:51:22.445740    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:51:22.445792    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:51:22.456764    3955 logs.go:276] 0 containers: []
	W0814 17:51:22.456776    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:51:22.456842    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:51:22.468310    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:51:22.468331    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:51:22.468337    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:51:22.481508    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:51:22.481521    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:51:22.493810    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:51:22.493822    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:51:22.506583    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:51:22.506600    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:51:22.519197    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:51:22.519213    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:51:22.531824    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:51:22.531837    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:51:22.544298    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:51:22.544310    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:51:22.557765    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:51:22.557777    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:51:22.585386    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:51:22.585413    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:51:22.590360    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:51:22.590368    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:51:22.630009    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:51:22.630022    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:51:22.648993    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:51:22.649006    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:51:22.664318    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:51:22.664330    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:51:22.683476    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:51:22.683488    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:51:22.701838    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:51:22.701855    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:51:22.426988    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:51:22.427097    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:51:22.443658    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:51:22.443731    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:51:22.457642    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:51:22.457682    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:51:22.469136    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:51:22.469207    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:51:22.485252    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:51:22.485325    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:51:22.497104    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:51:22.497173    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:51:22.508697    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:51:22.508764    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:51:22.520646    3966 logs.go:276] 0 containers: []
	W0814 17:51:22.520657    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:51:22.520721    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:51:22.532065    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:51:22.532081    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:51:22.532085    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:51:22.570457    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:51:22.570469    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:51:22.593384    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:51:22.593393    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:51:22.619058    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:51:22.619074    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:51:22.631881    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:51:22.631890    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:51:22.636673    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:51:22.636684    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:51:22.675676    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:51:22.675689    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:51:22.691252    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:51:22.691264    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:51:22.705888    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:51:22.705899    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:51:22.719143    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:51:22.719154    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:51:22.735118    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:51:22.735132    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:51:22.749560    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:51:22.749573    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:51:22.761306    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:51:22.761315    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:51:22.772910    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:51:22.772920    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:51:22.785381    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:51:22.785398    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:51:25.302442    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:51:25.240028    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:51:30.242413    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:51:30.247225    3955 out.go:177] 
	W0814 17:51:30.251192    3955 out.go:239] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: context deadline exceeded
	W0814 17:51:30.251208    3955 out.go:239] * 
	W0814 17:51:30.252436    3955 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:51:30.263127    3955 out.go:177] 
	I0814 17:51:30.304630    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:51:30.304742    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:51:30.320716    3966 logs.go:276] 1 containers: [d12eaf92ab6f]
	I0814 17:51:30.320806    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:51:30.334292    3966 logs.go:276] 1 containers: [3c60e8bda603]
	I0814 17:51:30.334369    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:51:30.349703    3966 logs.go:276] 4 containers: [2259f3a462ee 49dd660513a8 e503088d4f61 f805e836332e]
	I0814 17:51:30.349775    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:51:30.362328    3966 logs.go:276] 1 containers: [2cd3b4e0d744]
	I0814 17:51:30.362396    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:51:30.377867    3966 logs.go:276] 1 containers: [36f3b8954db0]
	I0814 17:51:30.377945    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:51:30.390599    3966 logs.go:276] 1 containers: [b1a83b84d3ff]
	I0814 17:51:30.390666    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:51:30.403149    3966 logs.go:276] 0 containers: []
	W0814 17:51:30.403161    3966 logs.go:278] No container was found matching "kindnet"
	I0814 17:51:30.403201    3966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:51:30.414089    3966 logs.go:276] 1 containers: [0144ba8035a5]
	I0814 17:51:30.414109    3966 logs.go:123] Gathering logs for kube-apiserver [d12eaf92ab6f] ...
	I0814 17:51:30.414115    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d12eaf92ab6f"
	I0814 17:51:30.429036    3966 logs.go:123] Gathering logs for etcd [3c60e8bda603] ...
	I0814 17:51:30.429046    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c60e8bda603"
	I0814 17:51:30.442903    3966 logs.go:123] Gathering logs for coredns [2259f3a462ee] ...
	I0814 17:51:30.442925    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2259f3a462ee"
	I0814 17:51:30.461331    3966 logs.go:123] Gathering logs for coredns [e503088d4f61] ...
	I0814 17:51:30.461349    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e503088d4f61"
	I0814 17:51:30.483095    3966 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:51:30.483116    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:51:30.545207    3966 logs.go:123] Gathering logs for coredns [49dd660513a8] ...
	I0814 17:51:30.545227    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49dd660513a8"
	I0814 17:51:30.567766    3966 logs.go:123] Gathering logs for storage-provisioner [0144ba8035a5] ...
	I0814 17:51:30.567784    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0144ba8035a5"
	I0814 17:51:30.591429    3966 logs.go:123] Gathering logs for Docker ...
	I0814 17:51:30.591448    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:51:30.617596    3966 logs.go:123] Gathering logs for container status ...
	I0814 17:51:30.617607    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:51:30.629515    3966 logs.go:123] Gathering logs for dmesg ...
	I0814 17:51:30.629526    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:51:30.634736    3966 logs.go:123] Gathering logs for coredns [f805e836332e] ...
	I0814 17:51:30.634745    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f805e836332e"
	I0814 17:51:30.647465    3966 logs.go:123] Gathering logs for kube-scheduler [2cd3b4e0d744] ...
	I0814 17:51:30.647476    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2cd3b4e0d744"
	I0814 17:51:30.663172    3966 logs.go:123] Gathering logs for kube-proxy [36f3b8954db0] ...
	I0814 17:51:30.663184    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36f3b8954db0"
	I0814 17:51:30.676942    3966 logs.go:123] Gathering logs for kube-controller-manager [b1a83b84d3ff] ...
	I0814 17:51:30.676954    3966 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1a83b84d3ff"
	I0814 17:51:30.697318    3966 logs.go:123] Gathering logs for kubelet ...
	I0814 17:51:30.697338    3966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:51:33.236782    3966 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:51:38.238957    3966 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:51:38.243312    3966 out.go:177] 
	W0814 17:51:38.247326    3966 out.go:239] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: context deadline exceeded
	W0814 17:51:38.247332    3966 out.go:239] * 
	W0814 17:51:38.247800    3966 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:51:38.258352    3966 out.go:177] 
	
	
	==> Docker <==
	-- Journal begins at Thu 2024-08-15 00:42:31 UTC, ends at Thu 2024-08-15 00:51:54 UTC. --
	Aug 15 00:51:38 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:38Z" level=error msg="ContainerStats resp: {0x40008da100 linux}"
	Aug 15 00:51:38 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:38Z" level=error msg="ContainerStats resp: {0x40003a0bc0 linux}"
	Aug 15 00:51:38 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:38Z" level=error msg="ContainerStats resp: {0x40008dacc0 linux}"
	Aug 15 00:51:39 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:39Z" level=info msg="Using CNI configuration file /etc/cni/net.d/1-k8s.conflist"
	Aug 15 00:51:39 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:39Z" level=error msg="ContainerStats resp: {0x4000486040 linux}"
	Aug 15 00:51:40 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:40Z" level=error msg="ContainerStats resp: {0x40008a5ac0 linux}"
	Aug 15 00:51:40 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:40Z" level=error msg="ContainerStats resp: {0x40008a5c00 linux}"
	Aug 15 00:51:40 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:40Z" level=error msg="ContainerStats resp: {0x4000746440 linux}"
	Aug 15 00:51:40 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:40Z" level=error msg="ContainerStats resp: {0x4000678540 linux}"
	Aug 15 00:51:40 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:40Z" level=error msg="ContainerStats resp: {0x4000746b80 linux}"
	Aug 15 00:51:40 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:40Z" level=error msg="ContainerStats resp: {0x40007473c0 linux}"
	Aug 15 00:51:40 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:40Z" level=error msg="ContainerStats resp: {0x4000747800 linux}"
	Aug 15 00:51:44 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:44Z" level=info msg="Using CNI configuration file /etc/cni/net.d/1-k8s.conflist"
	Aug 15 00:51:49 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:49Z" level=info msg="Using CNI configuration file /etc/cni/net.d/1-k8s.conflist"
	Aug 15 00:51:50 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:50Z" level=error msg="ContainerStats resp: {0x40007b4d80 linux}"
	Aug 15 00:51:50 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:50Z" level=error msg="ContainerStats resp: {0x40007b5440 linux}"
	Aug 15 00:51:51 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:51Z" level=error msg="ContainerStats resp: {0x4000486800 linux}"
	Aug 15 00:51:52 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:52Z" level=error msg="ContainerStats resp: {0x4000679a40 linux}"
	Aug 15 00:51:52 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:52Z" level=error msg="ContainerStats resp: {0x4000487800 linux}"
	Aug 15 00:51:52 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:52Z" level=error msg="ContainerStats resp: {0x40001a07c0 linux}"
	Aug 15 00:51:52 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:52Z" level=error msg="ContainerStats resp: {0x40001a1080 linux}"
	Aug 15 00:51:52 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:52Z" level=error msg="ContainerStats resp: {0x400009db80 linux}"
	Aug 15 00:51:52 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:52Z" level=error msg="ContainerStats resp: {0x4000912380 linux}"
	Aug 15 00:51:52 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:52Z" level=error msg="ContainerStats resp: {0x4000746840 linux}"
	Aug 15 00:51:54 running-upgrade-987000 cri-dockerd[4240]: time="2024-08-15T00:51:54Z" level=info msg="Using CNI configuration file /etc/cni/net.d/1-k8s.conflist"
	
	
	==> container status <==
	CONTAINER           IMAGE               CREATED             STATE               NAME                      ATTEMPT             POD ID
	32186022430fd       edaa71f2aee88       16 seconds ago      Running             coredns                   2                   925447a532586
	847b43368b4ef       edaa71f2aee88       16 seconds ago      Running             coredns                   2                   bb1391a16c8a6
	2259f3a462eef       edaa71f2aee88       2 minutes ago       Exited              coredns                   1                   925447a532586
	49dd660513a89       edaa71f2aee88       2 minutes ago       Exited              coredns                   1                   bb1391a16c8a6
	36f3b8954db06       fcbd620bbac08       4 minutes ago       Running             kube-proxy                0                   beb661b2b6bb3
	0144ba8035a5a       ba04bb24b9575       4 minutes ago       Running             storage-provisioner       0                   0bc6efb5946e0
	d12eaf92ab6f2       7c5896a75862a       4 minutes ago       Running             kube-apiserver            0                   97d24fc346828
	3c60e8bda6033       a9a710bb96df0       4 minutes ago       Running             etcd                      0                   28c4de9e5bca4
	2cd3b4e0d7441       000c19baf6bba       4 minutes ago       Running             kube-scheduler            0                   4f8b65eb40fb0
	b1a83b84d3fff       f61bbe9259d7c       4 minutes ago       Running             kube-controller-manager   0                   fcba9deee4c50
	
	
	==> coredns [2259f3a462ee] <==
	[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
	.:53
	[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7
	CoreDNS-1.8.6
	linux/arm64, go1.17.1, 13a9191
	[ERROR] plugin/errors: 2 1135552938015579660.7005796552063751288. HINFO: read udp 10.244.0.3:53501->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 1135552938015579660.7005796552063751288. HINFO: read udp 10.244.0.3:56768->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 1135552938015579660.7005796552063751288. HINFO: read udp 10.244.0.3:44858->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 1135552938015579660.7005796552063751288. HINFO: read udp 10.244.0.3:45864->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 1135552938015579660.7005796552063751288. HINFO: read udp 10.244.0.3:51447->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 1135552938015579660.7005796552063751288. HINFO: read udp 10.244.0.3:60188->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 1135552938015579660.7005796552063751288. HINFO: read udp 10.244.0.3:55647->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 1135552938015579660.7005796552063751288. HINFO: read udp 10.244.0.3:32794->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 1135552938015579660.7005796552063751288. HINFO: read udp 10.244.0.3:48526->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 1135552938015579660.7005796552063751288. HINFO: read udp 10.244.0.3:36606->10.0.2.3:53: i/o timeout
	[INFO] SIGTERM: Shutting down servers then terminating
	[INFO] plugin/health: Going into lameduck mode for 5s
	
	
	==> coredns [32186022430f] <==
	[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
	.:53
	[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7
	CoreDNS-1.8.6
	linux/arm64, go1.17.1, 13a9191
	[ERROR] plugin/errors: 2 7433730661178528066.195559375273545511. HINFO: read udp 10.244.0.3:43469->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 7433730661178528066.195559375273545511. HINFO: read udp 10.244.0.3:42860->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 7433730661178528066.195559375273545511. HINFO: read udp 10.244.0.3:49366->10.0.2.3:53: i/o timeout
	
	
	==> coredns [49dd660513a8] <==
	[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
	.:53
	[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7
	CoreDNS-1.8.6
	linux/arm64, go1.17.1, 13a9191
	[ERROR] plugin/errors: 2 1846849901207444316.279237443683376836. HINFO: read udp 10.244.0.2:50932->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 1846849901207444316.279237443683376836. HINFO: read udp 10.244.0.2:46297->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 1846849901207444316.279237443683376836. HINFO: read udp 10.244.0.2:37920->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 1846849901207444316.279237443683376836. HINFO: read udp 10.244.0.2:41344->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 1846849901207444316.279237443683376836. HINFO: read udp 10.244.0.2:48964->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 1846849901207444316.279237443683376836. HINFO: read udp 10.244.0.2:41662->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 1846849901207444316.279237443683376836. HINFO: read udp 10.244.0.2:43819->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 1846849901207444316.279237443683376836. HINFO: read udp 10.244.0.2:46156->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 1846849901207444316.279237443683376836. HINFO: read udp 10.244.0.2:50701->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 1846849901207444316.279237443683376836. HINFO: read udp 10.244.0.2:44985->10.0.2.3:53: i/o timeout
	[INFO] SIGTERM: Shutting down servers then terminating
	[INFO] plugin/health: Going into lameduck mode for 5s
	
	
	==> coredns [847b43368b4e] <==
	[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
	.:53
	[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7
	CoreDNS-1.8.6
	linux/arm64, go1.17.1, 13a9191
	[ERROR] plugin/errors: 2 3635212956481655586.3606514367632232495. HINFO: read udp 10.244.0.2:43908->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 3635212956481655586.3606514367632232495. HINFO: read udp 10.244.0.2:50383->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 3635212956481655586.3606514367632232495. HINFO: read udp 10.244.0.2:47232->10.0.2.3:53: i/o timeout
	
	
	==> describe nodes <==
	Name:               running-upgrade-987000
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=running-upgrade-987000
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=a560a51f794134545edbbeb49e1ab4a0b1355168
	                    minikube.k8s.io/name=running-upgrade-987000
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2024_08_14T17_47_37_0700
	                    minikube.k8s.io/version=v1.33.1
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 15 Aug 2024 00:47:34 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  running-upgrade-987000
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 15 Aug 2024 00:51:52 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 15 Aug 2024 00:47:37 +0000   Thu, 15 Aug 2024 00:47:33 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 15 Aug 2024 00:47:37 +0000   Thu, 15 Aug 2024 00:47:33 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 15 Aug 2024 00:47:37 +0000   Thu, 15 Aug 2024 00:47:33 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 15 Aug 2024 00:47:37 +0000   Thu, 15 Aug 2024 00:47:37 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  10.0.2.15
	  Hostname:    running-upgrade-987000
	Capacity:
	  cpu:                2
	  ephemeral-storage:  17784760Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             2148820Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  17784760Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             2148820Ki
	  pods:               110
	System Info:
	  Machine ID:                 156b3be98624497a9f848c44960f6a15
	  System UUID:                156b3be98624497a9f848c44960f6a15
	  Boot ID:                    73fe7ac8-01e5-422d-a1d5-504fd17a03e2
	  Kernel Version:             5.10.57
	  OS Image:                   Buildroot 2021.02.12
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  docker://20.10.16
	  Kubelet Version:            v1.24.1
	  Kube-Proxy Version:         v1.24.1
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (8 in total)
	  Namespace                   Name                                              CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                              ------------  ----------  ---------------  -------------  ---
	  kube-system                 coredns-6d4b75cb6d-rmrlc                          100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     4m4s
	  kube-system                 coredns-6d4b75cb6d-wzfbf                          100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     4m4s
	  kube-system                 etcd-running-upgrade-987000                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         4m19s
	  kube-system                 kube-apiserver-running-upgrade-987000             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m19s
	  kube-system                 kube-controller-manager-running-upgrade-987000    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m17s
	  kube-system                 kube-proxy-45jkq                                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m4s
	  kube-system                 kube-scheduler-running-upgrade-987000             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m17s
	  kube-system                 storage-provisioner                               0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m16s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests     Limits
	  --------           --------     ------
	  cpu                850m (42%!)(MISSING)   0 (0%!)(MISSING)
	  memory             240Mi (11%!)(MISSING)  340Mi (16%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)       0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)       0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)       0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)       0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)       0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age    From             Message
	  ----    ------                   ----   ----             -------
	  Normal  Starting                 4m3s   kube-proxy       
	  Normal  NodeReady                4m17s  kubelet          Node running-upgrade-987000 status is now: NodeReady
	  Normal  NodeAllocatableEnforced  4m17s  kubelet          Updated Node Allocatable limit across pods
	  Normal  NodeHasSufficientMemory  4m17s  kubelet          Node running-upgrade-987000 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    4m17s  kubelet          Node running-upgrade-987000 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     4m17s  kubelet          Node running-upgrade-987000 status is now: NodeHasSufficientPID
	  Normal  Starting                 4m17s  kubelet          Starting kubelet.
	  Normal  RegisteredNode           4m5s   node-controller  Node running-upgrade-987000 event: Registered Node running-upgrade-987000 in Controller
	
	
	==> dmesg <==
	[  +0.076224] systemd-fstab-generator[888]: Ignoring "noauto" for root device
	[  +0.075238] systemd-fstab-generator[899]: Ignoring "noauto" for root device
	[  +1.136118] kauditd_printk_skb: 53 callbacks suppressed
	[  +0.068624] systemd-fstab-generator[1049]: Ignoring "noauto" for root device
	[  +0.076904] systemd-fstab-generator[1060]: Ignoring "noauto" for root device
	[  +2.475434] systemd-fstab-generator[1290]: Ignoring "noauto" for root device
	[  +8.123792] systemd-fstab-generator[1942]: Ignoring "noauto" for root device
	[Aug15 00:43] kauditd_printk_skb: 47 callbacks suppressed
	[  +1.114562] systemd-fstab-generator[2649]: Ignoring "noauto" for root device
	[  +0.162986] systemd-fstab-generator[2688]: Ignoring "noauto" for root device
	[  +0.112185] systemd-fstab-generator[2744]: Ignoring "noauto" for root device
	[  +0.112131] systemd-fstab-generator[2757]: Ignoring "noauto" for root device
	[  +5.205862] kauditd_printk_skb: 14 callbacks suppressed
	[  +1.545135] systemd-fstab-generator[4197]: Ignoring "noauto" for root device
	[  +0.090001] systemd-fstab-generator[4208]: Ignoring "noauto" for root device
	[  +0.089092] systemd-fstab-generator[4219]: Ignoring "noauto" for root device
	[  +0.109422] systemd-fstab-generator[4233]: Ignoring "noauto" for root device
	[  +2.436760] systemd-fstab-generator[4527]: Ignoring "noauto" for root device
	[  +1.156141] kauditd_printk_skb: 39 callbacks suppressed
	[  +1.211146] systemd-fstab-generator[4884]: Ignoring "noauto" for root device
	[  +1.171475] systemd-fstab-generator[5029]: Ignoring "noauto" for root device
	[  +7.030001] kauditd_printk_skb: 40 callbacks suppressed
	[Aug15 00:47] systemd-fstab-generator[13753]: Ignoring "noauto" for root device
	[  +5.634850] systemd-fstab-generator[14355]: Ignoring "noauto" for root device
	[  +0.473182] systemd-fstab-generator[14487]: Ignoring "noauto" for root device
	
	
	==> etcd [3c60e8bda603] <==
	{"level":"info","ts":"2024-08-15T00:47:32.677Z","caller":"etcdserver/server.go:736","msg":"started as single-node; fast-forwarding election ticks","local-member-id":"f074a195de705325","forward-ticks":9,"forward-duration":"900ms","election-ticks":10,"election-timeout":"1s"}
	{"level":"info","ts":"2024-08-15T00:47:32.678Z","caller":"embed/etcd.go:277","msg":"now serving peer/client/metrics","local-member-id":"f074a195de705325","initial-advertise-peer-urls":["https://10.0.2.15:2380"],"listen-peer-urls":["https://10.0.2.15:2380"],"advertise-client-urls":["https://10.0.2.15:2379"],"listen-client-urls":["https://10.0.2.15:2379","https://127.0.0.1:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
	{"level":"info","ts":"2024-08-15T00:47:32.678Z","caller":"embed/etcd.go:763","msg":"serving metrics","address":"http://127.0.0.1:2381"}
	{"level":"info","ts":"2024-08-15T00:47:32.678Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f074a195de705325 switched to configuration voters=(17326651331455243045)"}
	{"level":"info","ts":"2024-08-15T00:47:32.678Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"ef296cf39f5d9d66","local-member-id":"f074a195de705325","added-peer-id":"f074a195de705325","added-peer-peer-urls":["https://10.0.2.15:2380"]}
	{"level":"info","ts":"2024-08-15T00:47:32.678Z","caller":"embed/etcd.go:581","msg":"serving peer traffic","address":"10.0.2.15:2380"}
	{"level":"info","ts":"2024-08-15T00:47:32.678Z","caller":"embed/etcd.go:553","msg":"cmux::serve","address":"10.0.2.15:2380"}
	{"level":"info","ts":"2024-08-15T00:47:33.274Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f074a195de705325 is starting a new election at term 1"}
	{"level":"info","ts":"2024-08-15T00:47:33.274Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f074a195de705325 became pre-candidate at term 1"}
	{"level":"info","ts":"2024-08-15T00:47:33.274Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f074a195de705325 received MsgPreVoteResp from f074a195de705325 at term 1"}
	{"level":"info","ts":"2024-08-15T00:47:33.274Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f074a195de705325 became candidate at term 2"}
	{"level":"info","ts":"2024-08-15T00:47:33.274Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f074a195de705325 received MsgVoteResp from f074a195de705325 at term 2"}
	{"level":"info","ts":"2024-08-15T00:47:33.274Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f074a195de705325 became leader at term 2"}
	{"level":"info","ts":"2024-08-15T00:47:33.274Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: f074a195de705325 elected leader f074a195de705325 at term 2"}
	{"level":"info","ts":"2024-08-15T00:47:33.274Z","caller":"etcdserver/server.go:2042","msg":"published local member to cluster through raft","local-member-id":"f074a195de705325","local-member-attributes":"{Name:running-upgrade-987000 ClientURLs:[https://10.0.2.15:2379]}","request-path":"/0/members/f074a195de705325/attributes","cluster-id":"ef296cf39f5d9d66","publish-timeout":"7s"}
	{"level":"info","ts":"2024-08-15T00:47:33.274Z","caller":"etcdserver/server.go:2507","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2024-08-15T00:47:33.274Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
	{"level":"info","ts":"2024-08-15T00:47:33.275Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2024-08-15T00:47:33.275Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
	{"level":"info","ts":"2024-08-15T00:47:33.276Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"10.0.2.15:2379"}
	{"level":"info","ts":"2024-08-15T00:47:33.276Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"ef296cf39f5d9d66","local-member-id":"f074a195de705325","cluster-version":"3.5"}
	{"level":"info","ts":"2024-08-15T00:47:33.278Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2024-08-15T00:47:33.278Z","caller":"etcdserver/server.go:2531","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2024-08-15T00:47:33.281Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2024-08-15T00:47:33.281Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	
	
	==> kernel <==
	 00:51:54 up 9 min,  0 users,  load average: 0.31, 0.20, 0.09
	Linux running-upgrade-987000 5.10.57 #1 SMP PREEMPT Thu Jun 16 21:01:29 UTC 2022 aarch64 GNU/Linux
	PRETTY_NAME="Buildroot 2021.02.12"
	
	
	==> kube-apiserver [d12eaf92ab6f] <==
	I0815 00:47:34.491750       1 controller.go:611] quota admission added evaluator for: namespaces
	I0815 00:47:34.515572       1 cache.go:39] Caches are synced for AvailableConditionController controller
	I0815 00:47:34.515628       1 cache.go:39] Caches are synced for autoregister controller
	I0815 00:47:34.515718       1 apf_controller.go:322] Running API Priority and Fairness config worker
	I0815 00:47:34.515747       1 shared_informer.go:262] Caches are synced for cluster_authentication_trust_controller
	I0815 00:47:34.531047       1 shared_informer.go:262] Caches are synced for crd-autoregister
	I0815 00:47:34.531436       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I0815 00:47:35.262107       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
	I0815 00:47:35.423206       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
	I0815 00:47:35.428434       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
	I0815 00:47:35.428473       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
	I0815 00:47:35.570371       1 controller.go:611] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0815 00:47:35.583020       1 controller.go:611] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	I0815 00:47:35.696429       1 alloc.go:327] "allocated clusterIPs" service="default/kubernetes" clusterIPs=map[IPv4:10.96.0.1]
	W0815 00:47:35.698595       1 lease.go:234] Resetting endpoints for master service "kubernetes" to [10.0.2.15]
	I0815 00:47:35.698976       1 controller.go:611] quota admission added evaluator for: endpoints
	I0815 00:47:35.700315       1 controller.go:611] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I0815 00:47:36.591420       1 controller.go:611] quota admission added evaluator for: serviceaccounts
	I0815 00:47:37.300504       1 controller.go:611] quota admission added evaluator for: deployments.apps
	I0815 00:47:37.303295       1 alloc.go:327] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs=map[IPv4:10.96.0.10]
	I0815 00:47:37.308558       1 controller.go:611] quota admission added evaluator for: daemonsets.apps
	I0815 00:47:37.360266       1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io
	I0815 00:47:50.262917       1 controller.go:611] quota admission added evaluator for: controllerrevisions.apps
	I0815 00:47:50.362476       1 controller.go:611] quota admission added evaluator for: replicasets.apps
	I0815 00:47:51.368892       1 controller.go:611] quota admission added evaluator for: events.events.k8s.io
	
	
	==> kube-controller-manager [b1a83b84d3ff] <==
	I0815 00:47:49.510448       1 node_lifecycle_controller.go:1215] Controller detected that zone  is now in state Normal.
	I0815 00:47:49.510469       1 taint_manager.go:187] "Starting NoExecuteTaintManager"
	I0815 00:47:49.510552       1 event.go:294] "Event occurred" object="running-upgrade-987000" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node running-upgrade-987000 event: Registered Node running-upgrade-987000 in Controller"
	I0815 00:47:49.511398       1 shared_informer.go:262] Caches are synced for stateful set
	I0815 00:47:49.511411       1 shared_informer.go:262] Caches are synced for ReplicationController
	I0815 00:47:49.511423       1 shared_informer.go:262] Caches are synced for TTL after finished
	I0815 00:47:49.511441       1 shared_informer.go:262] Caches are synced for persistent volume
	I0815 00:47:49.514707       1 shared_informer.go:262] Caches are synced for certificate-csrsigning-legacy-unknown
	I0815 00:47:49.514734       1 shared_informer.go:262] Caches are synced for certificate-csrsigning-kubelet-client
	I0815 00:47:49.514743       1 shared_informer.go:262] Caches are synced for certificate-csrsigning-kube-apiserver-client
	I0815 00:47:49.557732       1 shared_informer.go:262] Caches are synced for deployment
	I0815 00:47:49.606468       1 shared_informer.go:262] Caches are synced for disruption
	I0815 00:47:49.606481       1 disruption.go:371] Sending events to api server.
	I0815 00:47:49.610592       1 shared_informer.go:262] Caches are synced for ReplicaSet
	I0815 00:47:49.611686       1 shared_informer.go:262] Caches are synced for attach detach
	I0815 00:47:49.614924       1 shared_informer.go:262] Caches are synced for resource quota
	I0815 00:47:49.665076       1 shared_informer.go:262] Caches are synced for resource quota
	I0815 00:47:49.711458       1 shared_informer.go:262] Caches are synced for ClusterRoleAggregator
	I0815 00:47:50.126820       1 shared_informer.go:262] Caches are synced for garbage collector
	I0815 00:47:50.149831       1 shared_informer.go:262] Caches are synced for garbage collector
	I0815 00:47:50.149846       1 garbagecollector.go:158] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	I0815 00:47:50.266815       1 event.go:294] "Event occurred" object="kube-system/kube-proxy" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-45jkq"
	I0815 00:47:50.363513       1 event.go:294] "Event occurred" object="kube-system/coredns" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-6d4b75cb6d to 2"
	I0815 00:47:50.513078       1 event.go:294] "Event occurred" object="kube-system/coredns-6d4b75cb6d" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-6d4b75cb6d-wzfbf"
	I0815 00:47:50.517348       1 event.go:294] "Event occurred" object="kube-system/coredns-6d4b75cb6d" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-6d4b75cb6d-rmrlc"
	
	
	==> kube-proxy [36f3b8954db0] <==
	I0815 00:47:51.356922       1 node.go:163] Successfully retrieved node IP: 10.0.2.15
	I0815 00:47:51.356950       1 server_others.go:138] "Detected node IP" address="10.0.2.15"
	I0815 00:47:51.356963       1 server_others.go:578] "Unknown proxy mode, assuming iptables proxy" proxyMode=""
	I0815 00:47:51.366269       1 server_others.go:199] "kube-proxy running in single-stack mode, this ipFamily is not supported" ipFamily=IPv6
	I0815 00:47:51.366279       1 server_others.go:206] "Using iptables Proxier"
	I0815 00:47:51.366334       1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
	I0815 00:47:51.366501       1 server.go:661] "Version info" version="v1.24.1"
	I0815 00:47:51.366508       1 server.go:663] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0815 00:47:51.366817       1 config.go:317] "Starting service config controller"
	I0815 00:47:51.366851       1 shared_informer.go:255] Waiting for caches to sync for service config
	I0815 00:47:51.366876       1 config.go:226] "Starting endpoint slice config controller"
	I0815 00:47:51.366883       1 shared_informer.go:255] Waiting for caches to sync for endpoint slice config
	I0815 00:47:51.367953       1 config.go:444] "Starting node config controller"
	I0815 00:47:51.367957       1 shared_informer.go:255] Waiting for caches to sync for node config
	I0815 00:47:51.467414       1 shared_informer.go:262] Caches are synced for endpoint slice config
	I0815 00:47:51.467414       1 shared_informer.go:262] Caches are synced for service config
	I0815 00:47:51.468037       1 shared_informer.go:262] Caches are synced for node config
	
	
	==> kube-scheduler [2cd3b4e0d744] <==
	W0815 00:47:34.494436       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0815 00:47:34.494490       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	W0815 00:47:34.494547       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0815 00:47:34.494592       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	W0815 00:47:34.494655       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0815 00:47:34.494677       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	W0815 00:47:34.494725       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0815 00:47:34.494745       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	W0815 00:47:34.494804       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0815 00:47:34.494824       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0815 00:47:34.494852       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0815 00:47:34.494869       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0815 00:47:34.494926       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0815 00:47:34.494946       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	W0815 00:47:34.495075       1 reflector.go:324] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0815 00:47:34.495297       1 reflector.go:138] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	W0815 00:47:35.363479       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0815 00:47:35.363662       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	W0815 00:47:35.420413       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0815 00:47:35.420686       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0815 00:47:35.441323       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0815 00:47:35.441485       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0815 00:47:35.500487       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0815 00:47:35.500506       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	I0815 00:47:35.892969       1 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	
	==> kubelet <==
	-- Journal begins at Thu 2024-08-15 00:42:31 UTC, ends at Thu 2024-08-15 00:51:54 UTC. --
	Aug 15 00:47:38 running-upgrade-987000 kubelet[14361]: I0815 00:47:38.342658   14361 apiserver.go:52] "Watching apiserver"
	Aug 15 00:47:38 running-upgrade-987000 kubelet[14361]: I0815 00:47:38.763724   14361 reconciler.go:157] "Reconciler: start to sync state"
	Aug 15 00:47:38 running-upgrade-987000 kubelet[14361]: E0815 00:47:38.945256   14361 kubelet.go:1690] "Failed creating a mirror pod for" err="pods \"kube-controller-manager-running-upgrade-987000\" already exists" pod="kube-system/kube-controller-manager-running-upgrade-987000"
	Aug 15 00:47:39 running-upgrade-987000 kubelet[14361]: E0815 00:47:39.136112   14361 kubelet.go:1690] "Failed creating a mirror pod for" err="pods \"kube-scheduler-running-upgrade-987000\" already exists" pod="kube-system/kube-scheduler-running-upgrade-987000"
	Aug 15 00:47:39 running-upgrade-987000 kubelet[14361]: E0815 00:47:39.336178   14361 kubelet.go:1690] "Failed creating a mirror pod for" err="pods \"etcd-running-upgrade-987000\" already exists" pod="kube-system/etcd-running-upgrade-987000"
	Aug 15 00:47:39 running-upgrade-987000 kubelet[14361]: I0815 00:47:39.533724   14361 request.go:601] Waited for 1.110140308s due to client-side throttling, not priority and fairness, request: POST:https://control-plane.minikube.internal:8443/api/v1/namespaces/kube-system/pods
	Aug 15 00:47:39 running-upgrade-987000 kubelet[14361]: E0815 00:47:39.538474   14361 kubelet.go:1690] "Failed creating a mirror pod for" err="pods \"kube-apiserver-running-upgrade-987000\" already exists" pod="kube-system/kube-apiserver-running-upgrade-987000"
	Aug 15 00:47:49 running-upgrade-987000 kubelet[14361]: I0815 00:47:49.454290   14361 kuberuntime_manager.go:1095] "Updating runtime config through cri with podcidr" CIDR="10.244.0.0/24"
	Aug 15 00:47:49 running-upgrade-987000 kubelet[14361]: I0815 00:47:49.454864   14361 kubelet_network.go:60] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.244.0.0/24"
	Aug 15 00:47:49 running-upgrade-987000 kubelet[14361]: I0815 00:47:49.516462   14361 topology_manager.go:200] "Topology Admit Handler"
	Aug 15 00:47:49 running-upgrade-987000 kubelet[14361]: I0815 00:47:49.554848   14361 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/331429df-4aee-48b0-ad9e-214d6f0e2e2c-tmp\") pod \"storage-provisioner\" (UID: \"331429df-4aee-48b0-ad9e-214d6f0e2e2c\") " pod="kube-system/storage-provisioner"
	Aug 15 00:47:49 running-upgrade-987000 kubelet[14361]: I0815 00:47:49.655305   14361 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k655g\" (UniqueName: \"kubernetes.io/projected/331429df-4aee-48b0-ad9e-214d6f0e2e2c-kube-api-access-k655g\") pod \"storage-provisioner\" (UID: \"331429df-4aee-48b0-ad9e-214d6f0e2e2c\") " pod="kube-system/storage-provisioner"
	Aug 15 00:47:50 running-upgrade-987000 kubelet[14361]: I0815 00:47:50.268086   14361 topology_manager.go:200] "Topology Admit Handler"
	Aug 15 00:47:50 running-upgrade-987000 kubelet[14361]: I0815 00:47:50.460568   14361 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtqm6\" (UniqueName: \"kubernetes.io/projected/598d6277-4c5a-4c87-8c36-3eba9fc91398-kube-api-access-jtqm6\") pod \"kube-proxy-45jkq\" (UID: \"598d6277-4c5a-4c87-8c36-3eba9fc91398\") " pod="kube-system/kube-proxy-45jkq"
	Aug 15 00:47:50 running-upgrade-987000 kubelet[14361]: I0815 00:47:50.460590   14361 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/598d6277-4c5a-4c87-8c36-3eba9fc91398-xtables-lock\") pod \"kube-proxy-45jkq\" (UID: \"598d6277-4c5a-4c87-8c36-3eba9fc91398\") " pod="kube-system/kube-proxy-45jkq"
	Aug 15 00:47:50 running-upgrade-987000 kubelet[14361]: I0815 00:47:50.460601   14361 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/598d6277-4c5a-4c87-8c36-3eba9fc91398-kube-proxy\") pod \"kube-proxy-45jkq\" (UID: \"598d6277-4c5a-4c87-8c36-3eba9fc91398\") " pod="kube-system/kube-proxy-45jkq"
	Aug 15 00:47:50 running-upgrade-987000 kubelet[14361]: I0815 00:47:50.460611   14361 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/598d6277-4c5a-4c87-8c36-3eba9fc91398-lib-modules\") pod \"kube-proxy-45jkq\" (UID: \"598d6277-4c5a-4c87-8c36-3eba9fc91398\") " pod="kube-system/kube-proxy-45jkq"
	Aug 15 00:47:50 running-upgrade-987000 kubelet[14361]: I0815 00:47:50.515909   14361 topology_manager.go:200] "Topology Admit Handler"
	Aug 15 00:47:50 running-upgrade-987000 kubelet[14361]: I0815 00:47:50.520207   14361 topology_manager.go:200] "Topology Admit Handler"
	Aug 15 00:47:50 running-upgrade-987000 kubelet[14361]: I0815 00:47:50.661587   14361 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv5d8\" (UniqueName: \"kubernetes.io/projected/4b96e15c-4ad4-45fe-b3ac-2fce41830154-kube-api-access-gv5d8\") pod \"coredns-6d4b75cb6d-wzfbf\" (UID: \"4b96e15c-4ad4-45fe-b3ac-2fce41830154\") " pod="kube-system/coredns-6d4b75cb6d-wzfbf"
	Aug 15 00:47:50 running-upgrade-987000 kubelet[14361]: I0815 00:47:50.661610   14361 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjt9t\" (UniqueName: \"kubernetes.io/projected/8d5266d6-3ab3-47ca-a70d-83823cde0078-kube-api-access-qjt9t\") pod \"coredns-6d4b75cb6d-rmrlc\" (UID: \"8d5266d6-3ab3-47ca-a70d-83823cde0078\") " pod="kube-system/coredns-6d4b75cb6d-rmrlc"
	Aug 15 00:47:50 running-upgrade-987000 kubelet[14361]: I0815 00:47:50.661625   14361 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d5266d6-3ab3-47ca-a70d-83823cde0078-config-volume\") pod \"coredns-6d4b75cb6d-rmrlc\" (UID: \"8d5266d6-3ab3-47ca-a70d-83823cde0078\") " pod="kube-system/coredns-6d4b75cb6d-rmrlc"
	Aug 15 00:47:50 running-upgrade-987000 kubelet[14361]: I0815 00:47:50.661639   14361 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4b96e15c-4ad4-45fe-b3ac-2fce41830154-config-volume\") pod \"coredns-6d4b75cb6d-wzfbf\" (UID: \"4b96e15c-4ad4-45fe-b3ac-2fce41830154\") " pod="kube-system/coredns-6d4b75cb6d-wzfbf"
	Aug 15 00:51:38 running-upgrade-987000 kubelet[14361]: I0815 00:51:38.696833   14361 scope.go:110] "RemoveContainer" containerID="f805e836332e4b0f76a3f4d78c2ec71554f1a380a1b6e193180884a6420263b9"
	Aug 15 00:51:39 running-upgrade-987000 kubelet[14361]: I0815 00:51:39.706123   14361 scope.go:110] "RemoveContainer" containerID="e503088d4f6160723fffec4e0084d0c790e85725abc6a038763d87be306d748a"
	
	
	==> storage-provisioner [0144ba8035a5] <==
	I0815 00:47:50.029038       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0815 00:47:50.032388       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0815 00:47:50.032404       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0815 00:47:50.035149       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0815 00:47:50.035247       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_running-upgrade-987000_cb7d8dbb-697f-45bf-8c39-982cadc57e7f!
	I0815 00:47:50.035902       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"dc67908b-7d95-4d2b-a49d-047508517681", APIVersion:"v1", ResourceVersion:"316", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' running-upgrade-987000_cb7d8dbb-697f-45bf-8c39-982cadc57e7f became leader
	I0815 00:47:50.136118       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_running-upgrade-987000_cb7d8dbb-697f-45bf-8c39-982cadc57e7f!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p running-upgrade-987000 -n running-upgrade-987000
helpers_test.go:254: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.APIServer}} -p running-upgrade-987000 -n running-upgrade-987000: exit status 2 (15.723046792s)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:254: status error: exit status 2 (may be ok)
helpers_test.go:256: "running-upgrade-987000" apiserver is not running, skipping kubectl commands (state="Stopped")
helpers_test.go:175: Cleaning up "running-upgrade-987000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p running-upgrade-987000
--- FAIL: TestRunningBinaryUpgrade (622.15s)

                                                
                                    
x
+
TestKubernetesUpgrade (18.62s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:222: (dbg) Run:  out/minikube-darwin-arm64 start -p kubernetes-upgrade-077000 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=qemu2 
version_upgrade_test.go:222: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p kubernetes-upgrade-077000 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=qemu2 : exit status 80 (9.964639625s)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-077000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "kubernetes-upgrade-077000" primary control-plane node in "kubernetes-upgrade-077000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "kubernetes-upgrade-077000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:41:30.369385    3843 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:41:30.369512    3843 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:41:30.369516    3843 out.go:304] Setting ErrFile to fd 2...
	I0814 17:41:30.369518    3843 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:41:30.369630    3843 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:41:30.370678    3843 out.go:298] Setting JSON to false
	I0814 17:41:30.386851    3843 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2453,"bootTime":1723680037,"procs":459,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:41:30.386915    3843 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:41:30.391160    3843 out.go:177] * [kubernetes-upgrade-077000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:41:30.397075    3843 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:41:30.397149    3843 notify.go:220] Checking for updates...
	I0814 17:41:30.403178    3843 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:41:30.406119    3843 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:41:30.409121    3843 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:41:30.412179    3843 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:41:30.413493    3843 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:41:30.416421    3843 config.go:182] Loaded profile config "multinode-628000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:41:30.416481    3843 config.go:182] Loaded profile config "offline-docker-487000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:41:30.416536    3843 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:41:30.421181    3843 out.go:177] * Using the qemu2 driver based on user configuration
	I0814 17:41:30.426088    3843 start.go:297] selected driver: qemu2
	I0814 17:41:30.426094    3843 start.go:901] validating driver "qemu2" against <nil>
	I0814 17:41:30.426100    3843 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:41:30.428524    3843 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0814 17:41:30.432114    3843 out.go:177] * Automatically selected the socket_vmnet network
	I0814 17:41:30.433662    3843 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0814 17:41:30.433683    3843 cni.go:84] Creating CNI manager for ""
	I0814 17:41:30.433698    3843 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0814 17:41:30.433719    3843 start.go:340] cluster config:
	{Name:kubernetes-upgrade-077000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:kubernetes-upgrade-077000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster
.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:
SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:41:30.437397    3843 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:41:30.446150    3843 out.go:177] * Starting "kubernetes-upgrade-077000" primary control-plane node in "kubernetes-upgrade-077000" cluster
	I0814 17:41:30.450124    3843 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0814 17:41:30.450141    3843 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4
	I0814 17:41:30.450154    3843 cache.go:56] Caching tarball of preloaded images
	I0814 17:41:30.450213    3843 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:41:30.450219    3843 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I0814 17:41:30.450275    3843 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/kubernetes-upgrade-077000/config.json ...
	I0814 17:41:30.450285    3843 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/kubernetes-upgrade-077000/config.json: {Name:mk0e8d9a6b06e4648819b18675c8ddfbe040c68e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:41:30.455653    3843 start.go:360] acquireMachinesLock for kubernetes-upgrade-077000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:41:30.455683    3843 start.go:364] duration metric: took 22.833µs to acquireMachinesLock for "kubernetes-upgrade-077000"
	I0814 17:41:30.455694    3843 start.go:93] Provisioning new machine with config: &{Name:kubernetes-upgrade-077000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes
Config:{KubernetesVersion:v1.20.0 ClusterName:kubernetes-upgrade-077000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: D
isableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:41:30.455732    3843 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:41:30.468091    3843 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0814 17:41:30.486057    3843 start.go:159] libmachine.API.Create for "kubernetes-upgrade-077000" (driver="qemu2")
	I0814 17:41:30.486095    3843 client.go:168] LocalClient.Create starting
	I0814 17:41:30.486171    3843 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:41:30.486205    3843 main.go:141] libmachine: Decoding PEM data...
	I0814 17:41:30.486224    3843 main.go:141] libmachine: Parsing certificate...
	I0814 17:41:30.486263    3843 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:41:30.486289    3843 main.go:141] libmachine: Decoding PEM data...
	I0814 17:41:30.486297    3843 main.go:141] libmachine: Parsing certificate...
	I0814 17:41:30.489553    3843 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:41:30.678413    3843 main.go:141] libmachine: Creating SSH key...
	I0814 17:41:30.772636    3843 main.go:141] libmachine: Creating Disk image...
	I0814 17:41:30.772642    3843 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:41:30.772814    3843 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/disk.qcow2
	I0814 17:41:30.782431    3843 main.go:141] libmachine: STDOUT: 
	I0814 17:41:30.782449    3843 main.go:141] libmachine: STDERR: 
	I0814 17:41:30.782495    3843 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/disk.qcow2 +20000M
	I0814 17:41:30.790250    3843 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:41:30.790267    3843 main.go:141] libmachine: STDERR: 
	I0814 17:41:30.790284    3843 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/disk.qcow2
	I0814 17:41:30.790288    3843 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:41:30.790300    3843 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:41:30.790323    3843 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/qemu.pid -device virtio-net-pci,netdev=net0,mac=b6:c7:39:5a:8b:72 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/disk.qcow2
	I0814 17:41:30.791907    3843 main.go:141] libmachine: STDOUT: 
	I0814 17:41:30.791922    3843 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:41:30.791940    3843 client.go:171] duration metric: took 305.847416ms to LocalClient.Create
	I0814 17:41:32.794070    3843 start.go:128] duration metric: took 2.33836s to createHost
	I0814 17:41:32.794134    3843 start.go:83] releasing machines lock for "kubernetes-upgrade-077000", held for 2.338489667s
	W0814 17:41:32.794188    3843 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:41:32.811681    3843 out.go:177] * Deleting "kubernetes-upgrade-077000" in qemu2 ...
	W0814 17:41:32.846657    3843 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:41:32.846675    3843 start.go:729] Will try again in 5 seconds ...
	I0814 17:41:37.848720    3843 start.go:360] acquireMachinesLock for kubernetes-upgrade-077000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:41:37.849114    3843 start.go:364] duration metric: took 295.167µs to acquireMachinesLock for "kubernetes-upgrade-077000"
	I0814 17:41:37.849249    3843 start.go:93] Provisioning new machine with config: &{Name:kubernetes-upgrade-077000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes
Config:{KubernetesVersion:v1.20.0 ClusterName:kubernetes-upgrade-077000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: D
isableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:41:37.849517    3843 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:41:37.872429    3843 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0814 17:41:37.923343    3843 start.go:159] libmachine.API.Create for "kubernetes-upgrade-077000" (driver="qemu2")
	I0814 17:41:37.923394    3843 client.go:168] LocalClient.Create starting
	I0814 17:41:37.923540    3843 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:41:37.923594    3843 main.go:141] libmachine: Decoding PEM data...
	I0814 17:41:37.923614    3843 main.go:141] libmachine: Parsing certificate...
	I0814 17:41:37.923680    3843 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:41:37.923711    3843 main.go:141] libmachine: Decoding PEM data...
	I0814 17:41:37.923724    3843 main.go:141] libmachine: Parsing certificate...
	I0814 17:41:37.924252    3843 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:41:38.118586    3843 main.go:141] libmachine: Creating SSH key...
	I0814 17:41:38.250562    3843 main.go:141] libmachine: Creating Disk image...
	I0814 17:41:38.250568    3843 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:41:38.250730    3843 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/disk.qcow2
	I0814 17:41:38.260077    3843 main.go:141] libmachine: STDOUT: 
	I0814 17:41:38.260098    3843 main.go:141] libmachine: STDERR: 
	I0814 17:41:38.260143    3843 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/disk.qcow2 +20000M
	I0814 17:41:38.267963    3843 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:41:38.267985    3843 main.go:141] libmachine: STDERR: 
	I0814 17:41:38.267999    3843 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/disk.qcow2
	I0814 17:41:38.268005    3843 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:41:38.268017    3843 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:41:38.268051    3843 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/qemu.pid -device virtio-net-pci,netdev=net0,mac=c6:df:b9:72:26:b1 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/disk.qcow2
	I0814 17:41:38.269877    3843 main.go:141] libmachine: STDOUT: 
	I0814 17:41:38.269893    3843 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:41:38.269907    3843 client.go:171] duration metric: took 346.515167ms to LocalClient.Create
	I0814 17:41:40.271098    3843 start.go:128] duration metric: took 2.421617834s to createHost
	I0814 17:41:40.271113    3843 start.go:83] releasing machines lock for "kubernetes-upgrade-077000", held for 2.422029375s
	W0814 17:41:40.271173    3843 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p kubernetes-upgrade-077000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p kubernetes-upgrade-077000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:41:40.282834    3843 out.go:177] 
	W0814 17:41:40.287050    3843 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:41:40.287055    3843 out.go:239] * 
	* 
	W0814 17:41:40.287583    3843 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:41:40.296951    3843 out.go:177] 

                                                
                                                
** /stderr **
version_upgrade_test.go:224: failed to start minikube HEAD with oldest k8s version: out/minikube-darwin-arm64 start -p kubernetes-upgrade-077000 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=qemu2 : exit status 80
version_upgrade_test.go:227: (dbg) Run:  out/minikube-darwin-arm64 stop -p kubernetes-upgrade-077000
version_upgrade_test.go:227: (dbg) Done: out/minikube-darwin-arm64 stop -p kubernetes-upgrade-077000: (3.26918375s)
version_upgrade_test.go:232: (dbg) Run:  out/minikube-darwin-arm64 -p kubernetes-upgrade-077000 status --format={{.Host}}
version_upgrade_test.go:232: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p kubernetes-upgrade-077000 status --format={{.Host}}: exit status 7 (47.117166ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:234: status error: exit status 7 (may be ok)
version_upgrade_test.go:243: (dbg) Run:  out/minikube-darwin-arm64 start -p kubernetes-upgrade-077000 --memory=2200 --kubernetes-version=v1.31.0 --alsologtostderr -v=1 --driver=qemu2 
version_upgrade_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p kubernetes-upgrade-077000 --memory=2200 --kubernetes-version=v1.31.0 --alsologtostderr -v=1 --driver=qemu2 : exit status 80 (5.186106542s)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-077000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting "kubernetes-upgrade-077000" primary control-plane node in "kubernetes-upgrade-077000" cluster
	* Restarting existing qemu2 VM for "kubernetes-upgrade-077000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "kubernetes-upgrade-077000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:41:43.651468    3903 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:41:43.651596    3903 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:41:43.651599    3903 out.go:304] Setting ErrFile to fd 2...
	I0814 17:41:43.651602    3903 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:41:43.651720    3903 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:41:43.652678    3903 out.go:298] Setting JSON to false
	I0814 17:41:43.668697    3903 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2466,"bootTime":1723680037,"procs":465,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:41:43.668772    3903 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:41:43.673668    3903 out.go:177] * [kubernetes-upgrade-077000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:41:43.680736    3903 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:41:43.680789    3903 notify.go:220] Checking for updates...
	I0814 17:41:43.688620    3903 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:41:43.692542    3903 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:41:43.695769    3903 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:41:43.698675    3903 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:41:43.701707    3903 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:41:43.704964    3903 config.go:182] Loaded profile config "kubernetes-upgrade-077000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.20.0
	I0814 17:41:43.705252    3903 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:41:43.710683    3903 out.go:177] * Using the qemu2 driver based on existing profile
	I0814 17:41:43.718657    3903 start.go:297] selected driver: qemu2
	I0814 17:41:43.718664    3903 start.go:901] validating driver "qemu2" against &{Name:kubernetes-upgrade-077000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCon
fig:{KubernetesVersion:v1.20.0 ClusterName:kubernetes-upgrade-077000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disa
bleOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:41:43.718707    3903 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:41:43.720818    3903 cni.go:84] Creating CNI manager for ""
	I0814 17:41:43.720831    3903 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:41:43.720849    3903 start.go:340] cluster config:
	{Name:kubernetes-upgrade-077000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:kubernetes-upgrade-077000 Namespace:
default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnet
ClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:41:43.724018    3903 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:41:43.731615    3903 out.go:177] * Starting "kubernetes-upgrade-077000" primary control-plane node in "kubernetes-upgrade-077000" cluster
	I0814 17:41:43.735480    3903 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:41:43.735496    3903 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:41:43.735505    3903 cache.go:56] Caching tarball of preloaded images
	I0814 17:41:43.735563    3903 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:41:43.735569    3903 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:41:43.735617    3903 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/kubernetes-upgrade-077000/config.json ...
	I0814 17:41:43.735947    3903 start.go:360] acquireMachinesLock for kubernetes-upgrade-077000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:41:43.735978    3903 start.go:364] duration metric: took 25.584µs to acquireMachinesLock for "kubernetes-upgrade-077000"
	I0814 17:41:43.735986    3903 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:41:43.735991    3903 fix.go:54] fixHost starting: 
	I0814 17:41:43.736106    3903 fix.go:112] recreateIfNeeded on kubernetes-upgrade-077000: state=Stopped err=<nil>
	W0814 17:41:43.736113    3903 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:41:43.743669    3903 out.go:177] * Restarting existing qemu2 VM for "kubernetes-upgrade-077000" ...
	I0814 17:41:43.746607    3903 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:41:43.746640    3903 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/qemu.pid -device virtio-net-pci,netdev=net0,mac=c6:df:b9:72:26:b1 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/disk.qcow2
	I0814 17:41:43.748711    3903 main.go:141] libmachine: STDOUT: 
	I0814 17:41:43.748728    3903 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:41:43.748759    3903 fix.go:56] duration metric: took 12.768542ms for fixHost
	I0814 17:41:43.748763    3903 start.go:83] releasing machines lock for "kubernetes-upgrade-077000", held for 12.781ms
	W0814 17:41:43.748770    3903 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:41:43.748805    3903 out.go:239] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:41:43.748809    3903 start.go:729] Will try again in 5 seconds ...
	I0814 17:41:48.750644    3903 start.go:360] acquireMachinesLock for kubernetes-upgrade-077000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:41:48.751141    3903 start.go:364] duration metric: took 341.292µs to acquireMachinesLock for "kubernetes-upgrade-077000"
	I0814 17:41:48.751297    3903 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:41:48.751319    3903 fix.go:54] fixHost starting: 
	I0814 17:41:48.752046    3903 fix.go:112] recreateIfNeeded on kubernetes-upgrade-077000: state=Stopped err=<nil>
	W0814 17:41:48.752083    3903 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:41:48.759174    3903 out.go:177] * Restarting existing qemu2 VM for "kubernetes-upgrade-077000" ...
	I0814 17:41:48.768915    3903 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:41:48.769290    3903 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/qemu.pid -device virtio-net-pci,netdev=net0,mac=c6:df:b9:72:26:b1 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubernetes-upgrade-077000/disk.qcow2
	I0814 17:41:48.776165    3903 main.go:141] libmachine: STDOUT: 
	I0814 17:41:48.776230    3903 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:41:48.776301    3903 fix.go:56] duration metric: took 24.987583ms for fixHost
	I0814 17:41:48.776316    3903 start.go:83] releasing machines lock for "kubernetes-upgrade-077000", held for 25.145708ms
	W0814 17:41:48.776489    3903 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p kubernetes-upgrade-077000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p kubernetes-upgrade-077000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:41:48.784113    3903 out.go:177] 
	W0814 17:41:48.788155    3903 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:41:48.788188    3903 out.go:239] * 
	* 
	W0814 17:41:48.789586    3903 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:41:48.802033    3903 out.go:177] 

                                                
                                                
** /stderr **
version_upgrade_test.go:245: failed to upgrade with newest k8s version. args: out/minikube-darwin-arm64 start -p kubernetes-upgrade-077000 --memory=2200 --kubernetes-version=v1.31.0 --alsologtostderr -v=1 --driver=qemu2  : exit status 80
version_upgrade_test.go:248: (dbg) Run:  kubectl --context kubernetes-upgrade-077000 version --output=json
version_upgrade_test.go:248: (dbg) Non-zero exit: kubectl --context kubernetes-upgrade-077000 version --output=json: exit status 1 (37.330709ms)

                                                
                                                
** stderr ** 
	error: context "kubernetes-upgrade-077000" does not exist

                                                
                                                
** /stderr **
version_upgrade_test.go:250: error running kubectl: exit status 1
panic.go:626: *** TestKubernetesUpgrade FAILED at 2024-08-14 17:41:48.848722 -0700 PDT m=+2237.157908418
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p kubernetes-upgrade-077000 -n kubernetes-upgrade-077000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p kubernetes-upgrade-077000 -n kubernetes-upgrade-077000: exit status 7 (33.524833ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "kubernetes-upgrade-077000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "kubernetes-upgrade-077000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p kubernetes-upgrade-077000
--- FAIL: TestKubernetesUpgrade (18.62s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (591.08s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:183: (dbg) Run:  /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube-v1.26.0.2521824324 start -p stopped-upgrade-504000 --memory=2200 --vm-driver=qemu2 
version_upgrade_test.go:183: (dbg) Done: /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube-v1.26.0.2521824324 start -p stopped-upgrade-504000 --memory=2200 --vm-driver=qemu2 : (56.473618s)
version_upgrade_test.go:192: (dbg) Run:  /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube-v1.26.0.2521824324 -p stopped-upgrade-504000 stop
version_upgrade_test.go:192: (dbg) Done: /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube-v1.26.0.2521824324 -p stopped-upgrade-504000 stop: (12.087860459s)
version_upgrade_test.go:198: (dbg) Run:  out/minikube-darwin-arm64 start -p stopped-upgrade-504000 --memory=2200 --alsologtostderr -v=1 --driver=qemu2 
version_upgrade_test.go:198: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p stopped-upgrade-504000 --memory=2200 --alsologtostderr -v=1 --driver=qemu2 : exit status 80 (8m42.4240775s)

                                                
                                                
-- stdout --
	* [stopped-upgrade-504000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Kubernetes 1.31.0 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.0
	* Using the qemu2 driver based on existing profile
	* Starting "stopped-upgrade-504000" primary control-plane node in "stopped-upgrade-504000" cluster
	* Restarting existing qemu2 VM for "stopped-upgrade-504000" ...
	* Preparing Kubernetes v1.24.1 on Docker 20.10.16 ...
	  - Generating certificates and keys ...
	  - Booting up control plane ...
	  - Configuring RBAC rules ...
	* Configuring bridge CNI (Container Networking Interface) ...
	* Verifying Kubernetes components...
	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	* Enabled addons: storage-provisioner
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:42:47.895693    3955 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:42:47.895837    3955 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:42:47.895840    3955 out.go:304] Setting ErrFile to fd 2...
	I0814 17:42:47.895842    3955 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:42:47.895984    3955 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:42:47.897018    3955 out.go:298] Setting JSON to false
	I0814 17:42:47.913551    3955 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2530,"bootTime":1723680037,"procs":457,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:42:47.913645    3955 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:42:47.916912    3955 out.go:177] * [stopped-upgrade-504000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:42:47.923815    3955 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:42:47.923924    3955 notify.go:220] Checking for updates...
	I0814 17:42:47.930851    3955 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:42:47.933814    3955 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:42:47.936850    3955 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:42:47.939783    3955 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:42:47.942904    3955 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:42:47.946214    3955 config.go:182] Loaded profile config "stopped-upgrade-504000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I0814 17:42:47.949789    3955 out.go:177] * Kubernetes 1.31.0 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.0
	I0814 17:42:47.952815    3955 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:42:47.956747    3955 out.go:177] * Using the qemu2 driver based on existing profile
	I0814 17:42:47.963783    3955 start.go:297] selected driver: qemu2
	I0814 17:42:47.963800    3955 start.go:901] validating driver "qemu2" against &{Name:stopped-upgrade-504000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.26.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:50260 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:stopped-upgra
de-504000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizat
ions:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s}
	I0814 17:42:47.963846    3955 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:42:47.966219    3955 cni.go:84] Creating CNI manager for ""
	I0814 17:42:47.966234    3955 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:42:47.966259    3955 start.go:340] cluster config:
	{Name:stopped-upgrade-504000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.26.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:50260 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:stopped-upgrade-504000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerN
ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:
SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s}
	I0814 17:42:47.966309    3955 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:42:47.973760    3955 out.go:177] * Starting "stopped-upgrade-504000" primary control-plane node in "stopped-upgrade-504000" cluster
	I0814 17:42:47.977800    3955 preload.go:131] Checking if preload exists for k8s version v1.24.1 and runtime docker
	I0814 17:42:47.977823    3955 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-arm64.tar.lz4
	I0814 17:42:47.977835    3955 cache.go:56] Caching tarball of preloaded images
	I0814 17:42:47.977903    3955 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:42:47.977909    3955 cache.go:59] Finished verifying existence of preloaded tar for v1.24.1 on docker
	I0814 17:42:47.977963    3955 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/config.json ...
	I0814 17:42:47.978323    3955 start.go:360] acquireMachinesLock for stopped-upgrade-504000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:42:47.978353    3955 start.go:364] duration metric: took 23.209µs to acquireMachinesLock for "stopped-upgrade-504000"
	I0814 17:42:47.978361    3955 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:42:47.978364    3955 fix.go:54] fixHost starting: 
	I0814 17:42:47.978476    3955 fix.go:112] recreateIfNeeded on stopped-upgrade-504000: state=Stopped err=<nil>
	W0814 17:42:47.978487    3955 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:42:47.982774    3955 out.go:177] * Restarting existing qemu2 VM for "stopped-upgrade-504000" ...
	I0814 17:42:47.990774    3955 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:42:47.990861    3955 main.go:141] libmachine: executing: qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/Cellar/qemu/9.0.2/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/stopped-upgrade-504000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/stopped-upgrade-504000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/stopped-upgrade-504000/qemu.pid -nic user,model=virtio,hostfwd=tcp::50228-:22,hostfwd=tcp::50229-:2376,hostname=stopped-upgrade-504000 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/stopped-upgrade-504000/disk.qcow2
	I0814 17:42:48.027114    3955 main.go:141] libmachine: STDOUT: 
	I0814 17:42:48.027141    3955 main.go:141] libmachine: STDERR: 
	I0814 17:42:48.027146    3955 main.go:141] libmachine: Waiting for VM to start (ssh -p 50228 docker@127.0.0.1)...
	I0814 17:43:08.847383    3955 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/config.json ...
	I0814 17:43:08.847680    3955 machine.go:94] provisionDockerMachine start ...
	I0814 17:43:08.847735    3955 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:08.847929    3955 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10482c5a0] 0x10482ee00 <nil>  [] 0s} localhost 50228 <nil> <nil>}
	I0814 17:43:08.847937    3955 main.go:141] libmachine: About to run SSH command:
	hostname
	I0814 17:43:08.918488    3955 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
	
	I0814 17:43:08.918507    3955 buildroot.go:166] provisioning hostname "stopped-upgrade-504000"
	I0814 17:43:08.918567    3955 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:08.918701    3955 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10482c5a0] 0x10482ee00 <nil>  [] 0s} localhost 50228 <nil> <nil>}
	I0814 17:43:08.918709    3955 main.go:141] libmachine: About to run SSH command:
	sudo hostname stopped-upgrade-504000 && echo "stopped-upgrade-504000" | sudo tee /etc/hostname
	I0814 17:43:08.991560    3955 main.go:141] libmachine: SSH cmd err, output: <nil>: stopped-upgrade-504000
	
	I0814 17:43:08.991616    3955 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:08.991744    3955 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10482c5a0] 0x10482ee00 <nil>  [] 0s} localhost 50228 <nil> <nil>}
	I0814 17:43:08.991752    3955 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sstopped-upgrade-504000' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 stopped-upgrade-504000/g' /etc/hosts;
				else 
					echo '127.0.1.1 stopped-upgrade-504000' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0814 17:43:09.060432    3955 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0814 17:43:09.060446    3955 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/19443-949/.minikube CaCertPath:/Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/19443-949/.minikube}
	I0814 17:43:09.060466    3955 buildroot.go:174] setting up certificates
	I0814 17:43:09.060472    3955 provision.go:84] configureAuth start
	I0814 17:43:09.060476    3955 provision.go:143] copyHostCerts
	I0814 17:43:09.060564    3955 exec_runner.go:144] found /Users/jenkins/minikube-integration/19443-949/.minikube/ca.pem, removing ...
	I0814 17:43:09.060570    3955 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19443-949/.minikube/ca.pem
	I0814 17:43:09.060682    3955 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/19443-949/.minikube/ca.pem (1078 bytes)
	I0814 17:43:09.060861    3955 exec_runner.go:144] found /Users/jenkins/minikube-integration/19443-949/.minikube/cert.pem, removing ...
	I0814 17:43:09.060864    3955 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19443-949/.minikube/cert.pem
	I0814 17:43:09.060921    3955 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/19443-949/.minikube/cert.pem (1123 bytes)
	I0814 17:43:09.061026    3955 exec_runner.go:144] found /Users/jenkins/minikube-integration/19443-949/.minikube/key.pem, removing ...
	I0814 17:43:09.061030    3955 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19443-949/.minikube/key.pem
	I0814 17:43:09.061075    3955 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/19443-949/.minikube/key.pem (1679 bytes)
	I0814 17:43:09.061160    3955 provision.go:117] generating server cert: /Users/jenkins/minikube-integration/19443-949/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca-key.pem org=jenkins.stopped-upgrade-504000 san=[127.0.0.1 localhost minikube stopped-upgrade-504000]
	I0814 17:43:09.141913    3955 provision.go:177] copyRemoteCerts
	I0814 17:43:09.141960    3955 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0814 17:43:09.141970    3955 sshutil.go:53] new ssh client: &{IP:localhost Port:50228 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/stopped-upgrade-504000/id_rsa Username:docker}
	I0814 17:43:09.178731    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0814 17:43:09.185205    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
	I0814 17:43:09.192477    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0814 17:43:09.199605    3955 provision.go:87] duration metric: took 139.1395ms to configureAuth
	I0814 17:43:09.199615    3955 buildroot.go:189] setting minikube options for container-runtime
	I0814 17:43:09.199727    3955 config.go:182] Loaded profile config "stopped-upgrade-504000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I0814 17:43:09.199765    3955 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:09.199855    3955 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10482c5a0] 0x10482ee00 <nil>  [] 0s} localhost 50228 <nil> <nil>}
	I0814 17:43:09.199860    3955 main.go:141] libmachine: About to run SSH command:
	df --output=fstype / | tail -n 1
	I0814 17:43:09.266544    3955 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs
	
	I0814 17:43:09.266555    3955 buildroot.go:70] root file system type: tmpfs
	I0814 17:43:09.266607    3955 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
	I0814 17:43:09.266656    3955 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:09.266772    3955 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10482c5a0] 0x10482ee00 <nil>  [] 0s} localhost 50228 <nil> <nil>}
	I0814 17:43:09.266805    3955 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	After=network.target  minikube-automount.service docker.socket
	Requires= minikube-automount.service docker.socket 
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP \$MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	" | sudo tee /lib/systemd/system/docker.service.new
	I0814 17:43:09.338721    3955 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	After=network.target  minikube-automount.service docker.socket
	Requires= minikube-automount.service docker.socket 
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP $MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	
	I0814 17:43:09.338775    3955 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:09.338892    3955 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10482c5a0] 0x10482ee00 <nil>  [] 0s} localhost 50228 <nil> <nil>}
	I0814 17:43:09.338902    3955 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
	I0814 17:43:09.714079    3955 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory
	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.
	
	I0814 17:43:09.714100    3955 machine.go:97] duration metric: took 866.479083ms to provisionDockerMachine
	I0814 17:43:09.714107    3955 start.go:293] postStartSetup for "stopped-upgrade-504000" (driver="qemu2")
	I0814 17:43:09.714116    3955 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0814 17:43:09.714184    3955 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0814 17:43:09.714196    3955 sshutil.go:53] new ssh client: &{IP:localhost Port:50228 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/stopped-upgrade-504000/id_rsa Username:docker}
	I0814 17:43:09.752009    3955 ssh_runner.go:195] Run: cat /etc/os-release
	I0814 17:43:09.754183    3955 info.go:137] Remote host: Buildroot 2021.02.12
	I0814 17:43:09.754190    3955 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19443-949/.minikube/addons for local assets ...
	I0814 17:43:09.754270    3955 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19443-949/.minikube/files for local assets ...
	I0814 17:43:09.754390    3955 filesync.go:149] local asset: /Users/jenkins/minikube-integration/19443-949/.minikube/files/etc/ssl/certs/14042.pem -> 14042.pem in /etc/ssl/certs
	I0814 17:43:09.754519    3955 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0814 17:43:09.756873    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/files/etc/ssl/certs/14042.pem --> /etc/ssl/certs/14042.pem (1708 bytes)
	I0814 17:43:09.764730    3955 start.go:296] duration metric: took 50.618625ms for postStartSetup
	I0814 17:43:09.764748    3955 fix.go:56] duration metric: took 21.7893275s for fixHost
	I0814 17:43:09.764794    3955 main.go:141] libmachine: Using SSH client type: native
	I0814 17:43:09.764908    3955 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10482c5a0] 0x10482ee00 <nil>  [] 0s} localhost 50228 <nil> <nil>}
	I0814 17:43:09.764914    3955 main.go:141] libmachine: About to run SSH command:
	date +%s.%N
	I0814 17:43:09.835244    3955 main.go:141] libmachine: SSH cmd err, output: <nil>: 1723682590.078950463
	
	I0814 17:43:09.835256    3955 fix.go:216] guest clock: 1723682590.078950463
	I0814 17:43:09.835260    3955 fix.go:229] Guest: 2024-08-14 17:43:10.078950463 -0700 PDT Remote: 2024-08-14 17:43:09.76475 -0700 PDT m=+21.891397626 (delta=314.200463ms)
	I0814 17:43:09.835272    3955 fix.go:200] guest clock delta is within tolerance: 314.200463ms
	I0814 17:43:09.835275    3955 start.go:83] releasing machines lock for "stopped-upgrade-504000", held for 21.8598675s
	I0814 17:43:09.835354    3955 ssh_runner.go:195] Run: cat /version.json
	I0814 17:43:09.835367    3955 sshutil.go:53] new ssh client: &{IP:localhost Port:50228 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/stopped-upgrade-504000/id_rsa Username:docker}
	I0814 17:43:09.835502    3955 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0814 17:43:09.835543    3955 sshutil.go:53] new ssh client: &{IP:localhost Port:50228 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/stopped-upgrade-504000/id_rsa Username:docker}
	W0814 17:43:09.836157    3955 sshutil.go:64] dial failure (will retry): dial tcp [::1]:50228: connect: connection refused
	I0814 17:43:09.836206    3955 retry.go:31] will retry after 258.449934ms: dial tcp [::1]:50228: connect: connection refused
	W0814 17:43:09.870432    3955 start.go:419] Unable to open version.json: cat /version.json: Process exited with status 1
	stdout:
	
	stderr:
	cat: /version.json: No such file or directory
	I0814 17:43:09.870491    3955 ssh_runner.go:195] Run: systemctl --version
	I0814 17:43:09.872391    3955 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	W0814 17:43:09.874327    3955 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
	I0814 17:43:09.874370    3955 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
	I0814 17:43:09.877465    3955 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
	I0814 17:43:09.882661    3955 cni.go:308] configured [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
	I0814 17:43:09.882674    3955 start.go:495] detecting cgroup driver to use...
	I0814 17:43:09.882751    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0814 17:43:09.889803    3955 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.7"|' /etc/containerd/config.toml"
	I0814 17:43:09.893090    3955 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0814 17:43:09.896402    3955 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
	I0814 17:43:09.896424    3955 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0814 17:43:09.899647    3955 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0814 17:43:09.902665    3955 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0814 17:43:09.905628    3955 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0814 17:43:09.908820    3955 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0814 17:43:09.912475    3955 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0814 17:43:09.916096    3955 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
	I0814 17:43:09.919642    3955 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"
	I0814 17:43:09.922932    3955 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0814 17:43:09.925691    3955 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0814 17:43:09.928826    3955 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:43:10.010189    3955 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0814 17:43:10.016361    3955 start.go:495] detecting cgroup driver to use...
	I0814 17:43:10.016410    3955 ssh_runner.go:195] Run: sudo systemctl cat docker.service
	I0814 17:43:10.021707    3955 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0814 17:43:10.027853    3955 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0814 17:43:10.039293    3955 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0814 17:43:10.043913    3955 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0814 17:43:10.048303    3955 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0814 17:43:10.107052    3955 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0814 17:43:10.111504    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0814 17:43:10.117553    3955 ssh_runner.go:195] Run: which cri-dockerd
	I0814 17:43:10.119139    3955 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
	I0814 17:43:10.121829    3955 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
	I0814 17:43:10.126821    3955 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
	I0814 17:43:10.206222    3955 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
	I0814 17:43:10.289378    3955 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
	I0814 17:43:10.289448    3955 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
	I0814 17:43:10.294984    3955 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:43:10.380106    3955 ssh_runner.go:195] Run: sudo systemctl restart docker
	I0814 17:43:11.502649    3955 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.122607458s)
	I0814 17:43:11.502717    3955 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket
	I0814 17:43:11.507887    3955 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
	I0814 17:43:11.512828    3955 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
	I0814 17:43:11.596093    3955 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
	I0814 17:43:11.670970    3955 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:43:11.737288    3955 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
	I0814 17:43:11.743687    3955 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
	I0814 17:43:11.748155    3955 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:43:11.826649    3955 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service
	I0814 17:43:11.868068    3955 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock
	I0814 17:43:11.868143    3955 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
	I0814 17:43:11.871093    3955 start.go:563] Will wait 60s for crictl version
	I0814 17:43:11.871145    3955 ssh_runner.go:195] Run: which crictl
	I0814 17:43:11.872351    3955 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0814 17:43:11.886555    3955 start.go:579] Version:  0.1.0
	RuntimeName:  docker
	RuntimeVersion:  20.10.16
	RuntimeApiVersion:  1.41.0
	I0814 17:43:11.886625    3955 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I0814 17:43:11.901815    3955 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I0814 17:43:11.921160    3955 out.go:204] * Preparing Kubernetes v1.24.1 on Docker 20.10.16 ...
	I0814 17:43:11.921286    3955 ssh_runner.go:195] Run: grep 10.0.2.2	host.minikube.internal$ /etc/hosts
	I0814 17:43:11.922719    3955 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "10.0.2.2	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0814 17:43:11.926334    3955 kubeadm.go:883] updating cluster {Name:stopped-upgrade-504000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:50260 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName
:stopped-upgrade-504000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Di
sableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s} ...
	I0814 17:43:11.926379    3955 preload.go:131] Checking if preload exists for k8s version v1.24.1 and runtime docker
	I0814 17:43:11.926418    3955 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I0814 17:43:11.937400    3955 docker.go:685] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-apiserver:v1.24.1
	k8s.gcr.io/kube-proxy:v1.24.1
	k8s.gcr.io/kube-controller-manager:v1.24.1
	k8s.gcr.io/kube-scheduler:v1.24.1
	k8s.gcr.io/etcd:3.5.3-0
	k8s.gcr.io/pause:3.7
	k8s.gcr.io/coredns/coredns:v1.8.6
	k8s.gcr.io/pause:3.6
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I0814 17:43:11.937408    3955 docker.go:691] registry.k8s.io/kube-apiserver:v1.24.1 wasn't preloaded
	I0814 17:43:11.937465    3955 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I0814 17:43:11.940826    3955 ssh_runner.go:195] Run: which lz4
	I0814 17:43:11.942121    3955 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
	I0814 17:43:11.943357    3955 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/preloaded.tar.lz4': No such file or directory
	I0814 17:43:11.943366    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (359514331 bytes)
	I0814 17:43:12.926415    3955 docker.go:649] duration metric: took 984.396208ms to copy over tarball
	I0814 17:43:12.926470    3955 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
	I0814 17:43:14.093158    3955 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (1.166751875s)
	I0814 17:43:14.093173    3955 ssh_runner.go:146] rm: /preloaded.tar.lz4
	I0814 17:43:14.110151    3955 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I0814 17:43:14.113667    3955 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2523 bytes)
	I0814 17:43:14.119276    3955 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:43:14.197137    3955 ssh_runner.go:195] Run: sudo systemctl restart docker
	I0814 17:43:15.756157    3955 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.559099333s)
	I0814 17:43:15.756247    3955 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I0814 17:43:15.770312    3955 docker.go:685] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-apiserver:v1.24.1
	k8s.gcr.io/kube-proxy:v1.24.1
	k8s.gcr.io/kube-controller-manager:v1.24.1
	k8s.gcr.io/kube-scheduler:v1.24.1
	k8s.gcr.io/etcd:3.5.3-0
	k8s.gcr.io/pause:3.7
	k8s.gcr.io/coredns/coredns:v1.8.6
	<none>:<none>
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I0814 17:43:15.770320    3955 docker.go:691] registry.k8s.io/kube-apiserver:v1.24.1 wasn't preloaded
	I0814 17:43:15.770325    3955 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.24.1 registry.k8s.io/kube-controller-manager:v1.24.1 registry.k8s.io/kube-scheduler:v1.24.1 registry.k8s.io/kube-proxy:v1.24.1 registry.k8s.io/pause:3.7 registry.k8s.io/etcd:3.5.3-0 registry.k8s.io/coredns/coredns:v1.8.6 gcr.io/k8s-minikube/storage-provisioner:v5]
	I0814 17:43:15.774208    3955 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:43:15.775791    3955 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.24.1
	I0814 17:43:15.777715    3955 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:43:15.777741    3955 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.24.1
	I0814 17:43:15.780450    3955 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.24.1
	I0814 17:43:15.780548    3955 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.24.1
	I0814 17:43:15.782824    3955 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.24.1
	I0814 17:43:15.782901    3955 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.24.1
	I0814 17:43:15.784773    3955 image.go:135] retrieving image: registry.k8s.io/etcd:3.5.3-0
	I0814 17:43:15.785214    3955 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.24.1
	I0814 17:43:15.786753    3955 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.24.1
	I0814 17:43:15.786783    3955 image.go:135] retrieving image: registry.k8s.io/pause:3.7
	I0814 17:43:15.788304    3955 image.go:178] daemon lookup for registry.k8s.io/etcd:3.5.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.3-0
	I0814 17:43:15.788311    3955 image.go:135] retrieving image: registry.k8s.io/coredns/coredns:v1.8.6
	I0814 17:43:15.790531    3955 image.go:178] daemon lookup for registry.k8s.io/pause:3.7: Error response from daemon: No such image: registry.k8s.io/pause:3.7
	I0814 17:43:15.791780    3955 image.go:178] daemon lookup for registry.k8s.io/coredns/coredns:v1.8.6: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.8.6
	I0814 17:43:16.216028    3955 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.24.1
	I0814 17:43:16.225169    3955 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.24.1
	I0814 17:43:16.227747    3955 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.24.1" needs transfer: "registry.k8s.io/kube-proxy:v1.24.1" does not exist at hash "fcbd620bbac080b658602c597709b377cb2b3fec134a097a27f94cba9b2ed2fa" in container runtime
	I0814 17:43:16.227781    3955 docker.go:337] Removing image: registry.k8s.io/kube-proxy:v1.24.1
	I0814 17:43:16.227829    3955 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-proxy:v1.24.1
	I0814 17:43:16.238931    3955 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.24.1" needs transfer: "registry.k8s.io/kube-apiserver:v1.24.1" does not exist at hash "7c5896a75862a8bc252122185a929cec1393db2c525f6440137d4fbf46bbf6f9" in container runtime
	I0814 17:43:16.238951    3955 docker.go:337] Removing image: registry.k8s.io/kube-apiserver:v1.24.1
	I0814 17:43:16.238974    3955 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.24.1
	I0814 17:43:16.238976    3955 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-apiserver:v1.24.1
	I0814 17:43:16.240397    3955 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.1
	I0814 17:43:16.251691    3955 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.24.1" needs transfer: "registry.k8s.io/kube-scheduler:v1.24.1" does not exist at hash "000c19baf6bba51ff7ae5449f4c7a16d9190cef0263f58070dbf62cea9c4982f" in container runtime
	I0814 17:43:16.251725    3955 docker.go:337] Removing image: registry.k8s.io/kube-scheduler:v1.24.1
	I0814 17:43:16.251786    3955 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-scheduler:v1.24.1
	I0814 17:43:16.257687    3955 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.1
	I0814 17:43:16.263330    3955 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.24.1
	I0814 17:43:16.267139    3955 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.24.1
	I0814 17:43:16.276828    3955 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/etcd:3.5.3-0
	I0814 17:43:16.277634    3955 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.24.1" needs transfer: "registry.k8s.io/kube-controller-manager:v1.24.1" does not exist at hash "f61bbe9259d7caa580deb6c8e4bfd1780c7b5887efe3aa3adc7cc74f68a27c1b" in container runtime
	I0814 17:43:16.277662    3955 docker.go:337] Removing image: registry.k8s.io/kube-controller-manager:v1.24.1
	I0814 17:43:16.277707    3955 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-controller-manager:v1.24.1
	I0814 17:43:16.290123    3955 cache_images.go:116] "registry.k8s.io/etcd:3.5.3-0" needs transfer: "registry.k8s.io/etcd:3.5.3-0" does not exist at hash "a9a710bb96df080e6b9c720eb85dc5b832ff84abf77263548d74fedec6466a5a" in container runtime
	I0814 17:43:16.290149    3955 docker.go:337] Removing image: registry.k8s.io/etcd:3.5.3-0
	I0814 17:43:16.290194    3955 ssh_runner.go:195] Run: docker rmi registry.k8s.io/etcd:3.5.3-0
	I0814 17:43:16.290906    3955 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.1
	I0814 17:43:16.301594    3955 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0
	I0814 17:43:16.302565    3955 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/etcd_3.5.3-0
	I0814 17:43:16.304111    3955 ssh_runner.go:352] existence check for /var/lib/minikube/images/etcd_3.5.3-0: stat -c "%s %y" /var/lib/minikube/images/etcd_3.5.3-0: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/images/etcd_3.5.3-0': No such file or directory
	I0814 17:43:16.304123    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0 --> /var/lib/minikube/images/etcd_3.5.3-0 (81117184 bytes)
	W0814 17:43:16.308289    3955 image.go:283] image registry.k8s.io/coredns/coredns:v1.8.6 arch mismatch: want arm64 got amd64. fixing
	I0814 17:43:16.308409    3955 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/coredns/coredns:v1.8.6
	I0814 17:43:16.330944    3955 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/pause:3.7
	I0814 17:43:16.338984    3955 cache_images.go:116] "registry.k8s.io/coredns/coredns:v1.8.6" needs transfer: "registry.k8s.io/coredns/coredns:v1.8.6" does not exist at hash "6af7f860a8197bfa3fdb7dec2061aa33870253e87a1e91c492d55b8a4fd38d14" in container runtime
	I0814 17:43:16.339012    3955 docker.go:337] Removing image: registry.k8s.io/coredns/coredns:v1.8.6
	I0814 17:43:16.339067    3955 ssh_runner.go:195] Run: docker rmi registry.k8s.io/coredns/coredns:v1.8.6
	I0814 17:43:16.364951    3955 cache_images.go:116] "registry.k8s.io/pause:3.7" needs transfer: "registry.k8s.io/pause:3.7" does not exist at hash "e5a475a0380575fb5df454b2e32bdec93e1ec0094d8a61e895b41567cb884550" in container runtime
	I0814 17:43:16.364984    3955 docker.go:337] Removing image: registry.k8s.io/pause:3.7
	I0814 17:43:16.365043    3955 ssh_runner.go:195] Run: docker rmi registry.k8s.io/pause:3.7
	I0814 17:43:16.370979    3955 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6
	I0814 17:43:16.371107    3955 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/coredns_v1.8.6
	W0814 17:43:16.383017    3955 image.go:283] image gcr.io/k8s-minikube/storage-provisioner:v5 arch mismatch: want arm64 got amd64. fixing
	I0814 17:43:16.383165    3955 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:43:16.406809    3955 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7
	I0814 17:43:16.406825    3955 ssh_runner.go:352] existence check for /var/lib/minikube/images/coredns_v1.8.6: stat -c "%s %y" /var/lib/minikube/images/coredns_v1.8.6: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/images/coredns_v1.8.6': No such file or directory
	I0814 17:43:16.406843    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6 --> /var/lib/minikube/images/coredns_v1.8.6 (12318720 bytes)
	I0814 17:43:16.406935    3955 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/pause_3.7
	I0814 17:43:16.431732    3955 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "66749159455b3f08c8318fe0233122f54d0f5889f9c5fdfb73c3fd9d99895b51" in container runtime
	I0814 17:43:16.431757    3955 docker.go:337] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:43:16.431815    3955 ssh_runner.go:195] Run: docker rmi gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:43:16.432630    3955 ssh_runner.go:352] existence check for /var/lib/minikube/images/pause_3.7: stat -c "%s %y" /var/lib/minikube/images/pause_3.7: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/images/pause_3.7': No such file or directory
	I0814 17:43:16.432648    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7 --> /var/lib/minikube/images/pause_3.7 (268288 bytes)
	I0814 17:43:16.471132    3955 docker.go:304] Loading image: /var/lib/minikube/images/pause_3.7
	I0814 17:43:16.471148    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/pause_3.7 | docker load"
	I0814 17:43:16.476173    3955 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5
	I0814 17:43:16.476306    3955 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/storage-provisioner_v5
	I0814 17:43:16.558400    3955 cache_images.go:321] Transferred and loaded /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7 from cache
	I0814 17:43:16.558422    3955 docker.go:304] Loading image: /var/lib/minikube/images/coredns_v1.8.6
	I0814 17:43:16.558429    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/coredns_v1.8.6 | docker load"
	I0814 17:43:16.558493    3955 ssh_runner.go:352] existence check for /var/lib/minikube/images/storage-provisioner_v5: stat -c "%s %y" /var/lib/minikube/images/storage-provisioner_v5: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/images/storage-provisioner_v5': No such file or directory
	I0814 17:43:16.558524    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 --> /var/lib/minikube/images/storage-provisioner_v5 (8035840 bytes)
	I0814 17:43:16.647053    3955 cache_images.go:321] Transferred and loaded /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6 from cache
	I0814 17:43:16.647074    3955 docker.go:304] Loading image: /var/lib/minikube/images/storage-provisioner_v5
	I0814 17:43:16.647080    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/storage-provisioner_v5 | docker load"
	I0814 17:43:16.987812    3955 cache_images.go:321] Transferred and loaded /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 from cache
	I0814 17:43:16.987829    3955 docker.go:304] Loading image: /var/lib/minikube/images/etcd_3.5.3-0
	I0814 17:43:16.987838    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/etcd_3.5.3-0 | docker load"
	I0814 17:43:17.144457    3955 cache_images.go:321] Transferred and loaded /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0 from cache
	I0814 17:43:17.144501    3955 cache_images.go:92] duration metric: took 1.374250291s to LoadCachedImages
	W0814 17:43:17.144541    3955 out.go:239] X Unable to load cached images: LoadCachedImages: stat /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.1: no such file or directory
	X Unable to load cached images: LoadCachedImages: stat /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.1: no such file or directory
	I0814 17:43:17.144545    3955 kubeadm.go:934] updating node { 10.0.2.15 8443 v1.24.1 docker true true} ...
	I0814 17:43:17.144599    3955 kubeadm.go:946] kubelet [Unit]
	Wants=docker.socket
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=stopped-upgrade-504000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=10.0.2.15
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.1 ClusterName:stopped-upgrade-504000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0814 17:43:17.144664    3955 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
	I0814 17:43:17.158108    3955 cni.go:84] Creating CNI manager for ""
	I0814 17:43:17.158122    3955 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:43:17.158131    3955 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0814 17:43:17.158141    3955 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:10.0.2.15 APIServerPort:8443 KubernetesVersion:v1.24.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:stopped-upgrade-504000 NodeName:stopped-upgrade-504000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "10.0.2.15"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:10.0.2.15 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/
etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0814 17:43:17.158200    3955 kubeadm.go:187] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 10.0.2.15
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/cri-dockerd.sock
	  name: "stopped-upgrade-504000"
	  kubeletExtraArgs:
	    node-ip: 10.0.2.15
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "10.0.2.15"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.1
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0814 17:43:17.158259    3955 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.1
	I0814 17:43:17.161085    3955 binaries.go:44] Found k8s binaries, skipping transfer
	I0814 17:43:17.161118    3955 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0814 17:43:17.164057    3955 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (380 bytes)
	I0814 17:43:17.169387    3955 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0814 17:43:17.174809    3955 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2096 bytes)
	I0814 17:43:17.180614    3955 ssh_runner.go:195] Run: grep 10.0.2.15	control-plane.minikube.internal$ /etc/hosts
	I0814 17:43:17.182186    3955 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "10.0.2.15	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0814 17:43:17.186005    3955 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:43:17.262096    3955 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0814 17:43:17.277122    3955 certs.go:68] Setting up /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000 for IP: 10.0.2.15
	I0814 17:43:17.277132    3955 certs.go:194] generating shared ca certs ...
	I0814 17:43:17.277141    3955 certs.go:226] acquiring lock for ca certs: {Name:mk9c8185fea6e56aae9b82059113ab288e9964dd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:43:17.277315    3955 certs.go:235] skipping valid "minikubeCA" ca cert: /Users/jenkins/minikube-integration/19443-949/.minikube/ca.key
	I0814 17:43:17.277365    3955 certs.go:235] skipping valid "proxyClientCA" ca cert: /Users/jenkins/minikube-integration/19443-949/.minikube/proxy-client-ca.key
	I0814 17:43:17.277369    3955 certs.go:256] generating profile certs ...
	I0814 17:43:17.277442    3955 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/client.key
	I0814 17:43:17.277457    3955 certs.go:363] generating signed profile cert for "minikube": /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/apiserver.key.f73c6db7
	I0814 17:43:17.277469    3955 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/apiserver.crt.f73c6db7 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 10.0.2.15]
	I0814 17:43:17.352523    3955 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/apiserver.crt.f73c6db7 ...
	I0814 17:43:17.352537    3955 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/apiserver.crt.f73c6db7: {Name:mk79a7a7bb3c08716fe925f5622ca2d9d2cdf7ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:43:17.353036    3955 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/apiserver.key.f73c6db7 ...
	I0814 17:43:17.353042    3955 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/apiserver.key.f73c6db7: {Name:mkf632f5cb8ac150482d347063fe285ac2c45556 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:43:17.353210    3955 certs.go:381] copying /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/apiserver.crt.f73c6db7 -> /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/apiserver.crt
	I0814 17:43:17.353359    3955 certs.go:385] copying /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/apiserver.key.f73c6db7 -> /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/apiserver.key
	I0814 17:43:17.353513    3955 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/proxy-client.key
	I0814 17:43:17.353652    3955 certs.go:484] found cert: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/1404.pem (1338 bytes)
	W0814 17:43:17.353681    3955 certs.go:480] ignoring /Users/jenkins/minikube-integration/19443-949/.minikube/certs/1404_empty.pem, impossibly tiny 0 bytes
	I0814 17:43:17.353687    3955 certs.go:484] found cert: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca-key.pem (1675 bytes)
	I0814 17:43:17.353707    3955 certs.go:484] found cert: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem (1078 bytes)
	I0814 17:43:17.353726    3955 certs.go:484] found cert: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem (1123 bytes)
	I0814 17:43:17.353745    3955 certs.go:484] found cert: /Users/jenkins/minikube-integration/19443-949/.minikube/certs/key.pem (1679 bytes)
	I0814 17:43:17.353787    3955 certs.go:484] found cert: /Users/jenkins/minikube-integration/19443-949/.minikube/files/etc/ssl/certs/14042.pem (1708 bytes)
	I0814 17:43:17.354141    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0814 17:43:17.361051    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0814 17:43:17.368033    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0814 17:43:17.375309    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0814 17:43:17.382670    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
	I0814 17:43:17.389291    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0814 17:43:17.396556    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0814 17:43:17.404412    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0814 17:43:17.412513    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0814 17:43:17.420743    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/certs/1404.pem --> /usr/share/ca-certificates/1404.pem (1338 bytes)
	I0814 17:43:17.428206    3955 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19443-949/.minikube/files/etc/ssl/certs/14042.pem --> /usr/share/ca-certificates/14042.pem (1708 bytes)
	I0814 17:43:17.435730    3955 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0814 17:43:17.441362    3955 ssh_runner.go:195] Run: openssl version
	I0814 17:43:17.443353    3955 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0814 17:43:17.446483    3955 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0814 17:43:17.448135    3955 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 15 00:05 /usr/share/ca-certificates/minikubeCA.pem
	I0814 17:43:17.448169    3955 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0814 17:43:17.450472    3955 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0814 17:43:17.453725    3955 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1404.pem && ln -fs /usr/share/ca-certificates/1404.pem /etc/ssl/certs/1404.pem"
	I0814 17:43:17.456787    3955 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1404.pem
	I0814 17:43:17.458259    3955 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 15 00:12 /usr/share/ca-certificates/1404.pem
	I0814 17:43:17.458286    3955 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1404.pem
	I0814 17:43:17.460160    3955 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1404.pem /etc/ssl/certs/51391683.0"
	I0814 17:43:17.463700    3955 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14042.pem && ln -fs /usr/share/ca-certificates/14042.pem /etc/ssl/certs/14042.pem"
	I0814 17:43:17.467185    3955 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14042.pem
	I0814 17:43:17.468608    3955 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 15 00:12 /usr/share/ca-certificates/14042.pem
	I0814 17:43:17.468639    3955 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14042.pem
	I0814 17:43:17.471047    3955 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14042.pem /etc/ssl/certs/3ec20f2e.0"
	I0814 17:43:17.474481    3955 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0814 17:43:17.475983    3955 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0814 17:43:17.478255    3955 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0814 17:43:17.480142    3955 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0814 17:43:17.482260    3955 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0814 17:43:17.484414    3955 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0814 17:43:17.486495    3955 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0814 17:43:17.488443    3955 kubeadm.go:392] StartCluster: {Name:stopped-upgrade-504000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:50260 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:st
opped-upgrade-504000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disab
leOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s}
	I0814 17:43:17.488531    3955 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I0814 17:43:17.500508    3955 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0814 17:43:17.504248    3955 kubeadm.go:408] found existing configuration files, will attempt cluster restart
	I0814 17:43:17.504258    3955 kubeadm.go:593] restartPrimaryControlPlane start ...
	I0814 17:43:17.504297    3955 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0814 17:43:17.507887    3955 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0814 17:43:17.508123    3955 kubeconfig.go:47] verify endpoint returned: get endpoint: "stopped-upgrade-504000" does not appear in /Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:43:17.508172    3955 kubeconfig.go:62] /Users/jenkins/minikube-integration/19443-949/kubeconfig needs updating (will repair): [kubeconfig missing "stopped-upgrade-504000" cluster setting kubeconfig missing "stopped-upgrade-504000" context setting]
	I0814 17:43:17.508303    3955 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/kubeconfig: {Name:mke777513f7f5736c6804680b89db76bd98a8ac2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:43:17.508814    3955 kapi.go:59] client config for stopped-upgrade-504000: &rest.Config{Host:"https://10.0.2.15:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/client.key", CAFile:"/Users/jenkins/minikube-integration/19443-949/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8
(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x105de4f90), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0814 17:43:17.509129    3955 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0814 17:43:17.512309    3955 kubeadm.go:640] detected kubeadm config drift (will reconfigure cluster from new /var/tmp/minikube/kubeadm.yaml):
	-- stdout --
	--- /var/tmp/minikube/kubeadm.yaml
	+++ /var/tmp/minikube/kubeadm.yaml.new
	@@ -11,7 +11,7 @@
	       - signing
	       - authentication
	 nodeRegistration:
	-  criSocket: /var/run/cri-dockerd.sock
	+  criSocket: unix:///var/run/cri-dockerd.sock
	   name: "stopped-upgrade-504000"
	   kubeletExtraArgs:
	     node-ip: 10.0.2.15
	@@ -49,7 +49,9 @@
	 authentication:
	   x509:
	     clientCAFile: /var/lib/minikube/certs/ca.crt
	-cgroupDriver: systemd
	+cgroupDriver: cgroupfs
	+hairpinMode: hairpin-veth
	+runtimeRequestTimeout: 15m
	 clusterDomain: "cluster.local"
	 # disable disk resource management by default
	 imageGCHighThresholdPercent: 100
	
	-- /stdout --
	I0814 17:43:17.512315    3955 kubeadm.go:1160] stopping kube-system containers ...
	I0814 17:43:17.512359    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I0814 17:43:17.524657    3955 docker.go:483] Stopping containers: [886c89769d4d 8d68838819f9 b5246542fbb2 4f7295da5208 dc948f7a1a5b 6c24687f39f7 b6958c7276b1 aa3e71ab91c3]
	I0814 17:43:17.524720    3955 ssh_runner.go:195] Run: docker stop 886c89769d4d 8d68838819f9 b5246542fbb2 4f7295da5208 dc948f7a1a5b 6c24687f39f7 b6958c7276b1 aa3e71ab91c3
	I0814 17:43:17.537748    3955 ssh_runner.go:195] Run: sudo systemctl stop kubelet
	I0814 17:43:17.543753    3955 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0814 17:43:17.547536    3955 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0814 17:43:17.547546    3955 kubeadm.go:157] found existing configuration files:
	
	I0814 17:43:17.547601    3955 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/admin.conf
	I0814 17:43:17.550696    3955 kubeadm.go:163] "https://control-plane.minikube.internal:50260" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I0814 17:43:17.550743    3955 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I0814 17:43:17.553869    3955 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/kubelet.conf
	I0814 17:43:17.556620    3955 kubeadm.go:163] "https://control-plane.minikube.internal:50260" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I0814 17:43:17.556671    3955 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I0814 17:43:17.560590    3955 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/controller-manager.conf
	I0814 17:43:17.563650    3955 kubeadm.go:163] "https://control-plane.minikube.internal:50260" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I0814 17:43:17.563704    3955 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0814 17:43:17.567461    3955 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/scheduler.conf
	I0814 17:43:17.570532    3955 kubeadm.go:163] "https://control-plane.minikube.internal:50260" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I0814 17:43:17.570580    3955 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0814 17:43:17.573563    3955 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0814 17:43:17.576917    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
	I0814 17:43:17.603078    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
	I0814 17:43:18.192455    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
	I0814 17:43:18.321398    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
	I0814 17:43:18.344110    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
	I0814 17:43:18.369226    3955 api_server.go:52] waiting for apiserver process to appear ...
	I0814 17:43:18.369322    3955 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0814 17:43:18.869474    3955 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0814 17:43:19.371343    3955 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0814 17:43:19.376120    3955 api_server.go:72] duration metric: took 1.006948291s to wait for apiserver process to appear ...
	I0814 17:43:19.376134    3955 api_server.go:88] waiting for apiserver healthz status ...
	I0814 17:43:19.376153    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:24.377998    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:24.378032    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:29.378056    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:29.378091    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:34.378354    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:34.378395    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:39.378803    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:39.378887    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:44.379516    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:44.379587    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:49.380613    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:49.380688    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:54.383014    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:54.383077    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:43:59.385039    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:43:59.385170    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:04.387718    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:04.387786    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:09.388582    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:09.388662    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:14.391108    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:14.391161    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:19.393393    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:19.393656    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:44:19.412467    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:44:19.412566    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:44:19.425530    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:44:19.425612    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:44:19.436697    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:44:19.436774    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:44:19.447787    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:44:19.447865    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:44:19.458137    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:44:19.458206    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:44:19.468287    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:44:19.468358    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:44:19.478421    3955 logs.go:276] 0 containers: []
	W0814 17:44:19.478431    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:44:19.478487    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:44:19.489043    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:44:19.489063    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:44:19.489069    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:44:19.568979    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:44:19.568992    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:44:19.584197    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:44:19.584211    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:44:19.611275    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:44:19.611288    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:44:19.622958    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:44:19.622970    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:44:19.634915    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:44:19.634929    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:44:19.650394    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:44:19.650408    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:44:19.654576    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:44:19.654584    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:44:19.672003    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:44:19.672016    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:44:19.684553    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:44:19.684572    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:44:19.696088    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:44:19.696100    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:44:19.713934    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:44:19.713947    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:44:19.725385    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:44:19.725398    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:44:19.737466    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:44:19.737477    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:44:19.777249    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:44:19.777261    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:44:19.803974    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:44:19.803987    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:44:19.818046    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:44:19.818057    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:44:22.331322    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:27.333587    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:27.333680    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:44:27.345328    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:44:27.345402    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:44:27.356000    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:44:27.356081    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:44:27.366625    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:44:27.366690    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:44:27.377528    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:44:27.377599    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:44:27.387901    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:44:27.387966    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:44:27.398857    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:44:27.398922    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:44:27.409636    3955 logs.go:276] 0 containers: []
	W0814 17:44:27.409647    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:44:27.409709    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:44:27.420405    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:44:27.420421    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:44:27.420428    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:44:27.434709    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:44:27.434722    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:44:27.449791    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:44:27.449803    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:44:27.461017    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:44:27.461029    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:44:27.475678    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:44:27.475690    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:44:27.487384    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:44:27.487394    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:44:27.504573    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:44:27.504582    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:44:27.518482    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:44:27.518496    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:44:27.529970    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:44:27.529980    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:44:27.567613    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:44:27.567623    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:44:27.592308    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:44:27.592315    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:44:27.630234    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:44:27.630242    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:44:27.648706    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:44:27.648716    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:44:27.663228    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:44:27.663239    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:44:27.677287    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:44:27.677299    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:44:27.681497    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:44:27.681503    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:44:27.705931    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:44:27.705943    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:44:30.219740    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:35.221826    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:35.221910    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:44:35.233355    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:44:35.233436    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:44:35.244913    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:44:35.244981    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:44:35.256604    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:44:35.256681    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:44:35.269526    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:44:35.269600    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:44:35.281072    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:44:35.281146    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:44:35.293779    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:44:35.293879    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:44:35.304376    3955 logs.go:276] 0 containers: []
	W0814 17:44:35.304386    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:44:35.304452    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:44:35.315231    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:44:35.315252    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:44:35.315258    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:44:35.327477    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:44:35.327488    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:44:35.342804    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:44:35.342817    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:44:35.367638    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:44:35.367652    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:44:35.372146    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:44:35.372153    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:44:35.410326    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:44:35.410339    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:44:35.424235    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:44:35.424245    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:44:35.435661    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:44:35.435672    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:44:35.447406    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:44:35.447418    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:44:35.459931    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:44:35.459941    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:44:35.483735    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:44:35.483744    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:44:35.520316    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:44:35.520325    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:44:35.533276    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:44:35.533287    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:44:35.546944    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:44:35.546955    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:44:35.558655    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:44:35.558670    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:44:35.576080    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:44:35.576092    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:44:35.587222    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:44:35.587234    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:44:38.103645    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:43.105500    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:43.105651    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:44:43.116790    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:44:43.116860    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:44:43.128104    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:44:43.128175    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:44:43.145162    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:44:43.145232    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:44:43.156047    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:44:43.156114    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:44:43.167147    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:44:43.167205    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:44:43.178369    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:44:43.178429    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:44:43.189082    3955 logs.go:276] 0 containers: []
	W0814 17:44:43.189094    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:44:43.189155    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:44:43.200000    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:44:43.200019    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:44:43.200025    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:44:43.213126    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:44:43.213133    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:44:43.228985    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:44:43.229002    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:44:43.245389    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:44:43.245402    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:44:43.258307    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:44:43.258316    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:44:43.276588    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:44:43.276599    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:44:43.301507    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:44:43.301519    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:44:43.342066    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:44:43.342078    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:44:43.357616    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:44:43.357627    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:44:43.369529    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:44:43.369541    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:44:43.395056    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:44:43.395065    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:44:43.420124    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:44:43.420135    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:44:43.431928    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:44:43.431939    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:44:43.436086    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:44:43.436093    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:44:43.471600    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:44:43.471612    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:44:43.485875    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:44:43.485885    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:44:43.497213    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:44:43.497223    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:44:46.010780    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:51.013053    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:51.013133    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:44:51.024544    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:44:51.024617    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:44:51.036497    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:44:51.036568    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:44:51.051528    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:44:51.051602    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:44:51.062956    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:44:51.063030    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:44:51.073205    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:44:51.073273    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:44:51.083782    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:44:51.083852    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:44:51.096243    3955 logs.go:276] 0 containers: []
	W0814 17:44:51.096253    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:44:51.096317    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:44:51.107912    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:44:51.107928    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:44:51.107933    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:44:51.123753    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:44:51.123764    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:44:51.139099    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:44:51.139109    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:44:51.151260    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:44:51.151271    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:44:51.163809    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:44:51.163818    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:44:51.168419    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:44:51.168431    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:44:51.183300    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:44:51.183316    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:44:51.196547    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:44:51.196559    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:44:51.211733    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:44:51.211745    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:44:51.227096    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:44:51.227108    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:44:51.265341    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:44:51.265352    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:44:51.294483    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:44:51.294493    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:44:51.309171    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:44:51.309182    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:44:51.327418    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:44:51.327428    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:44:51.352351    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:44:51.352359    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:44:51.387023    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:44:51.387034    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:44:51.400810    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:44:51.400822    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:44:53.914850    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:44:58.916978    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:44:58.917059    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:44:58.930978    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:44:58.931054    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:44:58.945675    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:44:58.945750    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:44:58.957424    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:44:58.957491    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:44:58.968238    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:44:58.968311    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:44:58.978660    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:44:58.978725    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:44:58.990363    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:44:58.990438    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:44:59.001327    3955 logs.go:276] 0 containers: []
	W0814 17:44:59.001338    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:44:59.001398    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:44:59.013317    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:44:59.013335    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:44:59.013341    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:44:59.052052    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:44:59.052071    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:44:59.067433    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:44:59.067444    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:44:59.080091    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:44:59.080102    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:44:59.092048    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:44:59.092059    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:44:59.096895    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:44:59.096907    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:44:59.137205    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:44:59.137218    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:44:59.152043    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:44:59.152062    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:44:59.165926    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:44:59.165945    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:44:59.185317    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:44:59.185337    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:44:59.206744    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:44:59.206758    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:44:59.220690    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:44:59.220700    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:44:59.231623    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:44:59.231633    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:44:59.243483    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:44:59.243494    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:44:59.255182    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:44:59.255194    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:44:59.280105    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:44:59.280115    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:44:59.291666    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:44:59.291676    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:01.818910    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:06.821202    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:06.821354    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:06.832925    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:45:06.832996    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:06.844388    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:45:06.844458    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:06.855514    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:45:06.855601    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:06.867371    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:45:06.867445    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:06.879248    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:45:06.879323    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:06.890634    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:45:06.890708    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:06.905990    3955 logs.go:276] 0 containers: []
	W0814 17:45:06.906000    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:06.906061    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:06.916603    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:45:06.916620    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:45:06.916627    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:45:06.934920    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:06.934931    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:06.962389    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:06.962410    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:07.003333    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:07.003356    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:07.008066    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:45:07.008074    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:45:07.023285    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:45:07.023296    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:45:07.035432    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:45:07.035443    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:45:07.057307    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:45:07.057316    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:45:07.069842    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:45:07.069854    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:45:07.084495    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:45:07.084512    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:45:07.096704    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:45:07.096716    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:45:07.111892    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:45:07.111906    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:45:07.124596    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:45:07.124608    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:45:07.136761    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:45:07.136776    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:45:07.148819    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:45:07.148834    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:07.161652    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:07.161663    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:07.197968    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:45:07.197984    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:45:09.724819    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:14.726938    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:14.727023    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:14.738328    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:45:14.738406    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:14.752940    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:45:14.753008    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:14.764339    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:45:14.764404    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:14.775879    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:45:14.775954    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:14.787728    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:45:14.787805    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:14.799680    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:45:14.799755    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:14.811082    3955 logs.go:276] 0 containers: []
	W0814 17:45:14.811090    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:14.811152    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:14.822507    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:45:14.822524    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:14.822530    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:14.861774    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:45:14.861783    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:45:14.880657    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:45:14.880666    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:45:14.903509    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:45:14.903522    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:45:14.919120    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:45:14.919132    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:14.931510    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:14.931520    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:14.969837    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:45:14.969850    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:45:14.985191    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:45:14.985206    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:45:14.998107    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:45:14.998120    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:45:15.018839    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:45:15.018855    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:45:15.030924    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:15.030936    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:15.035538    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:45:15.035550    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:45:15.048929    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:45:15.048939    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:45:15.061688    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:45:15.061701    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:45:15.073439    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:15.073452    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:15.098722    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:45:15.098731    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:45:15.123845    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:45:15.123857    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:45:17.643061    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:22.643178    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:22.643226    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:22.656050    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:45:22.656102    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:22.672036    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:45:22.672111    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:22.685477    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:45:22.685542    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:22.698311    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:45:22.698383    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:22.713020    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:45:22.713086    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:22.725090    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:45:22.725164    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:22.735816    3955 logs.go:276] 0 containers: []
	W0814 17:45:22.735829    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:22.735888    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:22.748245    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:45:22.748265    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:22.748270    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:22.784091    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:45:22.784100    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:45:22.798120    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:45:22.798137    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:45:22.809860    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:22.809873    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:22.836061    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:22.836070    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:22.840726    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:45:22.840737    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:45:22.856092    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:45:22.856101    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:45:22.868326    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:45:22.868335    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:45:22.891038    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:45:22.891052    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:22.903505    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:45:22.903517    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:45:22.917828    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:45:22.917840    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:45:22.932836    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:45:22.932848    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:45:22.959144    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:45:22.959153    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:45:22.976719    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:45:22.976729    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:45:22.989254    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:45:22.989266    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:45:23.004866    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:45:23.004875    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:45:23.016716    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:23.016726    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:25.557761    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:30.559833    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:30.559896    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:30.571591    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:45:30.571663    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:30.584977    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:45:30.585054    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:30.597625    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:45:30.597696    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:30.609586    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:45:30.609661    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:30.620851    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:45:30.620920    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:30.632563    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:45:30.632637    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:30.643228    3955 logs.go:276] 0 containers: []
	W0814 17:45:30.643241    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:30.643306    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:30.656621    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:45:30.656640    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:30.656649    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:30.697355    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:30.697370    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:30.701968    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:45:30.701979    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:45:30.723430    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:45:30.723440    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:45:30.738321    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:45:30.738335    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:45:30.751519    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:45:30.751532    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:45:30.763495    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:30.763503    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:30.804676    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:45:30.804694    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:45:30.817611    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:45:30.817622    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:45:30.835669    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:45:30.835682    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:45:30.848658    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:30.848670    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:30.873323    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:45:30.873334    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:30.886521    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:45:30.886537    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:45:30.912618    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:45:30.912630    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:45:30.928985    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:45:30.928996    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:45:30.942923    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:45:30.942934    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:45:30.961306    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:45:30.961316    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:45:33.477321    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:38.479347    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:38.479438    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:38.494637    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:45:38.494716    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:38.509660    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:45:38.509735    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:38.521260    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:45:38.521298    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:38.538379    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:45:38.538454    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:38.549909    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:45:38.549982    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:38.561489    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:45:38.561560    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:38.572210    3955 logs.go:276] 0 containers: []
	W0814 17:45:38.572221    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:38.572282    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:38.585967    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:45:38.585985    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:38.585991    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:38.628131    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:45:38.628141    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:45:38.642961    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:45:38.642974    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:45:38.669591    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:45:38.669604    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:45:38.684325    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:45:38.684336    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:45:38.702586    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:45:38.702598    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:45:38.718296    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:45:38.718309    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:45:38.737365    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:45:38.737375    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:45:38.758112    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:45:38.758124    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:38.770769    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:38.770783    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:38.812343    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:45:38.812355    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:45:38.827598    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:45:38.827610    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:45:38.841110    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:38.841120    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:38.865635    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:38.865646    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:38.870985    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:45:38.870992    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:45:38.886735    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:45:38.886746    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:45:38.902389    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:45:38.902401    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:45:41.415502    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:46.417168    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:46.417536    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:46.447053    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:45:46.447144    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:46.468823    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:45:46.468898    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:46.481576    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:45:46.481634    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:46.492730    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:45:46.492803    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:46.504175    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:45:46.504247    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:46.515609    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:45:46.515682    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:46.526963    3955 logs.go:276] 0 containers: []
	W0814 17:45:46.526975    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:46.527029    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:46.538502    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:45:46.538522    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:45:46.538527    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:45:46.553648    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:45:46.553660    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:45:46.568448    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:45:46.568464    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:45:46.588586    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:45:46.588600    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:45:46.604590    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:46.604601    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:46.609275    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:45:46.609285    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:45:46.625711    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:45:46.625725    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:45:46.638165    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:45:46.638176    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:45:46.650259    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:45:46.650272    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:45:46.672074    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:45:46.672086    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:45:46.698576    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:45:46.698589    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:45:46.711856    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:45:46.711868    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:45:46.725029    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:46.725041    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:46.767984    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:45:46.767997    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:45:46.784674    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:46.784685    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:46.809961    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:45:46.809970    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:46.824599    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:46.824610    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:49.366561    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:45:54.369187    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:45:54.369655    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:45:54.414475    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:45:54.414587    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:45:54.435201    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:45:54.435297    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:45:54.449650    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:45:54.449733    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:45:54.462363    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:45:54.462435    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:45:54.474035    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:45:54.474104    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:45:54.485535    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:45:54.485607    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:45:54.496587    3955 logs.go:276] 0 containers: []
	W0814 17:45:54.496599    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:45:54.496656    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:45:54.512658    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:45:54.512677    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:45:54.512685    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:45:54.528285    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:45:54.528296    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:45:54.547467    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:45:54.547479    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:45:54.560483    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:45:54.560494    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:45:54.585046    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:45:54.585089    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:45:54.589838    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:45:54.589849    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:45:54.616706    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:45:54.616720    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:45:54.631946    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:45:54.631958    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:45:54.651475    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:45:54.651484    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:45:54.667608    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:45:54.667620    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:45:54.681369    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:45:54.681381    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:45:54.721963    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:45:54.721975    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:45:54.760284    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:45:54.760293    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:45:54.775573    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:45:54.775584    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:45:54.792478    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:45:54.792492    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:45:54.809356    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:45:54.809368    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:45:54.827413    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:45:54.827420    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:45:57.342500    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:02.343523    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:02.343678    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:02.371662    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:46:02.371723    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:02.393049    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:46:02.393122    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:02.407109    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:46:02.407184    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:02.419551    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:46:02.419630    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:02.431242    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:46:02.431317    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:02.443170    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:46:02.443240    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:02.454953    3955 logs.go:276] 0 containers: []
	W0814 17:46:02.454964    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:02.455026    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:02.466585    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:46:02.466603    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:46:02.466609    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:46:02.479866    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:46:02.479879    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:46:02.495027    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:46:02.495045    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:02.507807    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:46:02.507820    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:46:02.520104    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:46:02.520117    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:46:02.532755    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:02.532767    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:02.556691    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:02.556702    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:02.597420    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:46:02.597439    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:46:02.613048    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:46:02.613058    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:46:02.632912    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:46:02.632926    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:46:02.646755    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:46:02.646766    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:46:02.664688    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:02.664697    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:02.669003    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:46:02.669013    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:46:02.685504    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:46:02.685514    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:46:02.697646    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:02.697661    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:02.735630    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:46:02.735641    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:46:02.750283    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:46:02.750293    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:46:05.278307    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:10.280773    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:10.281015    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:10.306492    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:46:10.306569    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:10.324837    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:46:10.324926    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:10.338342    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:46:10.338420    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:10.350304    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:46:10.350384    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:10.362061    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:46:10.362135    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:10.373131    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:46:10.373203    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:10.383842    3955 logs.go:276] 0 containers: []
	W0814 17:46:10.383878    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:10.383950    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:10.397636    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:46:10.397650    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:46:10.397655    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:46:10.423823    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:46:10.423839    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:46:10.435332    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:46:10.435343    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:46:10.448004    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:46:10.448016    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:10.460884    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:46:10.460894    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:46:10.475496    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:46:10.475509    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:46:10.490812    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:46:10.490826    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:46:10.503381    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:10.503393    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:10.544106    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:10.544123    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:10.548794    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:10.548826    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:10.586283    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:46:10.586296    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:46:10.605396    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:46:10.605406    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:46:10.625446    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:46:10.625471    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:46:10.638131    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:10.638145    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:10.662795    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:46:10.662825    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:46:10.675171    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:46:10.675184    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:46:10.690907    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:46:10.690919    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:46:13.205552    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:18.206171    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:18.206335    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:18.220936    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:46:18.221007    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:18.231443    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:46:18.231509    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:18.242154    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:46:18.242222    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:18.252181    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:46:18.252246    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:18.262276    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:46:18.262344    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:18.273338    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:46:18.273411    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:18.284224    3955 logs.go:276] 0 containers: []
	W0814 17:46:18.284236    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:18.284289    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:18.295398    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:46:18.295420    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:18.295427    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:18.336266    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:46:18.336280    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:46:18.348520    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:46:18.348531    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:46:18.363461    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:46:18.363473    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:46:18.389364    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:46:18.389377    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:46:18.405099    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:46:18.405109    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:46:18.417828    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:46:18.417843    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:46:18.430785    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:46:18.430797    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:46:18.445732    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:46:18.445743    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:46:18.457175    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:18.457184    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:18.495239    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:46:18.495254    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:46:18.510783    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:46:18.510793    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:46:18.529646    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:46:18.529659    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:46:18.542746    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:18.542758    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:18.567016    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:18.567026    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:18.571575    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:46:18.571583    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:46:18.591284    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:46:18.591293    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:21.106064    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:26.108276    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:26.108413    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:26.121169    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:46:26.121256    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:26.132456    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:46:26.132539    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:26.143130    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:46:26.143195    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:26.154179    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:46:26.154256    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:26.164344    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:46:26.164418    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:26.174973    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:46:26.175041    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:26.190383    3955 logs.go:276] 0 containers: []
	W0814 17:46:26.190394    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:26.190454    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:26.201394    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:46:26.201413    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:26.201421    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:26.238933    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:46:26.238941    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:46:26.251870    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:46:26.251880    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:46:26.265527    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:46:26.265541    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:46:26.292822    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:46:26.292837    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:46:26.308700    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:46:26.308710    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:26.322247    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:26.322259    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:26.327254    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:46:26.327261    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:46:26.342244    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:46:26.342254    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:46:26.357547    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:46:26.357557    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:46:26.373015    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:46:26.373024    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:46:26.399953    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:46:26.399968    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:46:26.413134    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:46:26.413147    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:46:26.425810    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:26.425822    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:26.449724    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:26.449735    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:26.488792    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:46:26.488810    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:46:26.502052    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:46:26.502062    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:46:29.016077    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:34.018432    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:34.018786    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:34.049733    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:46:34.049869    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:34.068821    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:46:34.068920    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:34.082943    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:46:34.083021    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:34.101764    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:46:34.101842    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:34.113428    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:46:34.113496    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:34.124483    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:46:34.124552    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:34.136070    3955 logs.go:276] 0 containers: []
	W0814 17:46:34.136083    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:34.136146    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:34.152083    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:46:34.152100    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:34.152105    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:34.176525    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:34.176545    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:34.214507    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:46:34.214519    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:46:34.229628    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:46:34.229644    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:46:34.245021    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:46:34.245031    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:46:34.260273    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:46:34.260288    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:46:34.272978    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:46:34.272990    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:46:34.288346    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:34.288362    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:34.293067    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:46:34.293075    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:46:34.305635    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:46:34.305644    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:46:34.317811    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:34.317823    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:34.359313    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:46:34.359328    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:46:34.386745    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:46:34.386755    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:46:34.401233    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:46:34.401247    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:46:34.414052    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:46:34.414067    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:46:34.432203    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:46:34.432217    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:46:34.444785    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:46:34.444797    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:36.960103    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:41.962477    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:41.962901    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:42.000249    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:46:42.000381    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:42.025490    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:46:42.025565    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:42.042019    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:46:42.042093    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:42.053572    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:46:42.053633    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:42.064513    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:46:42.064572    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:42.075402    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:46:42.075476    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:42.086913    3955 logs.go:276] 0 containers: []
	W0814 17:46:42.086925    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:42.086981    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:42.101297    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:46:42.101312    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:46:42.101317    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:46:42.116728    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:46:42.116741    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:46:42.129718    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:46:42.129732    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:46:42.150588    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:42.150604    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:42.214206    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:46:42.214218    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:46:42.229072    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:46:42.229085    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:46:42.257823    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:46:42.257841    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:46:42.281972    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:46:42.281983    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:46:42.294722    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:46:42.294732    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:46:42.307041    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:42.307052    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:42.348360    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:46:42.348382    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:46:42.363616    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:46:42.363629    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:46:42.377663    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:46:42.377674    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:46:42.392948    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:46:42.392960    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:42.406180    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:42.406192    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:42.411078    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:46:42.411084    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:46:42.425264    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:42.425278    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:44.952028    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:49.954378    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:49.954767    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:49.985019    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:46:49.985153    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:50.005960    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:46:50.006055    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:50.020180    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:46:50.020255    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:50.034738    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:46:50.034816    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:50.048128    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:46:50.048196    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:50.060293    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:46:50.060362    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:50.071623    3955 logs.go:276] 0 containers: []
	W0814 17:46:50.071637    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:50.071698    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:50.083337    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:46:50.083355    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:46:50.083361    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:46:50.096796    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:46:50.096809    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:46:50.111525    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:46:50.111534    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:46:50.125338    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:46:50.125350    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:46:50.137354    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:46:50.137364    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:46:50.157282    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:46:50.157299    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:50.170357    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:50.170369    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:50.209621    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:46:50.209638    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:46:50.242844    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:46:50.242863    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:46:50.258146    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:46:50.258161    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:46:50.275426    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:46:50.275438    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:46:50.289013    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:46:50.289026    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:46:50.301259    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:50.301274    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:50.342895    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:50.342908    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:50.347778    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:50.347794    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:50.372011    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:46:50.372028    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:46:50.392722    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:46:50.392733    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:46:52.908301    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:46:57.910836    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:46:57.911294    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:46:57.951099    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:46:57.951242    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:46:57.973526    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:46:57.973657    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:46:57.993906    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:46:57.993983    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:46:58.008705    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:46:58.008744    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:46:58.020511    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:46:58.020587    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:46:58.034027    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:46:58.034081    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:46:58.046818    3955 logs.go:276] 0 containers: []
	W0814 17:46:58.046848    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:46:58.046907    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:46:58.059062    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:46:58.059079    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:46:58.059084    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:46:58.099283    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:46:58.099295    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:46:58.111704    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:46:58.111717    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:46:58.125375    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:46:58.125386    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:46:58.143688    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:46:58.143700    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:46:58.158458    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:46:58.158468    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:46:58.172002    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:46:58.172011    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:46:58.187186    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:46:58.187194    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:46:58.210716    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:46:58.210731    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:46:58.223585    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:46:58.223599    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:46:58.238811    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:46:58.238824    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:46:58.254734    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:46:58.254742    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:46:58.267607    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:46:58.267620    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:46:58.308123    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:46:58.308137    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:46:58.312545    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:46:58.312555    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:46:58.338549    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:46:58.338566    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:46:58.354539    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:46:58.354547    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:47:00.874453    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:05.875559    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:05.875997    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:47:05.917042    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:47:05.917186    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:47:05.938410    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:47:05.938505    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:47:05.953335    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:47:05.953414    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:47:05.966825    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:47:05.966905    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:47:05.979363    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:47:05.979428    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:47:05.990672    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:47:05.990742    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:47:06.002790    3955 logs.go:276] 0 containers: []
	W0814 17:47:06.002803    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:47:06.002867    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:47:06.015001    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:47:06.015036    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:47:06.015044    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:47:06.019622    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:47:06.019633    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:47:06.032212    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:47:06.032228    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:47:06.044987    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:47:06.045001    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:47:06.060760    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:47:06.060769    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:47:06.073263    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:47:06.073275    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:47:06.086077    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:47:06.086090    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:47:06.105661    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:47:06.105670    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:47:06.117940    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:47:06.117949    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:47:06.154667    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:47:06.154679    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:47:06.174797    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:47:06.174815    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:47:06.190202    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:47:06.190218    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:47:06.206464    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:47:06.206475    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:47:06.230306    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:47:06.230320    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:47:06.273692    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:47:06.273712    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:47:06.300141    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:47:06.300157    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:47:06.321474    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:47:06.321487    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:47:08.847520    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:13.849040    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:13.849281    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:47:13.872685    3955 logs.go:276] 2 containers: [731db5b39906 dc948f7a1a5b]
	I0814 17:47:13.872782    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:47:13.889011    3955 logs.go:276] 2 containers: [e1c66a83e273 b5246542fbb2]
	I0814 17:47:13.889088    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:47:13.901952    3955 logs.go:276] 1 containers: [3efebc52ee76]
	I0814 17:47:13.902034    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:47:13.914528    3955 logs.go:276] 2 containers: [a9d0232f564e 886c89769d4d]
	I0814 17:47:13.914627    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:47:13.925377    3955 logs.go:276] 1 containers: [18a1f7a7fcd8]
	I0814 17:47:13.925448    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:47:13.936521    3955 logs.go:276] 2 containers: [59f50938521a 4f7295da5208]
	I0814 17:47:13.936593    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:47:13.947461    3955 logs.go:276] 0 containers: []
	W0814 17:47:13.947473    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:47:13.947532    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:47:13.959873    3955 logs.go:276] 2 containers: [ef15cf10369c 5520c5d6143b]
	I0814 17:47:13.959889    3955 logs.go:123] Gathering logs for kube-scheduler [a9d0232f564e] ...
	I0814 17:47:13.959895    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9d0232f564e"
	I0814 17:47:13.972986    3955 logs.go:123] Gathering logs for kube-apiserver [731db5b39906] ...
	I0814 17:47:13.972998    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 731db5b39906"
	I0814 17:47:14.003052    3955 logs.go:123] Gathering logs for etcd [e1c66a83e273] ...
	I0814 17:47:14.003063    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e1c66a83e273"
	I0814 17:47:14.019203    3955 logs.go:123] Gathering logs for etcd [b5246542fbb2] ...
	I0814 17:47:14.019213    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5246542fbb2"
	I0814 17:47:14.034387    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:47:14.034402    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:47:14.057738    3955 logs.go:123] Gathering logs for coredns [3efebc52ee76] ...
	I0814 17:47:14.057757    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3efebc52ee76"
	I0814 17:47:14.073476    3955 logs.go:123] Gathering logs for kube-controller-manager [4f7295da5208] ...
	I0814 17:47:14.073488    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4f7295da5208"
	I0814 17:47:14.093336    3955 logs.go:123] Gathering logs for storage-provisioner [ef15cf10369c] ...
	I0814 17:47:14.093348    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef15cf10369c"
	I0814 17:47:14.105767    3955 logs.go:123] Gathering logs for kube-controller-manager [59f50938521a] ...
	I0814 17:47:14.105780    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 59f50938521a"
	I0814 17:47:14.125245    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:47:14.125254    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:47:14.137913    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:47:14.137925    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:47:14.175224    3955 logs.go:123] Gathering logs for kube-scheduler [886c89769d4d] ...
	I0814 17:47:14.175237    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 886c89769d4d"
	I0814 17:47:14.188363    3955 logs.go:123] Gathering logs for kube-proxy [18a1f7a7fcd8] ...
	I0814 17:47:14.188379    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 18a1f7a7fcd8"
	I0814 17:47:14.201418    3955 logs.go:123] Gathering logs for storage-provisioner [5520c5d6143b] ...
	I0814 17:47:14.201430    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5520c5d6143b"
	I0814 17:47:14.222275    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:47:14.222285    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:47:14.262865    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:47:14.262883    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:47:14.267459    3955 logs.go:123] Gathering logs for kube-apiserver [dc948f7a1a5b] ...
	I0814 17:47:14.267470    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc948f7a1a5b"
	I0814 17:47:16.795277    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:21.796915    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:21.796984    3955 kubeadm.go:597] duration metric: took 4m4.299766708s to restartPrimaryControlPlane
	W0814 17:47:21.797044    3955 out.go:239] ! Unable to restart control-plane node(s), will reset cluster: <no value>
	! Unable to restart control-plane node(s), will reset cluster: <no value>
	I0814 17:47:21.797076    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force"
	I0814 17:47:22.830868    3955 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force": (1.033809625s)
	I0814 17:47:22.830936    3955 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0814 17:47:22.835980    3955 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0814 17:47:22.838828    3955 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0814 17:47:22.841682    3955 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0814 17:47:22.841687    3955 kubeadm.go:157] found existing configuration files:
	
	I0814 17:47:22.841706    3955 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/admin.conf
	I0814 17:47:22.844665    3955 kubeadm.go:163] "https://control-plane.minikube.internal:50260" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I0814 17:47:22.844685    3955 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I0814 17:47:22.847438    3955 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/kubelet.conf
	I0814 17:47:22.850204    3955 kubeadm.go:163] "https://control-plane.minikube.internal:50260" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I0814 17:47:22.850225    3955 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I0814 17:47:22.853357    3955 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/controller-manager.conf
	I0814 17:47:22.856102    3955 kubeadm.go:163] "https://control-plane.minikube.internal:50260" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I0814 17:47:22.856127    3955 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0814 17:47:22.858560    3955 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/scheduler.conf
	I0814 17:47:22.861579    3955 kubeadm.go:163] "https://control-plane.minikube.internal:50260" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:50260 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I0814 17:47:22.861601    3955 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0814 17:47:22.864540    3955 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
	I0814 17:47:22.883113    3955 kubeadm.go:310] [init] Using Kubernetes version: v1.24.1
	I0814 17:47:22.883153    3955 kubeadm.go:310] [preflight] Running pre-flight checks
	I0814 17:47:22.932807    3955 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0814 17:47:22.932867    3955 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0814 17:47:22.932921    3955 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0814 17:47:22.981171    3955 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0814 17:47:22.985372    3955 out.go:204]   - Generating certificates and keys ...
	I0814 17:47:22.985410    3955 kubeadm.go:310] [certs] Using existing ca certificate authority
	I0814 17:47:22.985443    3955 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
	I0814 17:47:22.985485    3955 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
	I0814 17:47:22.985519    3955 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
	I0814 17:47:22.985555    3955 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
	I0814 17:47:22.985584    3955 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
	I0814 17:47:22.985615    3955 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
	I0814 17:47:22.985669    3955 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
	I0814 17:47:22.985712    3955 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
	I0814 17:47:22.985761    3955 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
	I0814 17:47:22.985785    3955 kubeadm.go:310] [certs] Using the existing "sa" key
	I0814 17:47:22.985814    3955 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0814 17:47:23.058371    3955 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0814 17:47:23.131171    3955 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0814 17:47:23.174294    3955 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0814 17:47:23.216077    3955 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0814 17:47:23.244512    3955 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0814 17:47:23.244922    3955 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0814 17:47:23.244942    3955 kubeadm.go:310] [kubelet-start] Starting the kubelet
	I0814 17:47:23.329700    3955 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0814 17:47:23.337673    3955 out.go:204]   - Booting up control plane ...
	I0814 17:47:23.337723    3955 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0814 17:47:23.337767    3955 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0814 17:47:23.337809    3955 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0814 17:47:23.337862    3955 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0814 17:47:23.338008    3955 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I0814 17:47:27.834270    3955 kubeadm.go:310] [apiclient] All control plane components are healthy after 4.501957 seconds
	I0814 17:47:27.834330    3955 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0814 17:47:27.837535    3955 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0814 17:47:28.348716    3955 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
	I0814 17:47:28.348873    3955 kubeadm.go:310] [mark-control-plane] Marking the node stopped-upgrade-504000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0814 17:47:28.852392    3955 kubeadm.go:310] [bootstrap-token] Using token: a7be3r.z8ykpssn5hbg2xb2
	I0814 17:47:28.858666    3955 out.go:204]   - Configuring RBAC rules ...
	I0814 17:47:28.858735    3955 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0814 17:47:28.858786    3955 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0814 17:47:28.865354    3955 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0814 17:47:28.866490    3955 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0814 17:47:28.867367    3955 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0814 17:47:28.868167    3955 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0814 17:47:28.871230    3955 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0814 17:47:29.024331    3955 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
	I0814 17:47:29.256161    3955 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
	I0814 17:47:29.256535    3955 kubeadm.go:310] 
	I0814 17:47:29.256566    3955 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
	I0814 17:47:29.256570    3955 kubeadm.go:310] 
	I0814 17:47:29.256606    3955 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
	I0814 17:47:29.256609    3955 kubeadm.go:310] 
	I0814 17:47:29.256622    3955 kubeadm.go:310]   mkdir -p $HOME/.kube
	I0814 17:47:29.256650    3955 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0814 17:47:29.256683    3955 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0814 17:47:29.256689    3955 kubeadm.go:310] 
	I0814 17:47:29.256719    3955 kubeadm.go:310] Alternatively, if you are the root user, you can run:
	I0814 17:47:29.256724    3955 kubeadm.go:310] 
	I0814 17:47:29.256748    3955 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0814 17:47:29.256752    3955 kubeadm.go:310] 
	I0814 17:47:29.256783    3955 kubeadm.go:310] You should now deploy a pod network to the cluster.
	I0814 17:47:29.256826    3955 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0814 17:47:29.256867    3955 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0814 17:47:29.256871    3955 kubeadm.go:310] 
	I0814 17:47:29.256914    3955 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
	I0814 17:47:29.256958    3955 kubeadm.go:310] and service account keys on each node and then running the following as root:
	I0814 17:47:29.256962    3955 kubeadm.go:310] 
	I0814 17:47:29.257005    3955 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token a7be3r.z8ykpssn5hbg2xb2 \
	I0814 17:47:29.257059    3955 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:957dccc044ee8898881693e1bb8f325b1f0a5c6f5463b6f7c0e6b1456e2d6ac2 \
	I0814 17:47:29.257070    3955 kubeadm.go:310] 	--control-plane 
	I0814 17:47:29.257073    3955 kubeadm.go:310] 
	I0814 17:47:29.257117    3955 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
	I0814 17:47:29.257120    3955 kubeadm.go:310] 
	I0814 17:47:29.257160    3955 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token a7be3r.z8ykpssn5hbg2xb2 \
	I0814 17:47:29.257217    3955 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:957dccc044ee8898881693e1bb8f325b1f0a5c6f5463b6f7c0e6b1456e2d6ac2 
	I0814 17:47:29.257383    3955 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0814 17:47:29.257447    3955 cni.go:84] Creating CNI manager for ""
	I0814 17:47:29.257459    3955 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:47:29.261668    3955 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
	I0814 17:47:29.268566    3955 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
	I0814 17:47:29.271503    3955 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)
	I0814 17:47:29.276262    3955 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0814 17:47:29.276301    3955 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0814 17:47:29.276321    3955 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes stopped-upgrade-504000 minikube.k8s.io/updated_at=2024_08_14T17_47_29_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=a560a51f794134545edbbeb49e1ab4a0b1355168 minikube.k8s.io/name=stopped-upgrade-504000 minikube.k8s.io/primary=true
	I0814 17:47:29.321596    3955 kubeadm.go:1113] duration metric: took 45.32725ms to wait for elevateKubeSystemPrivileges
	I0814 17:47:29.321615    3955 ops.go:34] apiserver oom_adj: -16
	I0814 17:47:29.321620    3955 kubeadm.go:394] duration metric: took 4m11.840430459s to StartCluster
	I0814 17:47:29.321630    3955 settings.go:142] acquiring lock: {Name:mkcf010cb030fc0976e1870794cf1a021579ed31 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:47:29.321719    3955 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:47:29.322093    3955 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/kubeconfig: {Name:mke777513f7f5736c6804680b89db76bd98a8ac2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:47:29.322275    3955 start.go:235] Will wait 6m0s for node &{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:47:29.322324    3955 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I0814 17:47:29.322364    3955 config.go:182] Loaded profile config "stopped-upgrade-504000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I0814 17:47:29.322370    3955 addons.go:69] Setting storage-provisioner=true in profile "stopped-upgrade-504000"
	I0814 17:47:29.322438    3955 addons.go:234] Setting addon storage-provisioner=true in "stopped-upgrade-504000"
	W0814 17:47:29.322446    3955 addons.go:243] addon storage-provisioner should already be in state true
	I0814 17:47:29.322460    3955 host.go:66] Checking if "stopped-upgrade-504000" exists ...
	I0814 17:47:29.322397    3955 addons.go:69] Setting default-storageclass=true in profile "stopped-upgrade-504000"
	I0814 17:47:29.322500    3955 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "stopped-upgrade-504000"
	I0814 17:47:29.326621    3955 out.go:177] * Verifying Kubernetes components...
	I0814 17:47:29.327299    3955 kapi.go:59] client config for stopped-upgrade-504000: &rest.Config{Host:"https://10.0.2.15:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/19443-949/.minikube/profiles/stopped-upgrade-504000/client.key", CAFile:"/Users/jenkins/minikube-integration/19443-949/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8
(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x105de4f90), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0814 17:47:29.330814    3955 addons.go:234] Setting addon default-storageclass=true in "stopped-upgrade-504000"
	W0814 17:47:29.330819    3955 addons.go:243] addon default-storageclass should already be in state true
	I0814 17:47:29.330828    3955 host.go:66] Checking if "stopped-upgrade-504000" exists ...
	I0814 17:47:29.331344    3955 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
	I0814 17:47:29.331349    3955 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0814 17:47:29.331354    3955 sshutil.go:53] new ssh client: &{IP:localhost Port:50228 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/stopped-upgrade-504000/id_rsa Username:docker}
	I0814 17:47:29.334525    3955 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0814 17:47:29.338615    3955 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0814 17:47:29.341618    3955 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0814 17:47:29.341624    3955 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0814 17:47:29.341630    3955 sshutil.go:53] new ssh client: &{IP:localhost Port:50228 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/stopped-upgrade-504000/id_rsa Username:docker}
	I0814 17:47:29.437690    3955 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0814 17:47:29.443142    3955 api_server.go:52] waiting for apiserver process to appear ...
	I0814 17:47:29.443184    3955 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0814 17:47:29.447844    3955 api_server.go:72] duration metric: took 125.560709ms to wait for apiserver process to appear ...
	I0814 17:47:29.447852    3955 api_server.go:88] waiting for apiserver healthz status ...
	I0814 17:47:29.447859    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:29.496998    3955 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0814 17:47:29.506246    3955 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0814 17:47:29.875764    3955 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
	I0814 17:47:29.875778    3955 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
	I0814 17:47:34.449838    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": dial tcp 10.0.2.15:8443: i/o timeout (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:34.449859    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:39.449996    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:39.450030    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:44.450258    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:44.450282    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:49.450521    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:49.450540    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:54.450914    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:54.450951    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:47:59.451507    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:47:59.451551    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	W0814 17:47:59.877259    3955 out.go:239] ! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error listing StorageClasses: Get "https://10.0.2.15:8443/apis/storage.k8s.io/v1/storageclasses": dial tcp 10.0.2.15:8443: i/o timeout]
	! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error listing StorageClasses: Get "https://10.0.2.15:8443/apis/storage.k8s.io/v1/storageclasses": dial tcp 10.0.2.15:8443: i/o timeout]
	I0814 17:47:59.881448    3955 out.go:177] * Enabled addons: storage-provisioner
	I0814 17:47:59.893390    3955 addons.go:510] duration metric: took 30.57191625s for enable addons: enabled=[storage-provisioner]
	I0814 17:48:04.452489    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:04.452518    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:09.453496    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:09.453531    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:14.454826    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:14.454879    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:19.456593    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:19.456635    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:24.458766    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:24.458816    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:29.459287    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:29.459463    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:48:29.470126    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:48:29.470212    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:48:29.480935    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:48:29.481004    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:48:29.491036    3955 logs.go:276] 2 containers: [bfe8ad4481d2 5580c1df3209]
	I0814 17:48:29.491100    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:48:29.501674    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:48:29.501735    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:48:29.511998    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:48:29.512065    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:48:29.522571    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:48:29.522642    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:48:29.533057    3955 logs.go:276] 0 containers: []
	W0814 17:48:29.533068    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:48:29.533125    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:48:29.543793    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:48:29.543810    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:48:29.543818    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:48:29.555735    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:48:29.555747    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:48:29.591760    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:48:29.591774    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:48:29.607021    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:48:29.607031    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:48:29.618618    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:48:29.618633    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:48:29.633772    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:48:29.633783    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:48:29.648863    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:48:29.648876    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:48:29.666328    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:48:29.666339    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:48:29.692421    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:48:29.692434    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:48:29.727690    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:48:29.727699    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:48:29.731983    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:48:29.731990    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:48:29.747197    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:48:29.747207    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:48:29.762294    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:48:29.762306    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:48:32.275402    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:37.277576    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:37.277722    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:48:37.292330    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:48:37.292412    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:48:37.303791    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:48:37.303863    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:48:37.314354    3955 logs.go:276] 2 containers: [bfe8ad4481d2 5580c1df3209]
	I0814 17:48:37.314421    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:48:37.325346    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:48:37.325411    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:48:37.335862    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:48:37.335930    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:48:37.346279    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:48:37.346350    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:48:37.356907    3955 logs.go:276] 0 containers: []
	W0814 17:48:37.356918    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:48:37.356980    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:48:37.368026    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:48:37.368042    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:48:37.368048    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:48:37.407710    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:48:37.407721    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:48:37.425419    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:48:37.425432    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:48:37.439553    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:48:37.439561    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:48:37.454717    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:48:37.454730    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:48:37.467718    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:48:37.467729    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:48:37.479541    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:48:37.479552    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:48:37.514421    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:48:37.514439    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:48:37.518806    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:48:37.518813    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:48:37.530281    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:48:37.530295    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:48:37.548017    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:48:37.548031    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:48:37.573514    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:48:37.573523    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:48:37.585482    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:48:37.585494    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:48:40.100572    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:45.102844    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:45.103051    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:48:45.127674    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:48:45.127755    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:48:45.143622    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:48:45.143694    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:48:45.158099    3955 logs.go:276] 2 containers: [bfe8ad4481d2 5580c1df3209]
	I0814 17:48:45.158165    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:48:45.168867    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:48:45.168925    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:48:45.179626    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:48:45.179701    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:48:45.190145    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:48:45.190214    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:48:45.200297    3955 logs.go:276] 0 containers: []
	W0814 17:48:45.200308    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:48:45.200368    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:48:45.210793    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:48:45.210808    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:48:45.210813    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:48:45.224753    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:48:45.224764    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:48:45.236635    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:48:45.236646    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:48:45.254503    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:48:45.254513    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:48:45.276867    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:48:45.276878    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:48:45.288607    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:48:45.288617    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:48:45.322725    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:48:45.322735    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:48:45.327362    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:48:45.327370    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:48:45.362561    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:48:45.362573    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:48:45.387495    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:48:45.387503    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:48:45.398415    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:48:45.398425    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:48:45.421412    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:48:45.421425    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:48:45.433109    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:48:45.433119    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:48:47.949884    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:48:52.950846    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:48:52.951195    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:48:52.983082    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:48:52.983205    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:48:53.002088    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:48:53.002167    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:48:53.016318    3955 logs.go:276] 2 containers: [bfe8ad4481d2 5580c1df3209]
	I0814 17:48:53.016394    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:48:53.029098    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:48:53.029172    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:48:53.039889    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:48:53.039966    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:48:53.055038    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:48:53.055104    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:48:53.065535    3955 logs.go:276] 0 containers: []
	W0814 17:48:53.065546    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:48:53.065608    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:48:53.076682    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:48:53.076696    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:48:53.076702    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:48:53.110664    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:48:53.110675    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:48:53.115114    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:48:53.115121    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:48:53.151317    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:48:53.151328    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:48:53.163390    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:48:53.163403    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:48:53.179069    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:48:53.179081    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:48:53.196427    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:48:53.196438    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:48:53.207844    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:48:53.207859    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:48:53.224656    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:48:53.224665    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:48:53.238787    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:48:53.238796    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:48:53.251346    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:48:53.251359    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:48:53.268411    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:48:53.268419    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:48:53.281719    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:48:53.281729    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:48:55.810383    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:00.812506    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:00.812654    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:00.826602    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:49:00.826681    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:00.838559    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:49:00.838627    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:00.849540    3955 logs.go:276] 2 containers: [bfe8ad4481d2 5580c1df3209]
	I0814 17:49:00.849610    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:00.860166    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:49:00.860239    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:00.873157    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:49:00.873229    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:00.883612    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:49:00.883682    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:00.895461    3955 logs.go:276] 0 containers: []
	W0814 17:49:00.895471    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:00.895528    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:00.906841    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:49:00.906856    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:00.906861    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:00.940300    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:49:00.940308    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:49:00.952494    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:49:00.952504    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:49:00.967454    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:49:00.967463    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:49:00.979251    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:49:00.979262    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:49:00.996495    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:49:00.996504    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:01.008068    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:01.008077    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:01.012399    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:01.012407    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:01.048848    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:49:01.048861    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:49:01.063900    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:49:01.063914    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:49:01.078000    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:49:01.078012    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:49:01.090907    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:49:01.090919    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:49:01.103607    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:01.103622    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:03.630614    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:08.632809    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:08.632992    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:08.655780    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:49:08.655890    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:08.671635    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:49:08.671706    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:08.684268    3955 logs.go:276] 2 containers: [bfe8ad4481d2 5580c1df3209]
	I0814 17:49:08.684335    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:08.695303    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:49:08.695369    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:08.708516    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:49:08.708580    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:08.720259    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:49:08.720326    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:08.733454    3955 logs.go:276] 0 containers: []
	W0814 17:49:08.733463    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:08.733512    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:08.744534    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:49:08.744551    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:49:08.744557    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:08.757266    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:08.757281    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:08.793684    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:49:08.793697    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:49:08.806433    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:49:08.806446    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:49:08.820005    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:49:08.820021    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:49:08.832595    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:49:08.832606    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:49:08.844458    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:49:08.844472    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:49:08.863463    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:08.863473    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:08.886441    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:08.886447    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:08.920616    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:08.920629    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:08.926070    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:49:08.926083    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:49:08.942274    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:49:08.942285    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:49:08.957713    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:49:08.957724    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:49:11.476673    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:16.478928    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:16.479074    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:16.491882    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:49:16.491953    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:16.503312    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:49:16.503379    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:16.514752    3955 logs.go:276] 2 containers: [bfe8ad4481d2 5580c1df3209]
	I0814 17:49:16.514825    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:16.526093    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:49:16.526165    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:16.537263    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:49:16.537333    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:16.548737    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:49:16.548813    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:16.559927    3955 logs.go:276] 0 containers: []
	W0814 17:49:16.559937    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:16.559998    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:16.570958    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:49:16.570974    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:49:16.570981    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:49:16.583366    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:16.583377    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:16.608124    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:49:16.608132    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:16.620692    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:16.620703    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:16.656399    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:16.656410    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:16.662214    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:49:16.662221    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:49:16.677025    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:49:16.677035    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:49:16.691817    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:49:16.691827    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:49:16.707879    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:16.707890    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:16.746316    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:49:16.746327    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:49:16.760742    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:49:16.760754    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:49:16.773997    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:49:16.774011    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:49:16.793587    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:49:16.793597    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:49:19.309061    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:24.311187    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:24.311471    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:24.336484    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:49:24.336588    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:24.353322    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:49:24.353403    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:24.372817    3955 logs.go:276] 2 containers: [bfe8ad4481d2 5580c1df3209]
	I0814 17:49:24.372887    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:24.383412    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:49:24.383479    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:24.394593    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:49:24.394659    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:24.406171    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:49:24.406237    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:24.417303    3955 logs.go:276] 0 containers: []
	W0814 17:49:24.417314    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:24.417370    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:24.428419    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:49:24.428437    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:49:24.428442    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:49:24.443925    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:49:24.443939    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:49:24.456246    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:49:24.456257    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:49:24.467986    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:24.467997    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:24.496781    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:49:24.496791    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:24.509522    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:49:24.509533    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:49:24.526295    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:49:24.526306    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:49:24.548490    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:24.548504    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:24.584136    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:24.584151    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:24.588843    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:24.588856    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:24.629871    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:49:24.629881    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:49:24.646440    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:49:24.646451    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:49:24.660023    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:49:24.660035    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:49:27.179189    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:32.181358    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:32.181505    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:32.194604    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:49:32.194684    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:32.205255    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:49:32.205327    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:32.216434    3955 logs.go:276] 2 containers: [bfe8ad4481d2 5580c1df3209]
	I0814 17:49:32.216501    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:32.227130    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:49:32.227193    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:32.237730    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:49:32.237796    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:32.248121    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:49:32.248197    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:32.258457    3955 logs.go:276] 0 containers: []
	W0814 17:49:32.258473    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:32.258529    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:32.274078    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:49:32.274093    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:49:32.274098    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:49:32.286445    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:49:32.286456    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:49:32.297964    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:49:32.297976    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:49:32.313342    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:49:32.313353    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:49:32.330685    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:32.330695    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:32.355786    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:32.355795    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:32.359977    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:32.359985    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:32.393575    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:49:32.393588    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:49:32.418457    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:49:32.418467    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:49:32.430150    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:49:32.430161    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:32.442834    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:32.442842    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:32.480478    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:49:32.480499    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:49:32.496433    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:49:32.496443    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:49:35.011504    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:40.013632    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:40.013765    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:40.029095    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:49:40.029167    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:40.040391    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:49:40.040464    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:40.050955    3955 logs.go:276] 2 containers: [bfe8ad4481d2 5580c1df3209]
	I0814 17:49:40.051023    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:40.061861    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:49:40.061923    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:40.072707    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:49:40.072779    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:40.082605    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:49:40.082668    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:40.093251    3955 logs.go:276] 0 containers: []
	W0814 17:49:40.093264    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:40.093322    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:40.103549    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:49:40.103564    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:49:40.103569    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:40.114879    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:40.114890    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:40.148339    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:49:40.148349    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:49:40.162762    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:49:40.162772    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:49:40.173990    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:49:40.174003    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:49:40.185117    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:49:40.185131    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:49:40.196364    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:40.196373    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:40.219811    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:40.219819    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:40.223744    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:40.223750    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:40.259023    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:49:40.259036    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:49:40.276822    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:49:40.276836    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:49:40.292606    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:49:40.292620    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:49:40.311392    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:49:40.311410    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:49:42.826682    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:47.828798    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:47.829075    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:47.862748    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:49:47.862867    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:47.878782    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:49:47.878877    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:47.891925    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:49:47.891997    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:47.903272    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:49:47.903342    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:47.915983    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:49:47.916051    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:47.926642    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:49:47.926716    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:47.937266    3955 logs.go:276] 0 containers: []
	W0814 17:49:47.937278    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:47.937336    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:47.947813    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:49:47.947833    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:47.947839    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:47.982981    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:49:47.982991    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:49:47.998470    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:49:47.998481    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:48.010235    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:49:48.010245    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:49:48.022009    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:49:48.022021    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:49:48.033405    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:49:48.033418    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:49:48.045383    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:49:48.045395    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:49:48.057361    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:49:48.057371    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:49:48.075344    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:49:48.075357    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:49:48.091481    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:48.091493    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:48.095991    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:49:48.096002    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:49:48.114980    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:48.114993    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:48.140638    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:48.140654    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:48.176593    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:49:48.176609    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:49:48.192983    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:49:48.192992    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:49:50.708132    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:49:55.710371    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:49:55.710512    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:49:55.724029    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:49:55.724112    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:49:55.735270    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:49:55.735346    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:49:55.746102    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:49:55.746174    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:49:55.757909    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:49:55.757980    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:49:55.768208    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:49:55.768279    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:49:55.778864    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:49:55.778931    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:49:55.789033    3955 logs.go:276] 0 containers: []
	W0814 17:49:55.789044    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:49:55.789102    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:49:55.799107    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:49:55.799124    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:49:55.799132    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:49:55.810288    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:49:55.810298    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:49:55.821797    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:49:55.821810    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:49:55.834319    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:49:55.834333    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:49:55.845763    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:49:55.845777    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:49:55.881095    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:49:55.881103    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:49:55.895178    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:49:55.895188    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:49:55.912501    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:49:55.912511    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:49:55.938360    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:49:55.938374    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:49:55.979830    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:49:55.979843    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:49:55.996659    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:49:55.996668    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:49:56.015127    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:49:56.015139    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:49:56.031258    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:49:56.031274    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:49:56.035765    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:49:56.035774    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:49:56.051028    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:49:56.051038    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:49:58.574287    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:03.576489    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:03.576690    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:03.590593    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:50:03.590675    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:03.602293    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:50:03.602366    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:03.620558    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:50:03.620628    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:03.631610    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:50:03.631676    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:03.642030    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:50:03.642092    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:03.652253    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:50:03.652318    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:03.662585    3955 logs.go:276] 0 containers: []
	W0814 17:50:03.662595    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:03.662647    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:03.672616    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:50:03.672632    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:03.672638    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:03.706475    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:03.706483    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:03.742536    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:50:03.742550    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:50:03.757507    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:50:03.757518    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:50:03.771198    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:50:03.771211    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:50:03.783816    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:50:03.783828    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:50:03.800912    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:50:03.800928    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:50:03.813959    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:03.813972    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:03.840751    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:03.840767    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:03.845957    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:50:03.845969    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:50:03.868824    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:50:03.868833    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:50:03.880841    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:50:03.880856    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:50:03.892739    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:50:03.892751    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:50:03.905370    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:50:03.905381    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:50:03.924032    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:50:03.924045    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:06.438688    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:11.440955    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:11.441203    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:11.466259    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:50:11.466374    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:11.482724    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:50:11.482798    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:11.497607    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:50:11.497698    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:11.508426    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:50:11.508496    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:11.518751    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:50:11.518814    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:11.529321    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:50:11.529386    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:11.539411    3955 logs.go:276] 0 containers: []
	W0814 17:50:11.539425    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:11.539478    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:11.550166    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:50:11.550184    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:11.550189    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:11.554809    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:50:11.554815    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:50:11.566332    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:50:11.566346    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:50:11.578475    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:50:11.578488    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:50:11.593943    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:50:11.593956    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:50:11.606016    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:50:11.606028    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:50:11.623991    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:11.624005    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:11.659778    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:50:11.659786    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:50:11.670946    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:50:11.670957    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:50:11.683058    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:11.683068    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:11.721547    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:50:11.721558    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:50:11.737019    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:50:11.737035    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:50:11.760701    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:50:11.760709    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:50:11.773928    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:11.773938    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:11.801000    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:50:11.801013    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:14.315969    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:19.318155    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:19.318353    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:19.334542    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:50:19.334624    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:19.355943    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:50:19.356014    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:19.366634    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:50:19.366709    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:19.377272    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:50:19.377343    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:19.388489    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:50:19.388556    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:19.399009    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:50:19.399076    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:19.409007    3955 logs.go:276] 0 containers: []
	W0814 17:50:19.409017    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:19.409074    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:19.419180    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:50:19.419198    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:50:19.419204    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:50:19.433420    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:50:19.433430    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:50:19.445120    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:50:19.445131    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:50:19.458981    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:50:19.458992    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:19.470640    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:19.470649    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:19.503889    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:19.503896    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:19.508221    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:50:19.508232    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:50:19.524631    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:50:19.524643    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:50:19.536807    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:50:19.536821    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:50:19.552109    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:50:19.552121    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:50:19.564167    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:50:19.564180    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:50:19.576617    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:19.576631    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:19.603501    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:19.603514    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:19.645294    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:50:19.645307    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:50:19.662387    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:50:19.662400    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:50:22.183629    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:27.185806    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:27.185993    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:27.203015    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:50:27.203106    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:27.217093    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:50:27.217173    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:27.228563    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:50:27.228639    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:27.243531    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:50:27.243602    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:27.254616    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:50:27.254692    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:27.267211    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:50:27.267281    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:27.278416    3955 logs.go:276] 0 containers: []
	W0814 17:50:27.278428    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:27.278488    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:27.289466    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:50:27.289485    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:27.289491    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:27.323399    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:50:27.323410    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:50:27.337449    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:50:27.337460    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:50:27.351487    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:50:27.351498    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:50:27.362749    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:27.362759    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:27.366910    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:50:27.366918    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:50:27.378634    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:50:27.378642    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:50:27.395231    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:27.395243    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:27.421606    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:27.421619    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:27.460703    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:50:27.460717    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:50:27.473686    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:50:27.473699    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:50:27.485947    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:50:27.485961    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:27.498553    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:50:27.498565    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:50:27.512498    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:50:27.512511    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:50:27.524695    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:50:27.524708    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:50:30.045411    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:35.047511    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:35.047813    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:35.073736    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:50:35.073857    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:35.091035    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:50:35.091123    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:35.104628    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:50:35.104708    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:35.116378    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:50:35.116442    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:35.129352    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:50:35.129427    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:35.140678    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:50:35.140750    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:35.150823    3955 logs.go:276] 0 containers: []
	W0814 17:50:35.150836    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:35.150895    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:35.161704    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:50:35.161721    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:50:35.161728    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:50:35.174851    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:50:35.174862    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:50:35.187491    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:50:35.187501    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:50:35.205701    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:50:35.205711    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:50:35.217471    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:50:35.217482    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:50:35.231249    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:50:35.231259    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:50:35.243939    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:50:35.243952    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:50:35.256936    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:50:35.256949    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:35.270289    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:35.270304    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:35.295886    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:35.295898    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:35.331912    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:35.331922    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:35.336677    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:35.336687    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:35.415735    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:50:35.415749    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:50:35.431533    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:50:35.431544    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:50:35.447111    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:50:35.447122    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:50:37.963506    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:42.965601    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:42.965760    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:42.978604    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:50:42.978678    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:42.989513    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:50:42.989587    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:43.000369    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:50:43.000445    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:43.011233    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:50:43.011301    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:43.024512    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:50:43.024579    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:43.035147    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:50:43.035220    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:43.045891    3955 logs.go:276] 0 containers: []
	W0814 17:50:43.045906    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:43.045967    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:43.057210    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:50:43.057228    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:50:43.057233    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:50:43.068634    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:50:43.068645    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:50:43.080415    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:43.080424    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:43.125410    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:50:43.125422    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:50:43.141407    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:50:43.141419    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:50:43.158315    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:50:43.158325    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:50:43.176636    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:50:43.176653    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:50:43.189091    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:50:43.189103    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:50:43.204224    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:50:43.204236    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:50:43.217402    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:50:43.217414    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:50:43.231824    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:50:43.231832    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:50:43.248131    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:50:43.248141    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:43.261643    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:43.261655    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:43.300869    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:43.300882    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:43.306341    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:43.306350    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:45.834560    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:50.836655    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:50.836920    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:50.855124    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:50:50.855208    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:50.868506    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:50:50.868582    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:50.880663    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:50:50.880732    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:50.891409    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:50:50.891473    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:50.901579    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:50:50.901637    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:50.911863    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:50:50.911930    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:50.922033    3955 logs.go:276] 0 containers: []
	W0814 17:50:50.922043    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:50.922093    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:50.933103    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:50:50.933122    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:50.933126    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:50.959260    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:50:50.959271    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:50:50.973744    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:50:50.973756    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:50:50.989914    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:50:50.989926    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:50:51.005380    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:51.005391    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:51.042668    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:50:51.042682    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:50:51.062547    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:50:51.062558    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:50:51.075156    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:50:51.075173    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:50:51.088631    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:51.088643    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:51.093216    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:51.093226    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:51.132672    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:50:51.132684    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:50:51.145557    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:50:51.145569    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:51.158374    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:50:51.158385    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:50:51.176996    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:50:51.177011    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:50:51.189698    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:50:51.189708    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:50:53.706677    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:50:58.708998    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:50:58.709374    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:50:58.742375    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:50:58.742509    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:50:58.763606    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:50:58.763719    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:50:58.777807    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:50:58.777898    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:50:58.795089    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:50:58.795162    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:50:58.807495    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:50:58.807558    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:50:58.818981    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:50:58.819046    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:50:58.830024    3955 logs.go:276] 0 containers: []
	W0814 17:50:58.830037    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:50:58.830099    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:50:58.842034    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:50:58.842055    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:50:58.842061    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:50:58.854824    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:50:58.854838    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:50:58.879944    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:50:58.879960    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:50:58.918065    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:50:58.918082    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:50:58.933384    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:50:58.933400    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:50:58.946010    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:50:58.946023    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:50:58.958494    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:50:58.958506    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:50:58.997299    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:50:58.997312    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:50:59.010397    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:50:59.010406    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:50:59.022951    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:50:59.022962    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:50:59.036920    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:50:59.036934    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:50:59.056247    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:50:59.056260    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:50:59.061496    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:50:59.061506    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:50:59.076882    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:50:59.076896    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:50:59.091629    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:50:59.091641    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:51:01.609283    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:51:06.611407    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:51:06.611515    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:51:06.623478    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:51:06.623546    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:51:06.637972    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:51:06.638036    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:51:06.648364    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:51:06.648433    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:51:06.658928    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:51:06.658988    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:51:06.675225    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:51:06.675288    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:51:06.691301    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:51:06.691369    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:51:06.702265    3955 logs.go:276] 0 containers: []
	W0814 17:51:06.702278    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:51:06.702332    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:51:06.713817    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:51:06.713835    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:51:06.713840    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:51:06.727486    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:51:06.727498    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:51:06.752132    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:51:06.752144    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:51:06.765174    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:51:06.765185    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:51:06.777892    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:51:06.777901    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:51:06.790995    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:51:06.791006    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:51:06.803547    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:51:06.803558    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:51:06.822167    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:51:06.822181    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:51:06.827148    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:51:06.827155    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:51:06.864496    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:51:06.864512    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:51:06.879965    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:51:06.879974    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:51:06.916083    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:51:06.916105    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:51:06.936141    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:51:06.936153    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:51:06.950972    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:51:06.950987    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:51:06.963116    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:51:06.963127    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:51:09.478412    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:51:14.480573    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:51:14.480689    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:51:14.491840    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:51:14.491919    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:51:14.502571    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:51:14.502643    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:51:14.513736    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:51:14.513813    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:51:14.525292    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:51:14.525369    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:51:14.537293    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:51:14.537374    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:51:14.548977    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:51:14.549050    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:51:14.562950    3955 logs.go:276] 0 containers: []
	W0814 17:51:14.562961    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:51:14.563022    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:51:14.574405    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:51:14.574421    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:51:14.574427    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:51:14.589043    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:51:14.589055    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:51:14.602432    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:51:14.602444    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:51:14.615006    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:51:14.615021    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:51:14.630469    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:51:14.630479    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:51:14.642797    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:51:14.642805    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:51:14.662095    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:51:14.662112    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:51:14.677913    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:51:14.677926    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:51:14.682471    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:51:14.682481    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:51:14.721319    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:51:14.721326    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:51:14.737718    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:51:14.737729    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:51:14.756651    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:51:14.756659    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:51:14.781775    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:51:14.781793    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:51:14.794701    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:51:14.794715    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:51:14.830436    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:51:14.830451    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:51:17.345768    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:51:22.348050    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:51:22.348336    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I0814 17:51:22.374125    3955 logs.go:276] 1 containers: [4fefcc502d63]
	I0814 17:51:22.374246    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I0814 17:51:22.390441    3955 logs.go:276] 1 containers: [a1d86cf0d403]
	I0814 17:51:22.390521    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I0814 17:51:22.403894    3955 logs.go:276] 4 containers: [d1c0db00cd33 eaa93e7b22e5 bfe8ad4481d2 5580c1df3209]
	I0814 17:51:22.403967    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I0814 17:51:22.416664    3955 logs.go:276] 1 containers: [ced0d8f62e4c]
	I0814 17:51:22.416735    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I0814 17:51:22.427467    3955 logs.go:276] 1 containers: [0c95116dbba9]
	I0814 17:51:22.427499    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I0814 17:51:22.445740    3955 logs.go:276] 1 containers: [c2012d96912e]
	I0814 17:51:22.445792    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I0814 17:51:22.456764    3955 logs.go:276] 0 containers: []
	W0814 17:51:22.456776    3955 logs.go:278] No container was found matching "kindnet"
	I0814 17:51:22.456842    3955 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I0814 17:51:22.468310    3955 logs.go:276] 1 containers: [556abe57a817]
	I0814 17:51:22.468331    3955 logs.go:123] Gathering logs for coredns [eaa93e7b22e5] ...
	I0814 17:51:22.468337    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 eaa93e7b22e5"
	I0814 17:51:22.481508    3955 logs.go:123] Gathering logs for coredns [5580c1df3209] ...
	I0814 17:51:22.481521    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5580c1df3209"
	I0814 17:51:22.493810    3955 logs.go:123] Gathering logs for kube-proxy [0c95116dbba9] ...
	I0814 17:51:22.493822    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c95116dbba9"
	I0814 17:51:22.506583    3955 logs.go:123] Gathering logs for storage-provisioner [556abe57a817] ...
	I0814 17:51:22.506600    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 556abe57a817"
	I0814 17:51:22.519197    3955 logs.go:123] Gathering logs for container status ...
	I0814 17:51:22.519213    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0814 17:51:22.531824    3955 logs.go:123] Gathering logs for coredns [d1c0db00cd33] ...
	I0814 17:51:22.531837    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d1c0db00cd33"
	I0814 17:51:22.544298    3955 logs.go:123] Gathering logs for coredns [bfe8ad4481d2] ...
	I0814 17:51:22.544310    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bfe8ad4481d2"
	I0814 17:51:22.557765    3955 logs.go:123] Gathering logs for Docker ...
	I0814 17:51:22.557777    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I0814 17:51:22.585386    3955 logs.go:123] Gathering logs for dmesg ...
	I0814 17:51:22.585413    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0814 17:51:22.590360    3955 logs.go:123] Gathering logs for describe nodes ...
	I0814 17:51:22.590368    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0814 17:51:22.630009    3955 logs.go:123] Gathering logs for kube-apiserver [4fefcc502d63] ...
	I0814 17:51:22.630022    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4fefcc502d63"
	I0814 17:51:22.648993    3955 logs.go:123] Gathering logs for etcd [a1d86cf0d403] ...
	I0814 17:51:22.649006    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1d86cf0d403"
	I0814 17:51:22.664318    3955 logs.go:123] Gathering logs for kube-scheduler [ced0d8f62e4c] ...
	I0814 17:51:22.664330    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ced0d8f62e4c"
	I0814 17:51:22.683476    3955 logs.go:123] Gathering logs for kube-controller-manager [c2012d96912e] ...
	I0814 17:51:22.683488    3955 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c2012d96912e"
	I0814 17:51:22.701838    3955 logs.go:123] Gathering logs for kubelet ...
	I0814 17:51:22.701855    3955 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0814 17:51:25.240028    3955 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I0814 17:51:30.242413    3955 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0814 17:51:30.247225    3955 out.go:177] 
	W0814 17:51:30.251192    3955 out.go:239] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: context deadline exceeded
	X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: context deadline exceeded
	W0814 17:51:30.251208    3955 out.go:239] * 
	* 
	W0814 17:51:30.252436    3955 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:51:30.263127    3955 out.go:177] 

                                                
                                                
** /stderr **
version_upgrade_test.go:200: upgrade from v1.26.0 to HEAD failed: out/minikube-darwin-arm64 start -p stopped-upgrade-504000 --memory=2200 --alsologtostderr -v=1 --driver=qemu2 : exit status 80
--- FAIL: TestStoppedBinaryUpgrade/Upgrade (591.08s)

                                                
                                    
x
+
TestPause/serial/Start (11.11s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-darwin-arm64 start -p pause-330000 --memory=2048 --install-addons=false --wait=all --driver=qemu2 
pause_test.go:80: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p pause-330000 --memory=2048 --install-addons=false --wait=all --driver=qemu2 : exit status 80 (11.041692833s)

                                                
                                                
-- stdout --
	* [pause-330000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "pause-330000" primary control-plane node in "pause-330000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "pause-330000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p pause-330000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
pause_test.go:82: failed to start minikube with args: "out/minikube-darwin-arm64 start -p pause-330000 --memory=2048 --install-addons=false --wait=all --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p pause-330000 -n pause-330000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p pause-330000 -n pause-330000: exit status 7 (65.391625ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "pause-330000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestPause/serial/Start (11.11s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (9.9s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-darwin-arm64 start -p NoKubernetes-707000 --driver=qemu2 
no_kubernetes_test.go:95: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p NoKubernetes-707000 --driver=qemu2 : exit status 80 (9.833341042s)

                                                
                                                
-- stdout --
	* [NoKubernetes-707000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "NoKubernetes-707000" primary control-plane node in "NoKubernetes-707000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "NoKubernetes-707000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p NoKubernetes-707000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
no_kubernetes_test.go:97: failed to start minikube with args: "out/minikube-darwin-arm64 start -p NoKubernetes-707000 --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p NoKubernetes-707000 -n NoKubernetes-707000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p NoKubernetes-707000 -n NoKubernetes-707000: exit status 7 (65.206958ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-707000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/StartWithK8s (9.90s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (5.29s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p NoKubernetes-707000 --no-kubernetes --driver=qemu2 
no_kubernetes_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p NoKubernetes-707000 --no-kubernetes --driver=qemu2 : exit status 80 (5.255320917s)

                                                
                                                
-- stdout --
	* [NoKubernetes-707000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting minikube without Kubernetes in cluster NoKubernetes-707000
	* Restarting existing qemu2 VM for "NoKubernetes-707000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "NoKubernetes-707000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p NoKubernetes-707000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
no_kubernetes_test.go:114: failed to start minikube with args: "out/minikube-darwin-arm64 start -p NoKubernetes-707000 --no-kubernetes --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p NoKubernetes-707000 -n NoKubernetes-707000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p NoKubernetes-707000 -n NoKubernetes-707000: exit status 7 (34.138083ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-707000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/StartWithStopK8s (5.29s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current (1.88s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current
driver_install_or_update_test.go:209: failed to run minikube. got: exit status 56
--- FAIL: TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current (1.88s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (5.31s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-darwin-arm64 start -p NoKubernetes-707000 --no-kubernetes --driver=qemu2 
* minikube v1.33.1 on darwin (arm64)
- MINIKUBE_LOCATION=19443
- KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-arm64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_FORCE_SYSTEMD=
- MINIKUBE_HOME=/var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.11.0-to-current2790678837/001
* Using the hyperkit driver based on user configuration

                                                
                                                
X Exiting due to DRV_UNSUPPORTED_OS: The driver 'hyperkit' is not supported on darwin/arm64

                                                
                                                
no_kubernetes_test.go:136: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p NoKubernetes-707000 --no-kubernetes --driver=qemu2 : exit status 80 (5.27743s)

                                                
                                                
-- stdout --
	* [NoKubernetes-707000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting minikube without Kubernetes in cluster NoKubernetes-707000
	* Restarting existing qemu2 VM for "NoKubernetes-707000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "NoKubernetes-707000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p NoKubernetes-707000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
no_kubernetes_test.go:138: failed to start minikube with args: "out/minikube-darwin-arm64 start -p NoKubernetes-707000 --no-kubernetes --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p NoKubernetes-707000 -n NoKubernetes-707000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p NoKubernetes-707000 -n NoKubernetes-707000: exit status 7 (31.849792ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-707000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/Start (5.31s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current (1.56s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current
* minikube v1.33.1 on darwin (arm64)
- MINIKUBE_LOCATION=19443
- KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-arm64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_FORCE_SYSTEMD=
- MINIKUBE_HOME=/var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.2.0-to-current1075477587/001
* Using the hyperkit driver based on user configuration

                                                
                                                
X Exiting due to DRV_UNSUPPORTED_OS: The driver 'hyperkit' is not supported on darwin/arm64

                                                
                                                
driver_install_or_update_test.go:209: failed to run minikube. got: exit status 56
--- FAIL: TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current (1.56s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (5.38s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-darwin-arm64 start -p NoKubernetes-707000 --driver=qemu2 
no_kubernetes_test.go:191: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p NoKubernetes-707000 --driver=qemu2 : exit status 80 (5.314311583s)

                                                
                                                
-- stdout --
	* [NoKubernetes-707000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting minikube without Kubernetes in cluster NoKubernetes-707000
	* Restarting existing qemu2 VM for "NoKubernetes-707000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "NoKubernetes-707000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p NoKubernetes-707000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
no_kubernetes_test.go:193: failed to start minikube with args: "out/minikube-darwin-arm64 start -p NoKubernetes-707000 --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p NoKubernetes-707000 -n NoKubernetes-707000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p NoKubernetes-707000 -n NoKubernetes-707000: exit status 7 (67.6645ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-707000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/StartNoArgs (5.38s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (9.86s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p auto-672000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=qemu2 
E0814 17:53:21.318760    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p auto-672000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=qemu2 : exit status 80 (9.8614895s)

                                                
                                                
-- stdout --
	* [auto-672000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "auto-672000" primary control-plane node in "auto-672000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "auto-672000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:53:13.285885    4471 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:53:13.285998    4471 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:53:13.286002    4471 out.go:304] Setting ErrFile to fd 2...
	I0814 17:53:13.286005    4471 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:53:13.286128    4471 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:53:13.287202    4471 out.go:298] Setting JSON to false
	I0814 17:53:13.303159    4471 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3156,"bootTime":1723680037,"procs":459,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:53:13.303227    4471 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:53:13.310402    4471 out.go:177] * [auto-672000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:53:13.318327    4471 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:53:13.318378    4471 notify.go:220] Checking for updates...
	I0814 17:53:13.323282    4471 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:53:13.326264    4471 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:53:13.329293    4471 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:53:13.332322    4471 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:53:13.335322    4471 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:53:13.338622    4471 config.go:182] Loaded profile config "cert-expiration-172000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:53:13.338691    4471 config.go:182] Loaded profile config "multinode-628000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:53:13.338746    4471 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:53:13.343319    4471 out.go:177] * Using the qemu2 driver based on user configuration
	I0814 17:53:13.350315    4471 start.go:297] selected driver: qemu2
	I0814 17:53:13.350322    4471 start.go:901] validating driver "qemu2" against <nil>
	I0814 17:53:13.350329    4471 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:53:13.352655    4471 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0814 17:53:13.356340    4471 out.go:177] * Automatically selected the socket_vmnet network
	I0814 17:53:13.359390    4471 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0814 17:53:13.359411    4471 cni.go:84] Creating CNI manager for ""
	I0814 17:53:13.359428    4471 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:53:13.359433    4471 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0814 17:53:13.359463    4471 start.go:340] cluster config:
	{Name:auto-672000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:auto-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:dock
er CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_clie
nt SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:53:13.362980    4471 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:53:13.369295    4471 out.go:177] * Starting "auto-672000" primary control-plane node in "auto-672000" cluster
	I0814 17:53:13.373319    4471 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:53:13.373337    4471 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:53:13.373353    4471 cache.go:56] Caching tarball of preloaded images
	I0814 17:53:13.373425    4471 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:53:13.373431    4471 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:53:13.373527    4471 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/auto-672000/config.json ...
	I0814 17:53:13.373538    4471 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/auto-672000/config.json: {Name:mk1a80dc03201160c4f86ccca7e3d9258a378164 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:53:13.373908    4471 start.go:360] acquireMachinesLock for auto-672000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:53:13.373941    4471 start.go:364] duration metric: took 27.25µs to acquireMachinesLock for "auto-672000"
	I0814 17:53:13.373952    4471 start.go:93] Provisioning new machine with config: &{Name:auto-672000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubern
etesVersion:v1.31.0 ClusterName:auto-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountP
ort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:53:13.373981    4471 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:53:13.381319    4471 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0814 17:53:13.398761    4471 start.go:159] libmachine.API.Create for "auto-672000" (driver="qemu2")
	I0814 17:53:13.398785    4471 client.go:168] LocalClient.Create starting
	I0814 17:53:13.398848    4471 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:53:13.398879    4471 main.go:141] libmachine: Decoding PEM data...
	I0814 17:53:13.398887    4471 main.go:141] libmachine: Parsing certificate...
	I0814 17:53:13.398924    4471 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:53:13.398946    4471 main.go:141] libmachine: Decoding PEM data...
	I0814 17:53:13.398960    4471 main.go:141] libmachine: Parsing certificate...
	I0814 17:53:13.399463    4471 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:53:13.552863    4471 main.go:141] libmachine: Creating SSH key...
	I0814 17:53:13.699233    4471 main.go:141] libmachine: Creating Disk image...
	I0814 17:53:13.699240    4471 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:53:13.699428    4471 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/auto-672000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/auto-672000/disk.qcow2
	I0814 17:53:13.709211    4471 main.go:141] libmachine: STDOUT: 
	I0814 17:53:13.709231    4471 main.go:141] libmachine: STDERR: 
	I0814 17:53:13.709292    4471 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/auto-672000/disk.qcow2 +20000M
	I0814 17:53:13.717161    4471 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:53:13.717176    4471 main.go:141] libmachine: STDERR: 
	I0814 17:53:13.717187    4471 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/auto-672000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/auto-672000/disk.qcow2
	I0814 17:53:13.717192    4471 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:53:13.717200    4471 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:53:13.717227    4471 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/auto-672000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/auto-672000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/auto-672000/qemu.pid -device virtio-net-pci,netdev=net0,mac=76:c7:6c:91:c3:be -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/auto-672000/disk.qcow2
	I0814 17:53:13.718824    4471 main.go:141] libmachine: STDOUT: 
	I0814 17:53:13.718841    4471 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:53:13.718857    4471 client.go:171] duration metric: took 320.0765ms to LocalClient.Create
	I0814 17:53:15.720966    4471 start.go:128] duration metric: took 2.347031041s to createHost
	I0814 17:53:15.721039    4471 start.go:83] releasing machines lock for "auto-672000", held for 2.347152042s
	W0814 17:53:15.721088    4471 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:53:15.733333    4471 out.go:177] * Deleting "auto-672000" in qemu2 ...
	W0814 17:53:15.767498    4471 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:53:15.767527    4471 start.go:729] Will try again in 5 seconds ...
	I0814 17:53:20.769579    4471 start.go:360] acquireMachinesLock for auto-672000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:53:20.770104    4471 start.go:364] duration metric: took 367.833µs to acquireMachinesLock for "auto-672000"
	I0814 17:53:20.770240    4471 start.go:93] Provisioning new machine with config: &{Name:auto-672000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubern
etesVersion:v1.31.0 ClusterName:auto-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountP
ort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:53:20.770533    4471 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:53:20.789345    4471 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0814 17:53:20.841154    4471 start.go:159] libmachine.API.Create for "auto-672000" (driver="qemu2")
	I0814 17:53:20.841205    4471 client.go:168] LocalClient.Create starting
	I0814 17:53:20.841323    4471 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:53:20.841375    4471 main.go:141] libmachine: Decoding PEM data...
	I0814 17:53:20.841418    4471 main.go:141] libmachine: Parsing certificate...
	I0814 17:53:20.841474    4471 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:53:20.841521    4471 main.go:141] libmachine: Decoding PEM data...
	I0814 17:53:20.841533    4471 main.go:141] libmachine: Parsing certificate...
	I0814 17:53:20.842201    4471 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:53:21.007975    4471 main.go:141] libmachine: Creating SSH key...
	I0814 17:53:21.053453    4471 main.go:141] libmachine: Creating Disk image...
	I0814 17:53:21.053458    4471 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:53:21.053647    4471 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/auto-672000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/auto-672000/disk.qcow2
	I0814 17:53:21.063167    4471 main.go:141] libmachine: STDOUT: 
	I0814 17:53:21.063186    4471 main.go:141] libmachine: STDERR: 
	I0814 17:53:21.063232    4471 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/auto-672000/disk.qcow2 +20000M
	I0814 17:53:21.071255    4471 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:53:21.071270    4471 main.go:141] libmachine: STDERR: 
	I0814 17:53:21.071283    4471 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/auto-672000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/auto-672000/disk.qcow2
	I0814 17:53:21.071287    4471 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:53:21.071293    4471 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:53:21.071335    4471 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/auto-672000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/auto-672000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/auto-672000/qemu.pid -device virtio-net-pci,netdev=net0,mac=f6:b7:cc:76:25:cc -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/auto-672000/disk.qcow2
	I0814 17:53:21.072995    4471 main.go:141] libmachine: STDOUT: 
	I0814 17:53:21.073026    4471 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:53:21.073040    4471 client.go:171] duration metric: took 231.835417ms to LocalClient.Create
	I0814 17:53:23.075186    4471 start.go:128] duration metric: took 2.304687s to createHost
	I0814 17:53:23.075282    4471 start.go:83] releasing machines lock for "auto-672000", held for 2.305206875s
	W0814 17:53:23.075570    4471 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p auto-672000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p auto-672000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:53:23.089199    4471 out.go:177] 
	W0814 17:53:23.093237    4471 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:53:23.093261    4471 out.go:239] * 
	* 
	W0814 17:53:23.095887    4471 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:53:23.105151    4471 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/auto/Start (9.86s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (9.9s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p calico-672000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=qemu2 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p calico-672000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=qemu2 : exit status 80 (9.895340791s)

                                                
                                                
-- stdout --
	* [calico-672000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "calico-672000" primary control-plane node in "calico-672000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "calico-672000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:53:25.259266    4581 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:53:25.259388    4581 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:53:25.259390    4581 out.go:304] Setting ErrFile to fd 2...
	I0814 17:53:25.259393    4581 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:53:25.259516    4581 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:53:25.260561    4581 out.go:298] Setting JSON to false
	I0814 17:53:25.276556    4581 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3168,"bootTime":1723680037,"procs":459,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:53:25.276687    4581 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:53:25.283513    4581 out.go:177] * [calico-672000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:53:25.291433    4581 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:53:25.291474    4581 notify.go:220] Checking for updates...
	I0814 17:53:25.298367    4581 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:53:25.301365    4581 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:53:25.305408    4581 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:53:25.308405    4581 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:53:25.311344    4581 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:53:25.314710    4581 config.go:182] Loaded profile config "cert-expiration-172000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:53:25.314775    4581 config.go:182] Loaded profile config "multinode-628000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:53:25.314827    4581 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:53:25.319389    4581 out.go:177] * Using the qemu2 driver based on user configuration
	I0814 17:53:25.326352    4581 start.go:297] selected driver: qemu2
	I0814 17:53:25.326360    4581 start.go:901] validating driver "qemu2" against <nil>
	I0814 17:53:25.326367    4581 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:53:25.328561    4581 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0814 17:53:25.331399    4581 out.go:177] * Automatically selected the socket_vmnet network
	I0814 17:53:25.334501    4581 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0814 17:53:25.334529    4581 cni.go:84] Creating CNI manager for "calico"
	I0814 17:53:25.334542    4581 start_flags.go:319] Found "Calico" CNI - setting NetworkPlugin=cni
	I0814 17:53:25.334578    4581 start.go:340] cluster config:
	{Name:calico-672000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:calico-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:
docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_
vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:53:25.338084    4581 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:53:25.346403    4581 out.go:177] * Starting "calico-672000" primary control-plane node in "calico-672000" cluster
	I0814 17:53:25.350425    4581 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:53:25.350443    4581 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:53:25.350462    4581 cache.go:56] Caching tarball of preloaded images
	I0814 17:53:25.350536    4581 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:53:25.350550    4581 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:53:25.350617    4581 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/calico-672000/config.json ...
	I0814 17:53:25.350634    4581 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/calico-672000/config.json: {Name:mk93429786cbae1ce6c346404ce159f037a6f54c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:53:25.351004    4581 start.go:360] acquireMachinesLock for calico-672000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:53:25.351037    4581 start.go:364] duration metric: took 27.083µs to acquireMachinesLock for "calico-672000"
	I0814 17:53:25.351049    4581 start.go:93] Provisioning new machine with config: &{Name:calico-672000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kube
rnetesVersion:v1.31.0 ClusterName:calico-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:53:25.351081    4581 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:53:25.358416    4581 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0814 17:53:25.375944    4581 start.go:159] libmachine.API.Create for "calico-672000" (driver="qemu2")
	I0814 17:53:25.375971    4581 client.go:168] LocalClient.Create starting
	I0814 17:53:25.376038    4581 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:53:25.376069    4581 main.go:141] libmachine: Decoding PEM data...
	I0814 17:53:25.376077    4581 main.go:141] libmachine: Parsing certificate...
	I0814 17:53:25.376116    4581 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:53:25.376139    4581 main.go:141] libmachine: Decoding PEM data...
	I0814 17:53:25.376147    4581 main.go:141] libmachine: Parsing certificate...
	I0814 17:53:25.376619    4581 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:53:25.527041    4581 main.go:141] libmachine: Creating SSH key...
	I0814 17:53:25.625208    4581 main.go:141] libmachine: Creating Disk image...
	I0814 17:53:25.625215    4581 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:53:25.625397    4581 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/calico-672000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/calico-672000/disk.qcow2
	I0814 17:53:25.634866    4581 main.go:141] libmachine: STDOUT: 
	I0814 17:53:25.634883    4581 main.go:141] libmachine: STDERR: 
	I0814 17:53:25.634928    4581 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/calico-672000/disk.qcow2 +20000M
	I0814 17:53:25.642817    4581 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:53:25.642838    4581 main.go:141] libmachine: STDERR: 
	I0814 17:53:25.642848    4581 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/calico-672000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/calico-672000/disk.qcow2
	I0814 17:53:25.642854    4581 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:53:25.642864    4581 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:53:25.642890    4581 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/calico-672000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/calico-672000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/calico-672000/qemu.pid -device virtio-net-pci,netdev=net0,mac=de:8d:23:14:05:b3 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/calico-672000/disk.qcow2
	I0814 17:53:25.644486    4581 main.go:141] libmachine: STDOUT: 
	I0814 17:53:25.644504    4581 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:53:25.644523    4581 client.go:171] duration metric: took 268.554333ms to LocalClient.Create
	I0814 17:53:27.646678    4581 start.go:128] duration metric: took 2.295640625s to createHost
	I0814 17:53:27.646744    4581 start.go:83] releasing machines lock for "calico-672000", held for 2.295758334s
	W0814 17:53:27.646829    4581 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:53:27.661301    4581 out.go:177] * Deleting "calico-672000" in qemu2 ...
	W0814 17:53:27.700817    4581 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:53:27.700847    4581 start.go:729] Will try again in 5 seconds ...
	I0814 17:53:32.702931    4581 start.go:360] acquireMachinesLock for calico-672000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:53:32.703485    4581 start.go:364] duration metric: took 364.125µs to acquireMachinesLock for "calico-672000"
	I0814 17:53:32.703616    4581 start.go:93] Provisioning new machine with config: &{Name:calico-672000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kube
rnetesVersion:v1.31.0 ClusterName:calico-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:53:32.703865    4581 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:53:32.722531    4581 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0814 17:53:32.775748    4581 start.go:159] libmachine.API.Create for "calico-672000" (driver="qemu2")
	I0814 17:53:32.775801    4581 client.go:168] LocalClient.Create starting
	I0814 17:53:32.775894    4581 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:53:32.775954    4581 main.go:141] libmachine: Decoding PEM data...
	I0814 17:53:32.775969    4581 main.go:141] libmachine: Parsing certificate...
	I0814 17:53:32.776023    4581 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:53:32.776066    4581 main.go:141] libmachine: Decoding PEM data...
	I0814 17:53:32.776080    4581 main.go:141] libmachine: Parsing certificate...
	I0814 17:53:32.776711    4581 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:53:32.940379    4581 main.go:141] libmachine: Creating SSH key...
	I0814 17:53:33.054481    4581 main.go:141] libmachine: Creating Disk image...
	I0814 17:53:33.054487    4581 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:53:33.054664    4581 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/calico-672000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/calico-672000/disk.qcow2
	I0814 17:53:33.063989    4581 main.go:141] libmachine: STDOUT: 
	I0814 17:53:33.064008    4581 main.go:141] libmachine: STDERR: 
	I0814 17:53:33.064054    4581 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/calico-672000/disk.qcow2 +20000M
	I0814 17:53:33.071887    4581 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:53:33.071903    4581 main.go:141] libmachine: STDERR: 
	I0814 17:53:33.071915    4581 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/calico-672000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/calico-672000/disk.qcow2
	I0814 17:53:33.071919    4581 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:53:33.071929    4581 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:53:33.071960    4581 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/calico-672000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/calico-672000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/calico-672000/qemu.pid -device virtio-net-pci,netdev=net0,mac=2a:4a:75:62:8e:9a -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/calico-672000/disk.qcow2
	I0814 17:53:33.073553    4581 main.go:141] libmachine: STDOUT: 
	I0814 17:53:33.073567    4581 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:53:33.073579    4581 client.go:171] duration metric: took 297.781958ms to LocalClient.Create
	I0814 17:53:35.075699    4581 start.go:128] duration metric: took 2.371862875s to createHost
	I0814 17:53:35.075758    4581 start.go:83] releasing machines lock for "calico-672000", held for 2.372312709s
	W0814 17:53:35.076153    4581 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p calico-672000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p calico-672000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:53:35.092733    4581 out.go:177] 
	W0814 17:53:35.095988    4581 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:53:35.096013    4581 out.go:239] * 
	* 
	W0814 17:53:35.098582    4581 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:53:35.111693    4581 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/calico/Start (9.90s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (9.89s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p custom-flannel-672000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=qemu2 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p custom-flannel-672000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=qemu2 : exit status 80 (9.884938334s)

                                                
                                                
-- stdout --
	* [custom-flannel-672000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "custom-flannel-672000" primary control-plane node in "custom-flannel-672000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "custom-flannel-672000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:53:37.477203    4698 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:53:37.477330    4698 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:53:37.477333    4698 out.go:304] Setting ErrFile to fd 2...
	I0814 17:53:37.477336    4698 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:53:37.477469    4698 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:53:37.478554    4698 out.go:298] Setting JSON to false
	I0814 17:53:37.494435    4698 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3180,"bootTime":1723680037,"procs":459,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:53:37.494505    4698 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:53:37.500303    4698 out.go:177] * [custom-flannel-672000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:53:37.508337    4698 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:53:37.508364    4698 notify.go:220] Checking for updates...
	I0814 17:53:37.517223    4698 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:53:37.520256    4698 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:53:37.524256    4698 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:53:37.527269    4698 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:53:37.530237    4698 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:53:37.533659    4698 config.go:182] Loaded profile config "cert-expiration-172000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:53:37.533731    4698 config.go:182] Loaded profile config "multinode-628000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:53:37.533778    4698 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:53:37.537161    4698 out.go:177] * Using the qemu2 driver based on user configuration
	I0814 17:53:37.544242    4698 start.go:297] selected driver: qemu2
	I0814 17:53:37.544248    4698 start.go:901] validating driver "qemu2" against <nil>
	I0814 17:53:37.544253    4698 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:53:37.546576    4698 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0814 17:53:37.549185    4698 out.go:177] * Automatically selected the socket_vmnet network
	I0814 17:53:37.552305    4698 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0814 17:53:37.552329    4698 cni.go:84] Creating CNI manager for "testdata/kube-flannel.yaml"
	I0814 17:53:37.552347    4698 start_flags.go:319] Found "testdata/kube-flannel.yaml" CNI - setting NetworkPlugin=cni
	I0814 17:53:37.552381    4698 start.go:340] cluster config:
	{Name:custom-flannel-672000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:custom-flannel-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/kube-flannel.yaml} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClie
ntPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:53:37.556053    4698 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:53:37.564231    4698 out.go:177] * Starting "custom-flannel-672000" primary control-plane node in "custom-flannel-672000" cluster
	I0814 17:53:37.568245    4698 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:53:37.568260    4698 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:53:37.568277    4698 cache.go:56] Caching tarball of preloaded images
	I0814 17:53:37.568340    4698 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:53:37.568346    4698 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:53:37.568412    4698 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/custom-flannel-672000/config.json ...
	I0814 17:53:37.568425    4698 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/custom-flannel-672000/config.json: {Name:mkdfeae009de7123dfc39413f08ec3ab36bb6255 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:53:37.568789    4698 start.go:360] acquireMachinesLock for custom-flannel-672000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:53:37.568825    4698 start.go:364] duration metric: took 29.333µs to acquireMachinesLock for "custom-flannel-672000"
	I0814 17:53:37.568837    4698 start.go:93] Provisioning new machine with config: &{Name:custom-flannel-672000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.31.0 ClusterName:custom-flannel-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/kube-flannel.yaml} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Mou
ntIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:53:37.568871    4698 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:53:37.576239    4698 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0814 17:53:37.594704    4698 start.go:159] libmachine.API.Create for "custom-flannel-672000" (driver="qemu2")
	I0814 17:53:37.594727    4698 client.go:168] LocalClient.Create starting
	I0814 17:53:37.594798    4698 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:53:37.594831    4698 main.go:141] libmachine: Decoding PEM data...
	I0814 17:53:37.594841    4698 main.go:141] libmachine: Parsing certificate...
	I0814 17:53:37.594887    4698 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:53:37.594912    4698 main.go:141] libmachine: Decoding PEM data...
	I0814 17:53:37.594920    4698 main.go:141] libmachine: Parsing certificate...
	I0814 17:53:37.595339    4698 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:53:37.768168    4698 main.go:141] libmachine: Creating SSH key...
	I0814 17:53:37.911691    4698 main.go:141] libmachine: Creating Disk image...
	I0814 17:53:37.911697    4698 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:53:37.911896    4698 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/custom-flannel-672000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/custom-flannel-672000/disk.qcow2
	I0814 17:53:37.921339    4698 main.go:141] libmachine: STDOUT: 
	I0814 17:53:37.921360    4698 main.go:141] libmachine: STDERR: 
	I0814 17:53:37.921421    4698 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/custom-flannel-672000/disk.qcow2 +20000M
	I0814 17:53:37.929425    4698 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:53:37.929442    4698 main.go:141] libmachine: STDERR: 
	I0814 17:53:37.929459    4698 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/custom-flannel-672000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/custom-flannel-672000/disk.qcow2
	I0814 17:53:37.929463    4698 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:53:37.929477    4698 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:53:37.929507    4698 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/custom-flannel-672000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/custom-flannel-672000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/custom-flannel-672000/qemu.pid -device virtio-net-pci,netdev=net0,mac=4e:b0:b8:f1:92:ee -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/custom-flannel-672000/disk.qcow2
	I0814 17:53:37.931173    4698 main.go:141] libmachine: STDOUT: 
	I0814 17:53:37.931190    4698 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:53:37.931208    4698 client.go:171] duration metric: took 336.484292ms to LocalClient.Create
	I0814 17:53:39.933328    4698 start.go:128] duration metric: took 2.364497917s to createHost
	I0814 17:53:39.933389    4698 start.go:83] releasing machines lock for "custom-flannel-672000", held for 2.364615875s
	W0814 17:53:39.933484    4698 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:53:39.947501    4698 out.go:177] * Deleting "custom-flannel-672000" in qemu2 ...
	W0814 17:53:39.978130    4698 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:53:39.978211    4698 start.go:729] Will try again in 5 seconds ...
	I0814 17:53:44.980320    4698 start.go:360] acquireMachinesLock for custom-flannel-672000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:53:44.980840    4698 start.go:364] duration metric: took 420.875µs to acquireMachinesLock for "custom-flannel-672000"
	I0814 17:53:44.981019    4698 start.go:93] Provisioning new machine with config: &{Name:custom-flannel-672000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.31.0 ClusterName:custom-flannel-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/kube-flannel.yaml} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Mou
ntIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:53:44.981396    4698 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:53:44.987207    4698 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0814 17:53:45.037615    4698 start.go:159] libmachine.API.Create for "custom-flannel-672000" (driver="qemu2")
	I0814 17:53:45.037662    4698 client.go:168] LocalClient.Create starting
	I0814 17:53:45.037773    4698 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:53:45.037832    4698 main.go:141] libmachine: Decoding PEM data...
	I0814 17:53:45.037848    4698 main.go:141] libmachine: Parsing certificate...
	I0814 17:53:45.037918    4698 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:53:45.037962    4698 main.go:141] libmachine: Decoding PEM data...
	I0814 17:53:45.037972    4698 main.go:141] libmachine: Parsing certificate...
	I0814 17:53:45.038487    4698 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:53:45.198782    4698 main.go:141] libmachine: Creating SSH key...
	I0814 17:53:45.269060    4698 main.go:141] libmachine: Creating Disk image...
	I0814 17:53:45.269067    4698 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:53:45.269253    4698 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/custom-flannel-672000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/custom-flannel-672000/disk.qcow2
	I0814 17:53:45.278693    4698 main.go:141] libmachine: STDOUT: 
	I0814 17:53:45.278716    4698 main.go:141] libmachine: STDERR: 
	I0814 17:53:45.278763    4698 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/custom-flannel-672000/disk.qcow2 +20000M
	I0814 17:53:45.286585    4698 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:53:45.286599    4698 main.go:141] libmachine: STDERR: 
	I0814 17:53:45.286612    4698 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/custom-flannel-672000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/custom-flannel-672000/disk.qcow2
	I0814 17:53:45.286616    4698 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:53:45.286626    4698 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:53:45.286651    4698 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/custom-flannel-672000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/custom-flannel-672000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/custom-flannel-672000/qemu.pid -device virtio-net-pci,netdev=net0,mac=4a:8a:96:b7:fb:9f -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/custom-flannel-672000/disk.qcow2
	I0814 17:53:45.288263    4698 main.go:141] libmachine: STDOUT: 
	I0814 17:53:45.288276    4698 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:53:45.288288    4698 client.go:171] duration metric: took 250.626208ms to LocalClient.Create
	I0814 17:53:47.290396    4698 start.go:128] duration metric: took 2.309026s to createHost
	I0814 17:53:47.290462    4698 start.go:83] releasing machines lock for "custom-flannel-672000", held for 2.309657292s
	W0814 17:53:47.290860    4698 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p custom-flannel-672000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p custom-flannel-672000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:53:47.305447    4698 out.go:177] 
	W0814 17:53:47.309637    4698 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:53:47.309687    4698 out.go:239] * 
	* 
	W0814 17:53:47.312546    4698 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:53:47.319492    4698 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/custom-flannel/Start (9.89s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/Start (9.98s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p false-672000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=qemu2 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p false-672000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=qemu2 : exit status 80 (9.977440334s)

                                                
                                                
-- stdout --
	* [false-672000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "false-672000" primary control-plane node in "false-672000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "false-672000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:53:49.714392    4820 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:53:49.714548    4820 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:53:49.714552    4820 out.go:304] Setting ErrFile to fd 2...
	I0814 17:53:49.714554    4820 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:53:49.714695    4820 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:53:49.715782    4820 out.go:298] Setting JSON to false
	I0814 17:53:49.731931    4820 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3192,"bootTime":1723680037,"procs":460,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:53:49.732008    4820 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:53:49.738100    4820 out.go:177] * [false-672000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:53:49.746047    4820 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:53:49.746102    4820 notify.go:220] Checking for updates...
	I0814 17:53:49.755084    4820 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:53:49.758087    4820 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:53:49.762095    4820 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:53:49.765086    4820 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:53:49.768094    4820 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:53:49.771459    4820 config.go:182] Loaded profile config "cert-expiration-172000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:53:49.771530    4820 config.go:182] Loaded profile config "multinode-628000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:53:49.771578    4820 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:53:49.775055    4820 out.go:177] * Using the qemu2 driver based on user configuration
	I0814 17:53:49.782116    4820 start.go:297] selected driver: qemu2
	I0814 17:53:49.782122    4820 start.go:901] validating driver "qemu2" against <nil>
	I0814 17:53:49.782130    4820 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:53:49.784579    4820 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0814 17:53:49.788108    4820 out.go:177] * Automatically selected the socket_vmnet network
	I0814 17:53:49.792102    4820 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0814 17:53:49.792144    4820 cni.go:84] Creating CNI manager for "false"
	I0814 17:53:49.792169    4820 start.go:340] cluster config:
	{Name:false-672000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:false-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:do
cker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_
client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:53:49.796114    4820 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:53:49.805034    4820 out.go:177] * Starting "false-672000" primary control-plane node in "false-672000" cluster
	I0814 17:53:49.809063    4820 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:53:49.809079    4820 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:53:49.809093    4820 cache.go:56] Caching tarball of preloaded images
	I0814 17:53:49.809165    4820 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:53:49.809171    4820 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:53:49.809239    4820 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/false-672000/config.json ...
	I0814 17:53:49.809252    4820 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/false-672000/config.json: {Name:mkf6aa801ef94203a4821edb22d679ad8004fb4b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:53:49.809642    4820 start.go:360] acquireMachinesLock for false-672000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:53:49.809677    4820 start.go:364] duration metric: took 29.417µs to acquireMachinesLock for "false-672000"
	I0814 17:53:49.809690    4820 start.go:93] Provisioning new machine with config: &{Name:false-672000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.31.0 ClusterName:false-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:53:49.809725    4820 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:53:49.817077    4820 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0814 17:53:49.835775    4820 start.go:159] libmachine.API.Create for "false-672000" (driver="qemu2")
	I0814 17:53:49.835803    4820 client.go:168] LocalClient.Create starting
	I0814 17:53:49.835874    4820 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:53:49.835904    4820 main.go:141] libmachine: Decoding PEM data...
	I0814 17:53:49.835915    4820 main.go:141] libmachine: Parsing certificate...
	I0814 17:53:49.835951    4820 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:53:49.835976    4820 main.go:141] libmachine: Decoding PEM data...
	I0814 17:53:49.835984    4820 main.go:141] libmachine: Parsing certificate...
	I0814 17:53:49.836414    4820 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:53:49.986409    4820 main.go:141] libmachine: Creating SSH key...
	I0814 17:53:50.201654    4820 main.go:141] libmachine: Creating Disk image...
	I0814 17:53:50.201666    4820 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:53:50.201911    4820 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/false-672000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/false-672000/disk.qcow2
	I0814 17:53:50.212011    4820 main.go:141] libmachine: STDOUT: 
	I0814 17:53:50.212031    4820 main.go:141] libmachine: STDERR: 
	I0814 17:53:50.212085    4820 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/false-672000/disk.qcow2 +20000M
	I0814 17:53:50.220028    4820 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:53:50.220043    4820 main.go:141] libmachine: STDERR: 
	I0814 17:53:50.220058    4820 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/false-672000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/false-672000/disk.qcow2
	I0814 17:53:50.220063    4820 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:53:50.220076    4820 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:53:50.220107    4820 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/false-672000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/false-672000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/false-672000/qemu.pid -device virtio-net-pci,netdev=net0,mac=76:1b:27:5e:8d:3f -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/false-672000/disk.qcow2
	I0814 17:53:50.221754    4820 main.go:141] libmachine: STDOUT: 
	I0814 17:53:50.221768    4820 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:53:50.221788    4820 client.go:171] duration metric: took 385.991083ms to LocalClient.Create
	I0814 17:53:52.223908    4820 start.go:128] duration metric: took 2.414225875s to createHost
	I0814 17:53:52.223953    4820 start.go:83] releasing machines lock for "false-672000", held for 2.414331166s
	W0814 17:53:52.224019    4820 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:53:52.239309    4820 out.go:177] * Deleting "false-672000" in qemu2 ...
	W0814 17:53:52.268245    4820 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:53:52.268266    4820 start.go:729] Will try again in 5 seconds ...
	I0814 17:53:57.270309    4820 start.go:360] acquireMachinesLock for false-672000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:53:57.270806    4820 start.go:364] duration metric: took 408.167µs to acquireMachinesLock for "false-672000"
	I0814 17:53:57.270947    4820 start.go:93] Provisioning new machine with config: &{Name:false-672000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.31.0 ClusterName:false-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:53:57.271246    4820 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:53:57.282766    4820 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0814 17:53:57.332384    4820 start.go:159] libmachine.API.Create for "false-672000" (driver="qemu2")
	I0814 17:53:57.332426    4820 client.go:168] LocalClient.Create starting
	I0814 17:53:57.332546    4820 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:53:57.332613    4820 main.go:141] libmachine: Decoding PEM data...
	I0814 17:53:57.332628    4820 main.go:141] libmachine: Parsing certificate...
	I0814 17:53:57.332690    4820 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:53:57.332738    4820 main.go:141] libmachine: Decoding PEM data...
	I0814 17:53:57.332757    4820 main.go:141] libmachine: Parsing certificate...
	I0814 17:53:57.333257    4820 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:53:57.493023    4820 main.go:141] libmachine: Creating SSH key...
	I0814 17:53:57.598890    4820 main.go:141] libmachine: Creating Disk image...
	I0814 17:53:57.598896    4820 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:53:57.599089    4820 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/false-672000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/false-672000/disk.qcow2
	I0814 17:53:57.608417    4820 main.go:141] libmachine: STDOUT: 
	I0814 17:53:57.608435    4820 main.go:141] libmachine: STDERR: 
	I0814 17:53:57.608486    4820 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/false-672000/disk.qcow2 +20000M
	I0814 17:53:57.616374    4820 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:53:57.616389    4820 main.go:141] libmachine: STDERR: 
	I0814 17:53:57.616401    4820 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/false-672000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/false-672000/disk.qcow2
	I0814 17:53:57.616405    4820 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:53:57.616417    4820 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:53:57.616453    4820 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/false-672000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/false-672000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/false-672000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ee:5e:f2:5b:3f:21 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/false-672000/disk.qcow2
	I0814 17:53:57.618124    4820 main.go:141] libmachine: STDOUT: 
	I0814 17:53:57.618140    4820 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:53:57.618154    4820 client.go:171] duration metric: took 285.729167ms to LocalClient.Create
	I0814 17:53:59.620276    4820 start.go:128] duration metric: took 2.349066959s to createHost
	I0814 17:53:59.620327    4820 start.go:83] releasing machines lock for "false-672000", held for 2.349533708s
	W0814 17:53:59.620772    4820 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p false-672000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p false-672000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:53:59.630378    4820 out.go:177] 
	W0814 17:53:59.637463    4820 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:53:59.637493    4820 out.go:239] * 
	* 
	W0814 17:53:59.640188    4820 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:53:59.648340    4820 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/false/Start (9.98s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (9.83s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p kindnet-672000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=qemu2 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p kindnet-672000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=qemu2 : exit status 80 (9.827796458s)

                                                
                                                
-- stdout --
	* [kindnet-672000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "kindnet-672000" primary control-plane node in "kindnet-672000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "kindnet-672000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:54:01.854766    4929 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:54:01.854890    4929 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:54:01.854893    4929 out.go:304] Setting ErrFile to fd 2...
	I0814 17:54:01.854896    4929 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:54:01.855030    4929 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:54:01.856165    4929 out.go:298] Setting JSON to false
	I0814 17:54:01.872051    4929 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3204,"bootTime":1723680037,"procs":457,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:54:01.872122    4929 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:54:01.878033    4929 out.go:177] * [kindnet-672000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:54:01.884968    4929 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:54:01.885032    4929 notify.go:220] Checking for updates...
	I0814 17:54:01.892989    4929 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:54:01.895978    4929 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:54:01.898950    4929 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:54:01.901986    4929 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:54:01.904984    4929 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:54:01.908280    4929 config.go:182] Loaded profile config "cert-expiration-172000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:54:01.908354    4929 config.go:182] Loaded profile config "multinode-628000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:54:01.908404    4929 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:54:01.912916    4929 out.go:177] * Using the qemu2 driver based on user configuration
	I0814 17:54:01.920028    4929 start.go:297] selected driver: qemu2
	I0814 17:54:01.920034    4929 start.go:901] validating driver "qemu2" against <nil>
	I0814 17:54:01.920050    4929 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:54:01.922315    4929 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0814 17:54:01.924997    4929 out.go:177] * Automatically selected the socket_vmnet network
	I0814 17:54:01.929045    4929 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0814 17:54:01.929078    4929 cni.go:84] Creating CNI manager for "kindnet"
	I0814 17:54:01.929083    4929 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0814 17:54:01.929121    4929 start.go:340] cluster config:
	{Name:kindnet-672000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:kindnet-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntim
e:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/sock
et_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:54:01.932782    4929 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:54:01.939998    4929 out.go:177] * Starting "kindnet-672000" primary control-plane node in "kindnet-672000" cluster
	I0814 17:54:01.943955    4929 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:54:01.943974    4929 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:54:01.943987    4929 cache.go:56] Caching tarball of preloaded images
	I0814 17:54:01.944056    4929 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:54:01.944062    4929 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:54:01.944155    4929 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/kindnet-672000/config.json ...
	I0814 17:54:01.944168    4929 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/kindnet-672000/config.json: {Name:mk14f2d7324952c90a89ac6bb32a3ed5862ef8f9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:54:01.944559    4929 start.go:360] acquireMachinesLock for kindnet-672000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:54:01.944595    4929 start.go:364] duration metric: took 29.375µs to acquireMachinesLock for "kindnet-672000"
	I0814 17:54:01.944607    4929 start.go:93] Provisioning new machine with config: &{Name:kindnet-672000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.0 ClusterName:kindnet-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOpti
ons:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:54:01.944636    4929 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:54:01.948011    4929 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0814 17:54:01.965838    4929 start.go:159] libmachine.API.Create for "kindnet-672000" (driver="qemu2")
	I0814 17:54:01.965863    4929 client.go:168] LocalClient.Create starting
	I0814 17:54:01.965924    4929 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:54:01.965954    4929 main.go:141] libmachine: Decoding PEM data...
	I0814 17:54:01.965964    4929 main.go:141] libmachine: Parsing certificate...
	I0814 17:54:01.966000    4929 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:54:01.966024    4929 main.go:141] libmachine: Decoding PEM data...
	I0814 17:54:01.966033    4929 main.go:141] libmachine: Parsing certificate...
	I0814 17:54:01.966561    4929 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:54:02.116320    4929 main.go:141] libmachine: Creating SSH key...
	I0814 17:54:02.180620    4929 main.go:141] libmachine: Creating Disk image...
	I0814 17:54:02.180627    4929 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:54:02.180811    4929 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kindnet-672000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kindnet-672000/disk.qcow2
	I0814 17:54:02.190044    4929 main.go:141] libmachine: STDOUT: 
	I0814 17:54:02.190064    4929 main.go:141] libmachine: STDERR: 
	I0814 17:54:02.190117    4929 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kindnet-672000/disk.qcow2 +20000M
	I0814 17:54:02.197974    4929 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:54:02.197992    4929 main.go:141] libmachine: STDERR: 
	I0814 17:54:02.198016    4929 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kindnet-672000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kindnet-672000/disk.qcow2
	I0814 17:54:02.198022    4929 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:54:02.198035    4929 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:54:02.198064    4929 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kindnet-672000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/kindnet-672000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kindnet-672000/qemu.pid -device virtio-net-pci,netdev=net0,mac=92:02:8f:10:2e:e4 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kindnet-672000/disk.qcow2
	I0814 17:54:02.199671    4929 main.go:141] libmachine: STDOUT: 
	I0814 17:54:02.199685    4929 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:54:02.199705    4929 client.go:171] duration metric: took 233.842958ms to LocalClient.Create
	I0814 17:54:04.201830    4929 start.go:128] duration metric: took 2.257231458s to createHost
	I0814 17:54:04.201886    4929 start.go:83] releasing machines lock for "kindnet-672000", held for 2.257341291s
	W0814 17:54:04.201964    4929 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:54:04.209126    4929 out.go:177] * Deleting "kindnet-672000" in qemu2 ...
	W0814 17:54:04.249387    4929 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:54:04.249409    4929 start.go:729] Will try again in 5 seconds ...
	I0814 17:54:09.251513    4929 start.go:360] acquireMachinesLock for kindnet-672000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:54:09.252063    4929 start.go:364] duration metric: took 450.792µs to acquireMachinesLock for "kindnet-672000"
	I0814 17:54:09.252191    4929 start.go:93] Provisioning new machine with config: &{Name:kindnet-672000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.0 ClusterName:kindnet-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOpti
ons:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:54:09.252429    4929 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:54:09.269466    4929 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0814 17:54:09.321531    4929 start.go:159] libmachine.API.Create for "kindnet-672000" (driver="qemu2")
	I0814 17:54:09.321613    4929 client.go:168] LocalClient.Create starting
	I0814 17:54:09.321783    4929 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:54:09.321874    4929 main.go:141] libmachine: Decoding PEM data...
	I0814 17:54:09.321890    4929 main.go:141] libmachine: Parsing certificate...
	I0814 17:54:09.321953    4929 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:54:09.322001    4929 main.go:141] libmachine: Decoding PEM data...
	I0814 17:54:09.322017    4929 main.go:141] libmachine: Parsing certificate...
	I0814 17:54:09.322820    4929 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:54:09.480538    4929 main.go:141] libmachine: Creating SSH key...
	I0814 17:54:09.584116    4929 main.go:141] libmachine: Creating Disk image...
	I0814 17:54:09.584122    4929 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:54:09.584307    4929 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kindnet-672000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kindnet-672000/disk.qcow2
	I0814 17:54:09.593906    4929 main.go:141] libmachine: STDOUT: 
	I0814 17:54:09.593926    4929 main.go:141] libmachine: STDERR: 
	I0814 17:54:09.593969    4929 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kindnet-672000/disk.qcow2 +20000M
	I0814 17:54:09.601887    4929 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:54:09.601904    4929 main.go:141] libmachine: STDERR: 
	I0814 17:54:09.601916    4929 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kindnet-672000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kindnet-672000/disk.qcow2
	I0814 17:54:09.601922    4929 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:54:09.601932    4929 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:54:09.601958    4929 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kindnet-672000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/kindnet-672000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kindnet-672000/qemu.pid -device virtio-net-pci,netdev=net0,mac=c2:86:bc:71:ab:08 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kindnet-672000/disk.qcow2
	I0814 17:54:09.603675    4929 main.go:141] libmachine: STDOUT: 
	I0814 17:54:09.603691    4929 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:54:09.603702    4929 client.go:171] duration metric: took 282.090583ms to LocalClient.Create
	I0814 17:54:11.605966    4929 start.go:128] duration metric: took 2.353562125s to createHost
	I0814 17:54:11.606048    4929 start.go:83] releasing machines lock for "kindnet-672000", held for 2.354024s
	W0814 17:54:11.606462    4929 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p kindnet-672000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p kindnet-672000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:54:11.621066    4929 out.go:177] 
	W0814 17:54:11.626252    4929 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:54:11.626275    4929 out.go:239] * 
	* 
	W0814 17:54:11.628841    4929 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:54:11.641122    4929 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/kindnet/Start (9.83s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (9.86s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p flannel-672000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=qemu2 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p flannel-672000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=qemu2 : exit status 80 (9.855354125s)

                                                
                                                
-- stdout --
	* [flannel-672000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "flannel-672000" primary control-plane node in "flannel-672000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "flannel-672000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:54:13.955472    5043 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:54:13.955600    5043 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:54:13.955603    5043 out.go:304] Setting ErrFile to fd 2...
	I0814 17:54:13.955605    5043 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:54:13.955750    5043 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:54:13.956808    5043 out.go:298] Setting JSON to false
	I0814 17:54:13.972942    5043 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3216,"bootTime":1723680037,"procs":458,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:54:13.973018    5043 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:54:13.979508    5043 out.go:177] * [flannel-672000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:54:13.987490    5043 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:54:13.987557    5043 notify.go:220] Checking for updates...
	I0814 17:54:13.993434    5043 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:54:13.996396    5043 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:54:13.999432    5043 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:54:14.002438    5043 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:54:14.005462    5043 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:54:14.008775    5043 config.go:182] Loaded profile config "cert-expiration-172000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:54:14.008852    5043 config.go:182] Loaded profile config "multinode-628000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:54:14.008898    5043 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:54:14.013376    5043 out.go:177] * Using the qemu2 driver based on user configuration
	I0814 17:54:14.020383    5043 start.go:297] selected driver: qemu2
	I0814 17:54:14.020389    5043 start.go:901] validating driver "qemu2" against <nil>
	I0814 17:54:14.020395    5043 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:54:14.022774    5043 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0814 17:54:14.025388    5043 out.go:177] * Automatically selected the socket_vmnet network
	I0814 17:54:14.028512    5043 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0814 17:54:14.028559    5043 cni.go:84] Creating CNI manager for "flannel"
	I0814 17:54:14.028570    5043 start_flags.go:319] Found "Flannel" CNI - setting NetworkPlugin=cni
	I0814 17:54:14.028594    5043 start.go:340] cluster config:
	{Name:flannel-672000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:flannel-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntim
e:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/sock
et_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:54:14.032290    5043 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:54:14.039440    5043 out.go:177] * Starting "flannel-672000" primary control-plane node in "flannel-672000" cluster
	I0814 17:54:14.043436    5043 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:54:14.043477    5043 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:54:14.043492    5043 cache.go:56] Caching tarball of preloaded images
	I0814 17:54:14.043565    5043 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:54:14.043570    5043 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:54:14.043643    5043 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/flannel-672000/config.json ...
	I0814 17:54:14.043654    5043 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/flannel-672000/config.json: {Name:mk6afca5458f032dbd300abf8b112502811fb680 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:54:14.044035    5043 start.go:360] acquireMachinesLock for flannel-672000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:54:14.044068    5043 start.go:364] duration metric: took 27.083µs to acquireMachinesLock for "flannel-672000"
	I0814 17:54:14.044080    5043 start.go:93] Provisioning new machine with config: &{Name:flannel-672000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.0 ClusterName:flannel-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOpti
ons:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:54:14.044126    5043 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:54:14.048355    5043 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0814 17:54:14.065554    5043 start.go:159] libmachine.API.Create for "flannel-672000" (driver="qemu2")
	I0814 17:54:14.065573    5043 client.go:168] LocalClient.Create starting
	I0814 17:54:14.065629    5043 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:54:14.065658    5043 main.go:141] libmachine: Decoding PEM data...
	I0814 17:54:14.065667    5043 main.go:141] libmachine: Parsing certificate...
	I0814 17:54:14.065704    5043 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:54:14.065727    5043 main.go:141] libmachine: Decoding PEM data...
	I0814 17:54:14.065741    5043 main.go:141] libmachine: Parsing certificate...
	I0814 17:54:14.066194    5043 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:54:14.217443    5043 main.go:141] libmachine: Creating SSH key...
	I0814 17:54:14.322858    5043 main.go:141] libmachine: Creating Disk image...
	I0814 17:54:14.322864    5043 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:54:14.323028    5043 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/flannel-672000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/flannel-672000/disk.qcow2
	I0814 17:54:14.332391    5043 main.go:141] libmachine: STDOUT: 
	I0814 17:54:14.332409    5043 main.go:141] libmachine: STDERR: 
	I0814 17:54:14.332467    5043 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/flannel-672000/disk.qcow2 +20000M
	I0814 17:54:14.340311    5043 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:54:14.340325    5043 main.go:141] libmachine: STDERR: 
	I0814 17:54:14.340341    5043 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/flannel-672000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/flannel-672000/disk.qcow2
	I0814 17:54:14.340345    5043 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:54:14.340360    5043 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:54:14.340389    5043 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/flannel-672000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/flannel-672000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/flannel-672000/qemu.pid -device virtio-net-pci,netdev=net0,mac=2e:fe:a2:8b:a6:57 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/flannel-672000/disk.qcow2
	I0814 17:54:14.342036    5043 main.go:141] libmachine: STDOUT: 
	I0814 17:54:14.342055    5043 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:54:14.342071    5043 client.go:171] duration metric: took 276.500125ms to LocalClient.Create
	I0814 17:54:16.344202    5043 start.go:128] duration metric: took 2.300116292s to createHost
	I0814 17:54:16.344251    5043 start.go:83] releasing machines lock for "flannel-672000", held for 2.300231291s
	W0814 17:54:16.344323    5043 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:54:16.360545    5043 out.go:177] * Deleting "flannel-672000" in qemu2 ...
	W0814 17:54:16.389300    5043 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:54:16.389321    5043 start.go:729] Will try again in 5 seconds ...
	I0814 17:54:21.391365    5043 start.go:360] acquireMachinesLock for flannel-672000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:54:21.391817    5043 start.go:364] duration metric: took 370.292µs to acquireMachinesLock for "flannel-672000"
	I0814 17:54:21.391948    5043 start.go:93] Provisioning new machine with config: &{Name:flannel-672000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.0 ClusterName:flannel-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOpti
ons:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:54:21.392235    5043 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:54:21.408886    5043 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0814 17:54:21.459162    5043 start.go:159] libmachine.API.Create for "flannel-672000" (driver="qemu2")
	I0814 17:54:21.459206    5043 client.go:168] LocalClient.Create starting
	I0814 17:54:21.459319    5043 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:54:21.459395    5043 main.go:141] libmachine: Decoding PEM data...
	I0814 17:54:21.459413    5043 main.go:141] libmachine: Parsing certificate...
	I0814 17:54:21.459471    5043 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:54:21.459515    5043 main.go:141] libmachine: Decoding PEM data...
	I0814 17:54:21.459525    5043 main.go:141] libmachine: Parsing certificate...
	I0814 17:54:21.460190    5043 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:54:21.619668    5043 main.go:141] libmachine: Creating SSH key...
	I0814 17:54:21.715613    5043 main.go:141] libmachine: Creating Disk image...
	I0814 17:54:21.715622    5043 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:54:21.715811    5043 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/flannel-672000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/flannel-672000/disk.qcow2
	I0814 17:54:21.725096    5043 main.go:141] libmachine: STDOUT: 
	I0814 17:54:21.725120    5043 main.go:141] libmachine: STDERR: 
	I0814 17:54:21.725178    5043 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/flannel-672000/disk.qcow2 +20000M
	I0814 17:54:21.732977    5043 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:54:21.732998    5043 main.go:141] libmachine: STDERR: 
	I0814 17:54:21.733010    5043 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/flannel-672000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/flannel-672000/disk.qcow2
	I0814 17:54:21.733015    5043 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:54:21.733026    5043 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:54:21.733052    5043 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/flannel-672000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/flannel-672000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/flannel-672000/qemu.pid -device virtio-net-pci,netdev=net0,mac=7a:20:53:81:f0:1b -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/flannel-672000/disk.qcow2
	I0814 17:54:21.734648    5043 main.go:141] libmachine: STDOUT: 
	I0814 17:54:21.734667    5043 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:54:21.734681    5043 client.go:171] duration metric: took 275.475958ms to LocalClient.Create
	I0814 17:54:23.736813    5043 start.go:128] duration metric: took 2.344593125s to createHost
	I0814 17:54:23.736875    5043 start.go:83] releasing machines lock for "flannel-672000", held for 2.345095333s
	W0814 17:54:23.737280    5043 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p flannel-672000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p flannel-672000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:54:23.745890    5043 out.go:177] 
	W0814 17:54:23.753892    5043 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:54:23.753919    5043 out.go:239] * 
	* 
	W0814 17:54:23.756747    5043 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:54:23.766808    5043 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/flannel/Start (9.86s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (9.84s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p enable-default-cni-672000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=qemu2 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p enable-default-cni-672000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=qemu2 : exit status 80 (9.836131916s)

                                                
                                                
-- stdout --
	* [enable-default-cni-672000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "enable-default-cni-672000" primary control-plane node in "enable-default-cni-672000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "enable-default-cni-672000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:54:26.167479    5160 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:54:26.167607    5160 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:54:26.167610    5160 out.go:304] Setting ErrFile to fd 2...
	I0814 17:54:26.167612    5160 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:54:26.167742    5160 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:54:26.168769    5160 out.go:298] Setting JSON to false
	I0814 17:54:26.184688    5160 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3229,"bootTime":1723680037,"procs":458,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:54:26.184783    5160 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:54:26.190851    5160 out.go:177] * [enable-default-cni-672000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:54:26.198839    5160 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:54:26.198883    5160 notify.go:220] Checking for updates...
	I0814 17:54:26.203054    5160 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:54:26.205798    5160 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:54:26.208883    5160 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:54:26.211836    5160 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:54:26.214835    5160 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:54:26.218204    5160 config.go:182] Loaded profile config "cert-expiration-172000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:54:26.218274    5160 config.go:182] Loaded profile config "multinode-628000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:54:26.218332    5160 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:54:26.222851    5160 out.go:177] * Using the qemu2 driver based on user configuration
	I0814 17:54:26.229812    5160 start.go:297] selected driver: qemu2
	I0814 17:54:26.229818    5160 start.go:901] validating driver "qemu2" against <nil>
	I0814 17:54:26.229824    5160 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:54:26.231972    5160 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0814 17:54:26.234872    5160 out.go:177] * Automatically selected the socket_vmnet network
	E0814 17:54:26.237888    5160 start_flags.go:464] Found deprecated --enable-default-cni flag, setting --cni=bridge
	I0814 17:54:26.237907    5160 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0814 17:54:26.237928    5160 cni.go:84] Creating CNI manager for "bridge"
	I0814 17:54:26.237932    5160 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0814 17:54:26.237957    5160 start.go:340] cluster config:
	{Name:enable-default-cni-672000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:enable-default-cni-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster
.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/
socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:54:26.241590    5160 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:54:26.248614    5160 out.go:177] * Starting "enable-default-cni-672000" primary control-plane node in "enable-default-cni-672000" cluster
	I0814 17:54:26.252838    5160 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:54:26.252854    5160 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:54:26.252870    5160 cache.go:56] Caching tarball of preloaded images
	I0814 17:54:26.252946    5160 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:54:26.252955    5160 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:54:26.253023    5160 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/enable-default-cni-672000/config.json ...
	I0814 17:54:26.253034    5160 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/enable-default-cni-672000/config.json: {Name:mkead009182438b34650692a6b8c7c86a0e19783 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:54:26.253248    5160 start.go:360] acquireMachinesLock for enable-default-cni-672000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:54:26.253282    5160 start.go:364] duration metric: took 27.375µs to acquireMachinesLock for "enable-default-cni-672000"
	I0814 17:54:26.253295    5160 start.go:93] Provisioning new machine with config: &{Name:enable-default-cni-672000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes
Config:{KubernetesVersion:v1.31.0 ClusterName:enable-default-cni-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountM
Size:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:54:26.253336    5160 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:54:26.260804    5160 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0814 17:54:26.277811    5160 start.go:159] libmachine.API.Create for "enable-default-cni-672000" (driver="qemu2")
	I0814 17:54:26.277831    5160 client.go:168] LocalClient.Create starting
	I0814 17:54:26.277897    5160 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:54:26.277926    5160 main.go:141] libmachine: Decoding PEM data...
	I0814 17:54:26.277936    5160 main.go:141] libmachine: Parsing certificate...
	I0814 17:54:26.277975    5160 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:54:26.277998    5160 main.go:141] libmachine: Decoding PEM data...
	I0814 17:54:26.278004    5160 main.go:141] libmachine: Parsing certificate...
	I0814 17:54:26.278430    5160 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:54:26.429823    5160 main.go:141] libmachine: Creating SSH key...
	I0814 17:54:26.562008    5160 main.go:141] libmachine: Creating Disk image...
	I0814 17:54:26.562013    5160 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:54:26.562203    5160 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/enable-default-cni-672000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/enable-default-cni-672000/disk.qcow2
	I0814 17:54:26.571773    5160 main.go:141] libmachine: STDOUT: 
	I0814 17:54:26.571790    5160 main.go:141] libmachine: STDERR: 
	I0814 17:54:26.571836    5160 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/enable-default-cni-672000/disk.qcow2 +20000M
	I0814 17:54:26.579709    5160 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:54:26.579727    5160 main.go:141] libmachine: STDERR: 
	I0814 17:54:26.579742    5160 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/enable-default-cni-672000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/enable-default-cni-672000/disk.qcow2
	I0814 17:54:26.579752    5160 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:54:26.579766    5160 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:54:26.579804    5160 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/enable-default-cni-672000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/enable-default-cni-672000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/enable-default-cni-672000/qemu.pid -device virtio-net-pci,netdev=net0,mac=72:c8:eb:d6:6b:b9 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/enable-default-cni-672000/disk.qcow2
	I0814 17:54:26.581435    5160 main.go:141] libmachine: STDOUT: 
	I0814 17:54:26.581452    5160 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:54:26.581470    5160 client.go:171] duration metric: took 303.641209ms to LocalClient.Create
	I0814 17:54:28.583593    5160 start.go:128] duration metric: took 2.3302975s to createHost
	I0814 17:54:28.583673    5160 start.go:83] releasing machines lock for "enable-default-cni-672000", held for 2.330437375s
	W0814 17:54:28.583756    5160 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:54:28.590921    5160 out.go:177] * Deleting "enable-default-cni-672000" in qemu2 ...
	W0814 17:54:28.629640    5160 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:54:28.629668    5160 start.go:729] Will try again in 5 seconds ...
	I0814 17:54:33.631780    5160 start.go:360] acquireMachinesLock for enable-default-cni-672000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:54:33.632209    5160 start.go:364] duration metric: took 363.416µs to acquireMachinesLock for "enable-default-cni-672000"
	I0814 17:54:33.632331    5160 start.go:93] Provisioning new machine with config: &{Name:enable-default-cni-672000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes
Config:{KubernetesVersion:v1.31.0 ClusterName:enable-default-cni-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountM
Size:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:54:33.632571    5160 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:54:33.649247    5160 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0814 17:54:33.699192    5160 start.go:159] libmachine.API.Create for "enable-default-cni-672000" (driver="qemu2")
	I0814 17:54:33.699244    5160 client.go:168] LocalClient.Create starting
	I0814 17:54:33.699406    5160 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:54:33.699475    5160 main.go:141] libmachine: Decoding PEM data...
	I0814 17:54:33.699493    5160 main.go:141] libmachine: Parsing certificate...
	I0814 17:54:33.699557    5160 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:54:33.699607    5160 main.go:141] libmachine: Decoding PEM data...
	I0814 17:54:33.699621    5160 main.go:141] libmachine: Parsing certificate...
	I0814 17:54:33.700128    5160 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:54:33.861061    5160 main.go:141] libmachine: Creating SSH key...
	I0814 17:54:33.909616    5160 main.go:141] libmachine: Creating Disk image...
	I0814 17:54:33.909622    5160 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:54:33.909808    5160 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/enable-default-cni-672000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/enable-default-cni-672000/disk.qcow2
	I0814 17:54:33.919319    5160 main.go:141] libmachine: STDOUT: 
	I0814 17:54:33.919344    5160 main.go:141] libmachine: STDERR: 
	I0814 17:54:33.919394    5160 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/enable-default-cni-672000/disk.qcow2 +20000M
	I0814 17:54:33.927461    5160 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:54:33.927475    5160 main.go:141] libmachine: STDERR: 
	I0814 17:54:33.927491    5160 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/enable-default-cni-672000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/enable-default-cni-672000/disk.qcow2
	I0814 17:54:33.927494    5160 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:54:33.927513    5160 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:54:33.927538    5160 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/enable-default-cni-672000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/enable-default-cni-672000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/enable-default-cni-672000/qemu.pid -device virtio-net-pci,netdev=net0,mac=a2:b8:6a:37:17:ad -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/enable-default-cni-672000/disk.qcow2
	I0814 17:54:33.929262    5160 main.go:141] libmachine: STDOUT: 
	I0814 17:54:33.929275    5160 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:54:33.929293    5160 client.go:171] duration metric: took 230.050708ms to LocalClient.Create
	I0814 17:54:35.931417    5160 start.go:128] duration metric: took 2.298877292s to createHost
	I0814 17:54:35.931573    5160 start.go:83] releasing machines lock for "enable-default-cni-672000", held for 2.299398042s
	W0814 17:54:35.931919    5160 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p enable-default-cni-672000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p enable-default-cni-672000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:54:35.945561    5160 out.go:177] 
	W0814 17:54:35.948689    5160 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:54:35.948752    5160 out.go:239] * 
	* 
	W0814 17:54:35.951463    5160 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:54:35.960587    5160 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/enable-default-cni/Start (9.84s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (9.84s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p bridge-672000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=qemu2 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p bridge-672000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=qemu2 : exit status 80 (9.835333833s)

                                                
                                                
-- stdout --
	* [bridge-672000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "bridge-672000" primary control-plane node in "bridge-672000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "bridge-672000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:54:38.170719    5269 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:54:38.170833    5269 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:54:38.170837    5269 out.go:304] Setting ErrFile to fd 2...
	I0814 17:54:38.170840    5269 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:54:38.170976    5269 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:54:38.172081    5269 out.go:298] Setting JSON to false
	I0814 17:54:38.188135    5269 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3241,"bootTime":1723680037,"procs":458,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:54:38.188223    5269 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:54:38.194179    5269 out.go:177] * [bridge-672000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:54:38.202213    5269 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:54:38.202276    5269 notify.go:220] Checking for updates...
	I0814 17:54:38.209184    5269 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:54:38.212145    5269 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:54:38.215201    5269 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:54:38.218195    5269 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:54:38.221118    5269 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:54:38.224543    5269 config.go:182] Loaded profile config "cert-expiration-172000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:54:38.224608    5269 config.go:182] Loaded profile config "multinode-628000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:54:38.224666    5269 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:54:38.229182    5269 out.go:177] * Using the qemu2 driver based on user configuration
	I0814 17:54:38.236129    5269 start.go:297] selected driver: qemu2
	I0814 17:54:38.236137    5269 start.go:901] validating driver "qemu2" against <nil>
	I0814 17:54:38.236143    5269 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:54:38.238462    5269 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0814 17:54:38.242211    5269 out.go:177] * Automatically selected the socket_vmnet network
	I0814 17:54:38.245309    5269 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0814 17:54:38.245330    5269 cni.go:84] Creating CNI manager for "bridge"
	I0814 17:54:38.245335    5269 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0814 17:54:38.245375    5269 start.go:340] cluster config:
	{Name:bridge-672000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:bridge-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:
docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_
vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:54:38.248880    5269 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:54:38.256214    5269 out.go:177] * Starting "bridge-672000" primary control-plane node in "bridge-672000" cluster
	I0814 17:54:38.260193    5269 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:54:38.260208    5269 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:54:38.260218    5269 cache.go:56] Caching tarball of preloaded images
	I0814 17:54:38.260281    5269 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:54:38.260287    5269 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:54:38.260362    5269 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/bridge-672000/config.json ...
	I0814 17:54:38.260374    5269 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/bridge-672000/config.json: {Name:mk20380904bd7e2455116eb116aa9f64d37e4c24 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:54:38.260748    5269 start.go:360] acquireMachinesLock for bridge-672000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:54:38.260781    5269 start.go:364] duration metric: took 26.75µs to acquireMachinesLock for "bridge-672000"
	I0814 17:54:38.260792    5269 start.go:93] Provisioning new machine with config: &{Name:bridge-672000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kube
rnetesVersion:v1.31.0 ClusterName:bridge-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:54:38.260831    5269 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:54:38.269106    5269 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0814 17:54:38.286907    5269 start.go:159] libmachine.API.Create for "bridge-672000" (driver="qemu2")
	I0814 17:54:38.286928    5269 client.go:168] LocalClient.Create starting
	I0814 17:54:38.286990    5269 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:54:38.287019    5269 main.go:141] libmachine: Decoding PEM data...
	I0814 17:54:38.287026    5269 main.go:141] libmachine: Parsing certificate...
	I0814 17:54:38.287062    5269 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:54:38.287084    5269 main.go:141] libmachine: Decoding PEM data...
	I0814 17:54:38.287092    5269 main.go:141] libmachine: Parsing certificate...
	I0814 17:54:38.287510    5269 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:54:38.438784    5269 main.go:141] libmachine: Creating SSH key...
	I0814 17:54:38.508227    5269 main.go:141] libmachine: Creating Disk image...
	I0814 17:54:38.508232    5269 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:54:38.508410    5269 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/bridge-672000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/bridge-672000/disk.qcow2
	I0814 17:54:38.517568    5269 main.go:141] libmachine: STDOUT: 
	I0814 17:54:38.517587    5269 main.go:141] libmachine: STDERR: 
	I0814 17:54:38.517649    5269 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/bridge-672000/disk.qcow2 +20000M
	I0814 17:54:38.525653    5269 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:54:38.525667    5269 main.go:141] libmachine: STDERR: 
	I0814 17:54:38.525685    5269 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/bridge-672000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/bridge-672000/disk.qcow2
	I0814 17:54:38.525691    5269 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:54:38.525701    5269 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:54:38.525731    5269 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/bridge-672000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/bridge-672000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/bridge-672000/qemu.pid -device virtio-net-pci,netdev=net0,mac=f6:d2:9f:b8:42:92 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/bridge-672000/disk.qcow2
	I0814 17:54:38.527318    5269 main.go:141] libmachine: STDOUT: 
	I0814 17:54:38.527332    5269 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:54:38.527350    5269 client.go:171] duration metric: took 240.424291ms to LocalClient.Create
	I0814 17:54:40.529535    5269 start.go:128] duration metric: took 2.268745167s to createHost
	I0814 17:54:40.529596    5269 start.go:83] releasing machines lock for "bridge-672000", held for 2.268866958s
	W0814 17:54:40.529649    5269 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:54:40.545768    5269 out.go:177] * Deleting "bridge-672000" in qemu2 ...
	W0814 17:54:40.576705    5269 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:54:40.576744    5269 start.go:729] Will try again in 5 seconds ...
	I0814 17:54:45.578878    5269 start.go:360] acquireMachinesLock for bridge-672000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:54:45.579262    5269 start.go:364] duration metric: took 313.583µs to acquireMachinesLock for "bridge-672000"
	I0814 17:54:45.579379    5269 start.go:93] Provisioning new machine with config: &{Name:bridge-672000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kube
rnetesVersion:v1.31.0 ClusterName:bridge-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:54:45.579650    5269 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:54:45.588299    5269 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0814 17:54:45.637541    5269 start.go:159] libmachine.API.Create for "bridge-672000" (driver="qemu2")
	I0814 17:54:45.637597    5269 client.go:168] LocalClient.Create starting
	I0814 17:54:45.637727    5269 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:54:45.637790    5269 main.go:141] libmachine: Decoding PEM data...
	I0814 17:54:45.637805    5269 main.go:141] libmachine: Parsing certificate...
	I0814 17:54:45.637871    5269 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:54:45.637917    5269 main.go:141] libmachine: Decoding PEM data...
	I0814 17:54:45.637928    5269 main.go:141] libmachine: Parsing certificate...
	I0814 17:54:45.638458    5269 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:54:45.798860    5269 main.go:141] libmachine: Creating SSH key...
	I0814 17:54:45.914492    5269 main.go:141] libmachine: Creating Disk image...
	I0814 17:54:45.914497    5269 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:54:45.914674    5269 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/bridge-672000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/bridge-672000/disk.qcow2
	I0814 17:54:45.924101    5269 main.go:141] libmachine: STDOUT: 
	I0814 17:54:45.924129    5269 main.go:141] libmachine: STDERR: 
	I0814 17:54:45.924195    5269 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/bridge-672000/disk.qcow2 +20000M
	I0814 17:54:45.932119    5269 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:54:45.932134    5269 main.go:141] libmachine: STDERR: 
	I0814 17:54:45.932146    5269 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/bridge-672000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/bridge-672000/disk.qcow2
	I0814 17:54:45.932152    5269 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:54:45.932164    5269 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:54:45.932188    5269 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/bridge-672000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/bridge-672000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/bridge-672000/qemu.pid -device virtio-net-pci,netdev=net0,mac=d2:ab:fd:f6:7a:bc -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/bridge-672000/disk.qcow2
	I0814 17:54:45.933836    5269 main.go:141] libmachine: STDOUT: 
	I0814 17:54:45.933857    5269 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:54:45.933870    5269 client.go:171] duration metric: took 296.274625ms to LocalClient.Create
	I0814 17:54:47.935984    5269 start.go:128] duration metric: took 2.356372667s to createHost
	I0814 17:54:47.936061    5269 start.go:83] releasing machines lock for "bridge-672000", held for 2.356837958s
	W0814 17:54:47.936504    5269 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p bridge-672000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p bridge-672000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:54:47.945945    5269 out.go:177] 
	W0814 17:54:47.954100    5269 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:54:47.954125    5269 out.go:239] * 
	* 
	W0814 17:54:47.956472    5269 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:54:47.963644    5269 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/bridge/Start (9.84s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/Start (9.82s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p kubenet-672000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=qemu2 
E0814 17:54:55.298376    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p kubenet-672000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=qemu2 : exit status 80 (9.816265125s)

                                                
                                                
-- stdout --
	* [kubenet-672000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "kubenet-672000" primary control-plane node in "kubenet-672000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "kubenet-672000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:54:50.152718    5381 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:54:50.152838    5381 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:54:50.152841    5381 out.go:304] Setting ErrFile to fd 2...
	I0814 17:54:50.152844    5381 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:54:50.152968    5381 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:54:50.154250    5381 out.go:298] Setting JSON to false
	I0814 17:54:50.170734    5381 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3253,"bootTime":1723680037,"procs":458,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:54:50.170807    5381 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:54:50.176489    5381 out.go:177] * [kubenet-672000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:54:50.183357    5381 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:54:50.183401    5381 notify.go:220] Checking for updates...
	I0814 17:54:50.189336    5381 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:54:50.192363    5381 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:54:50.196376    5381 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:54:50.199280    5381 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:54:50.202301    5381 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:54:50.205774    5381 config.go:182] Loaded profile config "cert-expiration-172000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:54:50.205852    5381 config.go:182] Loaded profile config "multinode-628000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:54:50.205897    5381 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:54:50.210319    5381 out.go:177] * Using the qemu2 driver based on user configuration
	I0814 17:54:50.219407    5381 start.go:297] selected driver: qemu2
	I0814 17:54:50.219414    5381 start.go:901] validating driver "qemu2" against <nil>
	I0814 17:54:50.219421    5381 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:54:50.221789    5381 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0814 17:54:50.225296    5381 out.go:177] * Automatically selected the socket_vmnet network
	I0814 17:54:50.228498    5381 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0814 17:54:50.228557    5381 cni.go:80] network plugin configured as "kubenet", returning disabled
	I0814 17:54:50.228595    5381 start.go:340] cluster config:
	{Name:kubenet-672000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:kubenet-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntim
e:docker CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_
vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:54:50.232383    5381 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:54:50.239261    5381 out.go:177] * Starting "kubenet-672000" primary control-plane node in "kubenet-672000" cluster
	I0814 17:54:50.243322    5381 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:54:50.243338    5381 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:54:50.243347    5381 cache.go:56] Caching tarball of preloaded images
	I0814 17:54:50.243413    5381 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:54:50.243419    5381 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:54:50.243483    5381 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/kubenet-672000/config.json ...
	I0814 17:54:50.243498    5381 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/kubenet-672000/config.json: {Name:mk2eed4289eefb345246bd26676b5585137e9d6b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:54:50.243894    5381 start.go:360] acquireMachinesLock for kubenet-672000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:54:50.243930    5381 start.go:364] duration metric: took 29.792µs to acquireMachinesLock for "kubenet-672000"
	I0814 17:54:50.243947    5381 start.go:93] Provisioning new machine with config: &{Name:kubenet-672000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.0 ClusterName:kubenet-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:54:50.244022    5381 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:54:50.252334    5381 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0814 17:54:50.270929    5381 start.go:159] libmachine.API.Create for "kubenet-672000" (driver="qemu2")
	I0814 17:54:50.270953    5381 client.go:168] LocalClient.Create starting
	I0814 17:54:50.271019    5381 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:54:50.271053    5381 main.go:141] libmachine: Decoding PEM data...
	I0814 17:54:50.271061    5381 main.go:141] libmachine: Parsing certificate...
	I0814 17:54:50.271105    5381 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:54:50.271129    5381 main.go:141] libmachine: Decoding PEM data...
	I0814 17:54:50.271137    5381 main.go:141] libmachine: Parsing certificate...
	I0814 17:54:50.271510    5381 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:54:50.420992    5381 main.go:141] libmachine: Creating SSH key...
	I0814 17:54:50.500480    5381 main.go:141] libmachine: Creating Disk image...
	I0814 17:54:50.500485    5381 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:54:50.500675    5381 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubenet-672000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubenet-672000/disk.qcow2
	I0814 17:54:50.509860    5381 main.go:141] libmachine: STDOUT: 
	I0814 17:54:50.509889    5381 main.go:141] libmachine: STDERR: 
	I0814 17:54:50.509949    5381 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubenet-672000/disk.qcow2 +20000M
	I0814 17:54:50.518008    5381 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:54:50.518023    5381 main.go:141] libmachine: STDERR: 
	I0814 17:54:50.518040    5381 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubenet-672000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubenet-672000/disk.qcow2
	I0814 17:54:50.518044    5381 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:54:50.518053    5381 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:54:50.518080    5381 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubenet-672000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubenet-672000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubenet-672000/qemu.pid -device virtio-net-pci,netdev=net0,mac=6e:f5:f4:97:5c:8b -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubenet-672000/disk.qcow2
	I0814 17:54:50.519674    5381 main.go:141] libmachine: STDOUT: 
	I0814 17:54:50.519690    5381 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:54:50.519708    5381 client.go:171] duration metric: took 248.756459ms to LocalClient.Create
	I0814 17:54:52.521844    5381 start.go:128] duration metric: took 2.277859833s to createHost
	I0814 17:54:52.521916    5381 start.go:83] releasing machines lock for "kubenet-672000", held for 2.278035666s
	W0814 17:54:52.521971    5381 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:54:52.538196    5381 out.go:177] * Deleting "kubenet-672000" in qemu2 ...
	W0814 17:54:52.567187    5381 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:54:52.567227    5381 start.go:729] Will try again in 5 seconds ...
	I0814 17:54:57.569256    5381 start.go:360] acquireMachinesLock for kubenet-672000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:54:57.569728    5381 start.go:364] duration metric: took 379.75µs to acquireMachinesLock for "kubenet-672000"
	I0814 17:54:57.569893    5381 start.go:93] Provisioning new machine with config: &{Name:kubenet-672000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.0 ClusterName:kubenet-672000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:54:57.570145    5381 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:54:57.588018    5381 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0814 17:54:57.639849    5381 start.go:159] libmachine.API.Create for "kubenet-672000" (driver="qemu2")
	I0814 17:54:57.639907    5381 client.go:168] LocalClient.Create starting
	I0814 17:54:57.640018    5381 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:54:57.640079    5381 main.go:141] libmachine: Decoding PEM data...
	I0814 17:54:57.640094    5381 main.go:141] libmachine: Parsing certificate...
	I0814 17:54:57.640156    5381 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:54:57.640199    5381 main.go:141] libmachine: Decoding PEM data...
	I0814 17:54:57.640214    5381 main.go:141] libmachine: Parsing certificate...
	I0814 17:54:57.641146    5381 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:54:57.817271    5381 main.go:141] libmachine: Creating SSH key...
	I0814 17:54:57.874761    5381 main.go:141] libmachine: Creating Disk image...
	I0814 17:54:57.874766    5381 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:54:57.874956    5381 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubenet-672000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubenet-672000/disk.qcow2
	I0814 17:54:57.884079    5381 main.go:141] libmachine: STDOUT: 
	I0814 17:54:57.884098    5381 main.go:141] libmachine: STDERR: 
	I0814 17:54:57.884149    5381 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubenet-672000/disk.qcow2 +20000M
	I0814 17:54:57.892013    5381 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:54:57.892030    5381 main.go:141] libmachine: STDERR: 
	I0814 17:54:57.892040    5381 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubenet-672000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubenet-672000/disk.qcow2
	I0814 17:54:57.892044    5381 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:54:57.892056    5381 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:54:57.892080    5381 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubenet-672000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubenet-672000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubenet-672000/qemu.pid -device virtio-net-pci,netdev=net0,mac=c2:e0:3b:31:42:aa -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/kubenet-672000/disk.qcow2
	I0814 17:54:57.893829    5381 main.go:141] libmachine: STDOUT: 
	I0814 17:54:57.893844    5381 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:54:57.893856    5381 client.go:171] duration metric: took 253.948958ms to LocalClient.Create
	I0814 17:54:59.895972    5381 start.go:128] duration metric: took 2.325858375s to createHost
	I0814 17:54:59.896107    5381 start.go:83] releasing machines lock for "kubenet-672000", held for 2.326344875s
	W0814 17:54:59.896400    5381 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p kubenet-672000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p kubenet-672000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:54:59.911165    5381 out.go:177] 
	W0814 17:54:59.914268    5381 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:54:59.914328    5381 out.go:239] * 
	* 
	W0814 17:54:59.916979    5381 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:54:59.926102    5381 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/kubenet/Start (9.82s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (9.94s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-arm64 start -p old-k8s-version-637000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=qemu2  --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p old-k8s-version-637000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=qemu2  --kubernetes-version=v1.20.0: exit status 80 (9.873072958s)

                                                
                                                
-- stdout --
	* [old-k8s-version-637000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "old-k8s-version-637000" primary control-plane node in "old-k8s-version-637000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "old-k8s-version-637000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:55:02.121107    5492 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:55:02.121244    5492 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:55:02.121247    5492 out.go:304] Setting ErrFile to fd 2...
	I0814 17:55:02.121250    5492 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:55:02.121376    5492 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:55:02.122443    5492 out.go:298] Setting JSON to false
	I0814 17:55:02.138475    5492 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3265,"bootTime":1723680037,"procs":459,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:55:02.138555    5492 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:55:02.144778    5492 out.go:177] * [old-k8s-version-637000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:55:02.152819    5492 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:55:02.152877    5492 notify.go:220] Checking for updates...
	I0814 17:55:02.159758    5492 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:55:02.161175    5492 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:55:02.164751    5492 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:55:02.167826    5492 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:55:02.170814    5492 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:55:02.174218    5492 config.go:182] Loaded profile config "cert-expiration-172000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:55:02.174283    5492 config.go:182] Loaded profile config "multinode-628000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:55:02.174334    5492 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:55:02.178791    5492 out.go:177] * Using the qemu2 driver based on user configuration
	I0814 17:55:02.185739    5492 start.go:297] selected driver: qemu2
	I0814 17:55:02.185746    5492 start.go:901] validating driver "qemu2" against <nil>
	I0814 17:55:02.185753    5492 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:55:02.188056    5492 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0814 17:55:02.192811    5492 out.go:177] * Automatically selected the socket_vmnet network
	I0814 17:55:02.195881    5492 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0814 17:55:02.195934    5492 cni.go:84] Creating CNI manager for ""
	I0814 17:55:02.195942    5492 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0814 17:55:02.195971    5492 start.go:340] cluster config:
	{Name:old-k8s-version-637000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-637000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/
socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:55:02.199601    5492 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:55:02.207813    5492 out.go:177] * Starting "old-k8s-version-637000" primary control-plane node in "old-k8s-version-637000" cluster
	I0814 17:55:02.211749    5492 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0814 17:55:02.211766    5492 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4
	I0814 17:55:02.211779    5492 cache.go:56] Caching tarball of preloaded images
	I0814 17:55:02.211846    5492 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:55:02.211853    5492 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I0814 17:55:02.211922    5492 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/old-k8s-version-637000/config.json ...
	I0814 17:55:02.211933    5492 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/old-k8s-version-637000/config.json: {Name:mk0f7f87f082f9c54092c3cbfa4112512241544c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:55:02.212169    5492 start.go:360] acquireMachinesLock for old-k8s-version-637000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:55:02.212200    5492 start.go:364] duration metric: took 25.291µs to acquireMachinesLock for "old-k8s-version-637000"
	I0814 17:55:02.212211    5492 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-637000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-637000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mount
Options:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:55:02.212238    5492 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:55:02.220791    5492 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0814 17:55:02.237433    5492 start.go:159] libmachine.API.Create for "old-k8s-version-637000" (driver="qemu2")
	I0814 17:55:02.237453    5492 client.go:168] LocalClient.Create starting
	I0814 17:55:02.237514    5492 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:55:02.237543    5492 main.go:141] libmachine: Decoding PEM data...
	I0814 17:55:02.237556    5492 main.go:141] libmachine: Parsing certificate...
	I0814 17:55:02.237590    5492 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:55:02.237619    5492 main.go:141] libmachine: Decoding PEM data...
	I0814 17:55:02.237629    5492 main.go:141] libmachine: Parsing certificate...
	I0814 17:55:02.238060    5492 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:55:02.386968    5492 main.go:141] libmachine: Creating SSH key...
	I0814 17:55:02.457161    5492 main.go:141] libmachine: Creating Disk image...
	I0814 17:55:02.457166    5492 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:55:02.457350    5492 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/disk.qcow2
	I0814 17:55:02.466499    5492 main.go:141] libmachine: STDOUT: 
	I0814 17:55:02.466518    5492 main.go:141] libmachine: STDERR: 
	I0814 17:55:02.466576    5492 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/disk.qcow2 +20000M
	I0814 17:55:02.474375    5492 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:55:02.474387    5492 main.go:141] libmachine: STDERR: 
	I0814 17:55:02.474401    5492 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/disk.qcow2
	I0814 17:55:02.474407    5492 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:55:02.474421    5492 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:55:02.474443    5492 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/qemu.pid -device virtio-net-pci,netdev=net0,mac=e6:28:bd:90:8c:5b -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/disk.qcow2
	I0814 17:55:02.476039    5492 main.go:141] libmachine: STDOUT: 
	I0814 17:55:02.476059    5492 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:55:02.476078    5492 client.go:171] duration metric: took 238.628042ms to LocalClient.Create
	I0814 17:55:04.478267    5492 start.go:128] duration metric: took 2.266073625s to createHost
	I0814 17:55:04.478314    5492 start.go:83] releasing machines lock for "old-k8s-version-637000", held for 2.266166s
	W0814 17:55:04.478373    5492 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:55:04.489387    5492 out.go:177] * Deleting "old-k8s-version-637000" in qemu2 ...
	W0814 17:55:04.526192    5492 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:55:04.526219    5492 start.go:729] Will try again in 5 seconds ...
	I0814 17:55:09.528244    5492 start.go:360] acquireMachinesLock for old-k8s-version-637000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:55:09.528769    5492 start.go:364] duration metric: took 440.541µs to acquireMachinesLock for "old-k8s-version-637000"
	I0814 17:55:09.528883    5492 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-637000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-637000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mount
Options:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:55:09.529187    5492 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:55:09.539782    5492 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0814 17:55:09.590430    5492 start.go:159] libmachine.API.Create for "old-k8s-version-637000" (driver="qemu2")
	I0814 17:55:09.590468    5492 client.go:168] LocalClient.Create starting
	I0814 17:55:09.590576    5492 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:55:09.590640    5492 main.go:141] libmachine: Decoding PEM data...
	I0814 17:55:09.590657    5492 main.go:141] libmachine: Parsing certificate...
	I0814 17:55:09.590716    5492 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:55:09.590762    5492 main.go:141] libmachine: Decoding PEM data...
	I0814 17:55:09.590773    5492 main.go:141] libmachine: Parsing certificate...
	I0814 17:55:09.591259    5492 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:55:09.753533    5492 main.go:141] libmachine: Creating SSH key...
	I0814 17:55:09.900944    5492 main.go:141] libmachine: Creating Disk image...
	I0814 17:55:09.900950    5492 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:55:09.901175    5492 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/disk.qcow2
	I0814 17:55:09.910686    5492 main.go:141] libmachine: STDOUT: 
	I0814 17:55:09.910706    5492 main.go:141] libmachine: STDERR: 
	I0814 17:55:09.910773    5492 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/disk.qcow2 +20000M
	I0814 17:55:09.918752    5492 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:55:09.918767    5492 main.go:141] libmachine: STDERR: 
	I0814 17:55:09.918778    5492 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/disk.qcow2
	I0814 17:55:09.918783    5492 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:55:09.918804    5492 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:55:09.918830    5492 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/qemu.pid -device virtio-net-pci,netdev=net0,mac=1a:94:d4:65:e0:54 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/disk.qcow2
	I0814 17:55:09.920419    5492 main.go:141] libmachine: STDOUT: 
	I0814 17:55:09.920435    5492 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:55:09.920447    5492 client.go:171] duration metric: took 329.983584ms to LocalClient.Create
	I0814 17:55:11.922569    5492 start.go:128] duration metric: took 2.393418291s to createHost
	I0814 17:55:11.922630    5492 start.go:83] releasing machines lock for "old-k8s-version-637000", held for 2.393896041s
	W0814 17:55:11.922999    5492 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p old-k8s-version-637000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p old-k8s-version-637000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:55:11.934394    5492 out.go:177] 
	W0814 17:55:11.939622    5492 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:55:11.939648    5492 out.go:239] * 
	* 
	W0814 17:55:11.942322    5492 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:55:11.951535    5492 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-arm64 start -p old-k8s-version-637000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=qemu2  --kubernetes-version=v1.20.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-637000 -n old-k8s-version-637000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-637000 -n old-k8s-version-637000: exit status 7 (68.107333ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-637000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (9.94s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (0.09s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-637000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context old-k8s-version-637000 create -f testdata/busybox.yaml: exit status 1 (29.432833ms)

                                                
                                                
** stderr ** 
	error: context "old-k8s-version-637000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context old-k8s-version-637000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-637000 -n old-k8s-version-637000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-637000 -n old-k8s-version-637000: exit status 7 (30.368166ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-637000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-637000 -n old-k8s-version-637000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-637000 -n old-k8s-version-637000: exit status 7 (30.579458ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-637000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/DeployApp (0.09s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.11s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-arm64 addons enable metrics-server -p old-k8s-version-637000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-637000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context old-k8s-version-637000 describe deploy/metrics-server -n kube-system: exit status 1 (26.32175ms)

                                                
                                                
** stderr ** 
	error: context "old-k8s-version-637000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context old-k8s-version-637000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-637000 -n old-k8s-version-637000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-637000 -n old-k8s-version-637000: exit status 7 (29.549958ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-637000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.11s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (5.26s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-arm64 start -p old-k8s-version-637000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=qemu2  --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p old-k8s-version-637000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=qemu2  --kubernetes-version=v1.20.0: exit status 80 (5.19060325s)

                                                
                                                
-- stdout --
	* [old-k8s-version-637000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Kubernetes 1.31.0 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.0
	* Using the qemu2 driver based on existing profile
	* Starting "old-k8s-version-637000" primary control-plane node in "old-k8s-version-637000" cluster
	* Restarting existing qemu2 VM for "old-k8s-version-637000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "old-k8s-version-637000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:55:15.162728    5543 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:55:15.162889    5543 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:55:15.162892    5543 out.go:304] Setting ErrFile to fd 2...
	I0814 17:55:15.162894    5543 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:55:15.163015    5543 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:55:15.163984    5543 out.go:298] Setting JSON to false
	I0814 17:55:15.179821    5543 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3278,"bootTime":1723680037,"procs":459,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:55:15.179897    5543 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:55:15.184547    5543 out.go:177] * [old-k8s-version-637000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:55:15.191560    5543 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:55:15.191616    5543 notify.go:220] Checking for updates...
	I0814 17:55:15.199519    5543 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:55:15.202533    5543 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:55:15.205429    5543 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:55:15.208531    5543 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:55:15.211539    5543 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:55:15.214867    5543 config.go:182] Loaded profile config "old-k8s-version-637000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.20.0
	I0814 17:55:15.218464    5543 out.go:177] * Kubernetes 1.31.0 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.0
	I0814 17:55:15.221491    5543 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:55:15.225461    5543 out.go:177] * Using the qemu2 driver based on existing profile
	I0814 17:55:15.232532    5543 start.go:297] selected driver: qemu2
	I0814 17:55:15.232539    5543 start.go:901] validating driver "qemu2" against &{Name:old-k8s-version-637000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-637000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:
0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:55:15.232620    5543 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:55:15.234942    5543 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0814 17:55:15.234969    5543 cni.go:84] Creating CNI manager for ""
	I0814 17:55:15.234977    5543 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0814 17:55:15.235000    5543 start.go:340] cluster config:
	{Name:old-k8s-version-637000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-637000 Namespace:default
APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount
9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:55:15.238604    5543 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:55:15.247506    5543 out.go:177] * Starting "old-k8s-version-637000" primary control-plane node in "old-k8s-version-637000" cluster
	I0814 17:55:15.251522    5543 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0814 17:55:15.251539    5543 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4
	I0814 17:55:15.251554    5543 cache.go:56] Caching tarball of preloaded images
	I0814 17:55:15.251625    5543 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:55:15.251631    5543 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I0814 17:55:15.251700    5543 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/old-k8s-version-637000/config.json ...
	I0814 17:55:15.252202    5543 start.go:360] acquireMachinesLock for old-k8s-version-637000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:55:15.252234    5543 start.go:364] duration metric: took 24.75µs to acquireMachinesLock for "old-k8s-version-637000"
	I0814 17:55:15.252243    5543 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:55:15.252248    5543 fix.go:54] fixHost starting: 
	I0814 17:55:15.252381    5543 fix.go:112] recreateIfNeeded on old-k8s-version-637000: state=Stopped err=<nil>
	W0814 17:55:15.252390    5543 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:55:15.256494    5543 out.go:177] * Restarting existing qemu2 VM for "old-k8s-version-637000" ...
	I0814 17:55:15.264447    5543 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:55:15.264485    5543 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/qemu.pid -device virtio-net-pci,netdev=net0,mac=1a:94:d4:65:e0:54 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/disk.qcow2
	I0814 17:55:15.266561    5543 main.go:141] libmachine: STDOUT: 
	I0814 17:55:15.266583    5543 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:55:15.266612    5543 fix.go:56] duration metric: took 14.363958ms for fixHost
	I0814 17:55:15.266617    5543 start.go:83] releasing machines lock for "old-k8s-version-637000", held for 14.378709ms
	W0814 17:55:15.266623    5543 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:55:15.266653    5543 out.go:239] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:55:15.266661    5543 start.go:729] Will try again in 5 seconds ...
	I0814 17:55:20.268688    5543 start.go:360] acquireMachinesLock for old-k8s-version-637000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:55:20.269072    5543 start.go:364] duration metric: took 291.959µs to acquireMachinesLock for "old-k8s-version-637000"
	I0814 17:55:20.269236    5543 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:55:20.269254    5543 fix.go:54] fixHost starting: 
	I0814 17:55:20.270004    5543 fix.go:112] recreateIfNeeded on old-k8s-version-637000: state=Stopped err=<nil>
	W0814 17:55:20.270029    5543 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:55:20.278602    5543 out.go:177] * Restarting existing qemu2 VM for "old-k8s-version-637000" ...
	I0814 17:55:20.282590    5543 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:55:20.282833    5543 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/qemu.pid -device virtio-net-pci,netdev=net0,mac=1a:94:d4:65:e0:54 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/old-k8s-version-637000/disk.qcow2
	I0814 17:55:20.291903    5543 main.go:141] libmachine: STDOUT: 
	I0814 17:55:20.291985    5543 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:55:20.292062    5543 fix.go:56] duration metric: took 22.808167ms for fixHost
	I0814 17:55:20.292079    5543 start.go:83] releasing machines lock for "old-k8s-version-637000", held for 22.96375ms
	W0814 17:55:20.292259    5543 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p old-k8s-version-637000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p old-k8s-version-637000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:55:20.299499    5543 out.go:177] 
	W0814 17:55:20.302615    5543 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:55:20.302652    5543 out.go:239] * 
	* 
	W0814 17:55:20.305260    5543 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:55:20.312497    5543 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-arm64 start -p old-k8s-version-637000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=qemu2  --kubernetes-version=v1.20.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-637000 -n old-k8s-version-637000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-637000 -n old-k8s-version-637000: exit status 7 (70.649834ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-637000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (5.26s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (0.03s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "old-k8s-version-637000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-637000 -n old-k8s-version-637000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-637000 -n old-k8s-version-637000: exit status 7 (32.500666ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-637000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (0.03s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (0.06s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "old-k8s-version-637000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-637000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context old-k8s-version-637000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (26.054375ms)

                                                
                                                
** stderr ** 
	error: context "old-k8s-version-637000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context old-k8s-version-637000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-637000 -n old-k8s-version-637000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-637000 -n old-k8s-version-637000: exit status 7 (30.580209ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-637000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (0.06s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-arm64 -p old-k8s-version-637000 image list --format=json
start_stop_delete_test.go:304: v1.20.0 images missing (-want +got):
[]string{
- 	"k8s.gcr.io/coredns:1.7.0",
- 	"k8s.gcr.io/etcd:3.4.13-0",
- 	"k8s.gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"k8s.gcr.io/kube-apiserver:v1.20.0",
- 	"k8s.gcr.io/kube-controller-manager:v1.20.0",
- 	"k8s.gcr.io/kube-proxy:v1.20.0",
- 	"k8s.gcr.io/kube-scheduler:v1.20.0",
- 	"k8s.gcr.io/pause:3.2",
}
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-637000 -n old-k8s-version-637000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-637000 -n old-k8s-version-637000: exit status 7 (30.235334ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-637000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.07s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (0.1s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-arm64 pause -p old-k8s-version-637000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-arm64 pause -p old-k8s-version-637000 --alsologtostderr -v=1: exit status 83 (42.135291ms)

                                                
                                                
-- stdout --
	* The control-plane node old-k8s-version-637000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p old-k8s-version-637000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:55:20.587506    5562 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:55:20.587989    5562 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:55:20.587994    5562 out.go:304] Setting ErrFile to fd 2...
	I0814 17:55:20.587996    5562 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:55:20.588177    5562 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:55:20.588378    5562 out.go:298] Setting JSON to false
	I0814 17:55:20.588387    5562 mustload.go:65] Loading cluster: old-k8s-version-637000
	I0814 17:55:20.588576    5562 config.go:182] Loaded profile config "old-k8s-version-637000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.20.0
	I0814 17:55:20.593147    5562 out.go:177] * The control-plane node old-k8s-version-637000 host is not running: state=Stopped
	I0814 17:55:20.596159    5562 out.go:177]   To start a cluster, run: "minikube start -p old-k8s-version-637000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-arm64 pause -p old-k8s-version-637000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-637000 -n old-k8s-version-637000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-637000 -n old-k8s-version-637000: exit status 7 (30.362208ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-637000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-637000 -n old-k8s-version-637000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-637000 -n old-k8s-version-637000: exit status 7 (29.81125ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-637000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/Pause (0.10s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (9.94s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-arm64 start -p no-preload-064000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.31.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p no-preload-064000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.31.0: exit status 80 (9.86703525s)

                                                
                                                
-- stdout --
	* [no-preload-064000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "no-preload-064000" primary control-plane node in "no-preload-064000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "no-preload-064000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:55:21.008114    5586 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:55:21.008254    5586 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:55:21.008258    5586 out.go:304] Setting ErrFile to fd 2...
	I0814 17:55:21.008260    5586 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:55:21.008394    5586 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:55:21.009499    5586 out.go:298] Setting JSON to false
	I0814 17:55:21.025481    5586 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3284,"bootTime":1723680037,"procs":459,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:55:21.025544    5586 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:55:21.029241    5586 out.go:177] * [no-preload-064000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:55:21.036100    5586 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:55:21.036134    5586 notify.go:220] Checking for updates...
	I0814 17:55:21.042068    5586 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:55:21.046123    5586 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:55:21.049111    5586 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:55:21.052022    5586 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:55:21.055097    5586 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:55:21.058480    5586 config.go:182] Loaded profile config "cert-expiration-172000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:55:21.058538    5586 config.go:182] Loaded profile config "multinode-628000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:55:21.058580    5586 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:55:21.062088    5586 out.go:177] * Using the qemu2 driver based on user configuration
	I0814 17:55:21.069113    5586 start.go:297] selected driver: qemu2
	I0814 17:55:21.069119    5586 start.go:901] validating driver "qemu2" against <nil>
	I0814 17:55:21.069125    5586 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:55:21.071345    5586 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0814 17:55:21.074150    5586 out.go:177] * Automatically selected the socket_vmnet network
	I0814 17:55:21.077179    5586 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0814 17:55:21.077228    5586 cni.go:84] Creating CNI manager for ""
	I0814 17:55:21.077235    5586 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:55:21.077246    5586 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0814 17:55:21.077279    5586 start.go:340] cluster config:
	{Name:no-preload-064000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:no-preload-064000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Container
Runtime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket
_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:55:21.080805    5586 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:55:21.088086    5586 out.go:177] * Starting "no-preload-064000" primary control-plane node in "no-preload-064000" cluster
	I0814 17:55:21.092165    5586 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:55:21.092255    5586 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/no-preload-064000/config.json ...
	I0814 17:55:21.092275    5586 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/no-preload-064000/config.json: {Name:mkb2a789c4fc1db3eb5444f338f5a5ca6861703a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:55:21.092264    5586 cache.go:107] acquiring lock: {Name:mkfb2a02c93df7684ceeb9294fe33d944a3bb658 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:55:21.092270    5586 cache.go:107] acquiring lock: {Name:mk0304140ff00df018778325ec25c4018977fe26 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:55:21.092307    5586 cache.go:107] acquiring lock: {Name:mkd8245903ab4dbb47eefa29d57de4b64041986c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:55:21.092321    5586 cache.go:107] acquiring lock: {Name:mk0060d3df1e40ec70b68d8d023a67954ec1aa05 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:55:21.092347    5586 cache.go:107] acquiring lock: {Name:mk2d7e87f202540e2ba035581776414f765494b0 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:55:21.092309    5586 cache.go:107] acquiring lock: {Name:mkfb9f6efd773e1351d243ffe71827b67a4da0b5 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:55:21.092390    5586 cache.go:107] acquiring lock: {Name:mk9a98c0460e7c034a1aa3a3332be438a3ce3548 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:55:21.092437    5586 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.31.0
	I0814 17:55:21.092478    5586 cache.go:107] acquiring lock: {Name:mk0fc162fdeb990fbe7afcfd830cb2ebe47fbb0b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:55:21.092514    5586 image.go:135] retrieving image: registry.k8s.io/pause:3.10
	I0814 17:55:21.092593    5586 image.go:135] retrieving image: registry.k8s.io/coredns/coredns:v1.11.1
	I0814 17:55:21.092632    5586 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.31.0
	I0814 17:55:21.092650    5586 image.go:135] retrieving image: registry.k8s.io/etcd:3.5.15-0
	I0814 17:55:21.092664    5586 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.31.0
	I0814 17:55:21.092739    5586 cache.go:115] /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I0814 17:55:21.092752    5586 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 490µs
	I0814 17:55:21.092760    5586 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I0814 17:55:21.092770    5586 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.31.0
	I0814 17:55:21.092774    5586 start.go:360] acquireMachinesLock for no-preload-064000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:55:21.092807    5586 start.go:364] duration metric: took 27.625µs to acquireMachinesLock for "no-preload-064000"
	I0814 17:55:21.092819    5586 start.go:93] Provisioning new machine with config: &{Name:no-preload-064000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.31.0 ClusterName:no-preload-064000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOption
s:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:55:21.092850    5586 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:55:21.101133    5586 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0814 17:55:21.105201    5586 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.31.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.31.0
	I0814 17:55:21.106024    5586 image.go:178] daemon lookup for registry.k8s.io/etcd:3.5.15-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.15-0
	I0814 17:55:21.106112    5586 image.go:178] daemon lookup for registry.k8s.io/pause:3.10: Error response from daemon: No such image: registry.k8s.io/pause:3.10
	I0814 17:55:21.106147    5586 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.31.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.31.0
	I0814 17:55:21.106154    5586 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.31.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.31.0
	I0814 17:55:21.107311    5586 image.go:178] daemon lookup for registry.k8s.io/coredns/coredns:v1.11.1: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.11.1
	I0814 17:55:21.107435    5586 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.31.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.31.0
	I0814 17:55:21.118154    5586 start.go:159] libmachine.API.Create for "no-preload-064000" (driver="qemu2")
	I0814 17:55:21.118178    5586 client.go:168] LocalClient.Create starting
	I0814 17:55:21.118239    5586 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:55:21.118270    5586 main.go:141] libmachine: Decoding PEM data...
	I0814 17:55:21.118278    5586 main.go:141] libmachine: Parsing certificate...
	I0814 17:55:21.118318    5586 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:55:21.118344    5586 main.go:141] libmachine: Decoding PEM data...
	I0814 17:55:21.118352    5586 main.go:141] libmachine: Parsing certificate...
	I0814 17:55:21.118676    5586 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:55:21.272563    5586 main.go:141] libmachine: Creating SSH key...
	I0814 17:55:21.405826    5586 main.go:141] libmachine: Creating Disk image...
	I0814 17:55:21.405848    5586 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:55:21.406068    5586 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/disk.qcow2
	I0814 17:55:21.415496    5586 main.go:141] libmachine: STDOUT: 
	I0814 17:55:21.415517    5586 main.go:141] libmachine: STDERR: 
	I0814 17:55:21.415576    5586 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/disk.qcow2 +20000M
	I0814 17:55:21.423702    5586 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:55:21.423720    5586 main.go:141] libmachine: STDERR: 
	I0814 17:55:21.423733    5586 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/disk.qcow2
	I0814 17:55:21.423737    5586 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:55:21.423756    5586 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:55:21.423779    5586 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/qemu.pid -device virtio-net-pci,netdev=net0,mac=c2:2d:ce:26:8f:a5 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/disk.qcow2
	I0814 17:55:21.425509    5586 main.go:141] libmachine: STDOUT: 
	I0814 17:55:21.425527    5586 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:55:21.425547    5586 client.go:171] duration metric: took 307.373958ms to LocalClient.Create
	I0814 17:55:21.530067    5586 cache.go:162] opening:  /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0
	I0814 17:55:21.542779    5586 cache.go:162] opening:  /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10
	I0814 17:55:21.543090    5586 cache.go:162] opening:  /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0
	I0814 17:55:21.565654    5586 cache.go:162] opening:  /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0
	I0814 17:55:21.582241    5586 cache.go:162] opening:  /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0
	I0814 17:55:21.586822    5586 cache.go:162] opening:  /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1
	I0814 17:55:21.596354    5586 cache.go:162] opening:  /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0
	I0814 17:55:21.676150    5586 cache.go:157] /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 exists
	I0814 17:55:21.676209    5586 cache.go:96] cache image "registry.k8s.io/pause:3.10" -> "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10" took 583.893792ms
	I0814 17:55:21.676238    5586 cache.go:80] save to tar file registry.k8s.io/pause:3.10 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 succeeded
	I0814 17:55:23.425662    5586 start.go:128] duration metric: took 2.332851583s to createHost
	I0814 17:55:23.425723    5586 start.go:83] releasing machines lock for "no-preload-064000", held for 2.332965916s
	W0814 17:55:23.425796    5586 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:55:23.434871    5586 out.go:177] * Deleting "no-preload-064000" in qemu2 ...
	W0814 17:55:23.464253    5586 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:55:23.464285    5586 start.go:729] Will try again in 5 seconds ...
	I0814 17:55:24.517972    5586 cache.go:157] /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0 exists
	I0814 17:55:24.518027    5586 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.31.0" -> "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0" took 3.425678834s
	I0814 17:55:24.518064    5586 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.31.0 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0 succeeded
	I0814 17:55:24.896695    5586 cache.go:157] /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0 exists
	I0814 17:55:24.896751    5586 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.31.0" -> "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0" took 3.804582917s
	I0814 17:55:24.896784    5586 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.31.0 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0 succeeded
	I0814 17:55:25.041418    5586 cache.go:157] /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0 exists
	I0814 17:55:25.041463    5586 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.31.0" -> "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0" took 3.949288583s
	I0814 17:55:25.041490    5586 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.31.0 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0 succeeded
	I0814 17:55:25.134215    5586 cache.go:157] /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 exists
	I0814 17:55:25.134251    5586 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.1" -> "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1" took 4.042009417s
	I0814 17:55:25.134284    5586 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.1 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 succeeded
	I0814 17:55:26.153834    5586 cache.go:157] /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0 exists
	I0814 17:55:26.153880    5586 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.31.0" -> "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0" took 5.061643333s
	I0814 17:55:26.153940    5586 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.31.0 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0 succeeded
	I0814 17:55:28.464446    5586 start.go:360] acquireMachinesLock for no-preload-064000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:55:28.464931    5586 start.go:364] duration metric: took 405.584µs to acquireMachinesLock for "no-preload-064000"
	I0814 17:55:28.465051    5586 start.go:93] Provisioning new machine with config: &{Name:no-preload-064000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.31.0 ClusterName:no-preload-064000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOption
s:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:55:28.465333    5586 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:55:28.470882    5586 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0814 17:55:28.522151    5586 start.go:159] libmachine.API.Create for "no-preload-064000" (driver="qemu2")
	I0814 17:55:28.522208    5586 client.go:168] LocalClient.Create starting
	I0814 17:55:28.522354    5586 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:55:28.522441    5586 main.go:141] libmachine: Decoding PEM data...
	I0814 17:55:28.522463    5586 main.go:141] libmachine: Parsing certificate...
	I0814 17:55:28.522549    5586 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:55:28.522597    5586 main.go:141] libmachine: Decoding PEM data...
	I0814 17:55:28.522613    5586 main.go:141] libmachine: Parsing certificate...
	I0814 17:55:28.523193    5586 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:55:28.685485    5586 main.go:141] libmachine: Creating SSH key...
	I0814 17:55:28.782430    5586 main.go:141] libmachine: Creating Disk image...
	I0814 17:55:28.782436    5586 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:55:28.782623    5586 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/disk.qcow2
	I0814 17:55:28.792095    5586 main.go:141] libmachine: STDOUT: 
	I0814 17:55:28.792112    5586 main.go:141] libmachine: STDERR: 
	I0814 17:55:28.792175    5586 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/disk.qcow2 +20000M
	I0814 17:55:28.800097    5586 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:55:28.800119    5586 main.go:141] libmachine: STDERR: 
	I0814 17:55:28.800130    5586 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/disk.qcow2
	I0814 17:55:28.800137    5586 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:55:28.800145    5586 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:55:28.800190    5586 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/qemu.pid -device virtio-net-pci,netdev=net0,mac=3e:5c:cb:54:e0:99 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/disk.qcow2
	I0814 17:55:28.801860    5586 main.go:141] libmachine: STDOUT: 
	I0814 17:55:28.801877    5586 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:55:28.801890    5586 client.go:171] duration metric: took 279.682959ms to LocalClient.Create
	I0814 17:55:29.458779    5586 cache.go:157] /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 exists
	I0814 17:55:29.458854    5586 cache.go:96] cache image "registry.k8s.io/etcd:3.5.15-0" -> "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0" took 8.366758833s
	I0814 17:55:29.458930    5586 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.15-0 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 succeeded
	I0814 17:55:29.458993    5586 cache.go:87] Successfully saved all images to host disk.
	I0814 17:55:30.804107    5586 start.go:128] duration metric: took 2.338787583s to createHost
	I0814 17:55:30.804175    5586 start.go:83] releasing machines lock for "no-preload-064000", held for 2.339278542s
	W0814 17:55:30.804580    5586 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p no-preload-064000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p no-preload-064000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:55:30.818203    5586 out.go:177] 
	W0814 17:55:30.822145    5586 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:55:30.822200    5586 out.go:239] * 
	* 
	W0814 17:55:30.824684    5586 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:55:30.833240    5586 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-arm64 start -p no-preload-064000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.31.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-064000 -n no-preload-064000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-064000 -n no-preload-064000: exit status 7 (66.628833ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-064000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/FirstStart (9.94s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (0.09s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-064000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context no-preload-064000 create -f testdata/busybox.yaml: exit status 1 (29.52ms)

                                                
                                                
** stderr ** 
	error: context "no-preload-064000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context no-preload-064000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-064000 -n no-preload-064000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-064000 -n no-preload-064000: exit status 7 (30.773917ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-064000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-064000 -n no-preload-064000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-064000 -n no-preload-064000: exit status 7 (29.856459ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-064000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/DeployApp (0.09s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.12s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-arm64 addons enable metrics-server -p no-preload-064000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-064000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context no-preload-064000 describe deploy/metrics-server -n kube-system: exit status 1 (27.166667ms)

                                                
                                                
** stderr ** 
	error: context "no-preload-064000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context no-preload-064000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-064000 -n no-preload-064000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-064000 -n no-preload-064000: exit status 7 (30.720292ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-064000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.12s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (5.25s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-arm64 start -p no-preload-064000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.31.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p no-preload-064000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.31.0: exit status 80 (5.180417292s)

                                                
                                                
-- stdout --
	* [no-preload-064000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting "no-preload-064000" primary control-plane node in "no-preload-064000" cluster
	* Restarting existing qemu2 VM for "no-preload-064000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "no-preload-064000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:55:34.649891    5665 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:55:34.650027    5665 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:55:34.650030    5665 out.go:304] Setting ErrFile to fd 2...
	I0814 17:55:34.650033    5665 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:55:34.650172    5665 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:55:34.651179    5665 out.go:298] Setting JSON to false
	I0814 17:55:34.667164    5665 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3297,"bootTime":1723680037,"procs":459,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:55:34.667230    5665 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:55:34.672117    5665 out.go:177] * [no-preload-064000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:55:34.679097    5665 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:55:34.679160    5665 notify.go:220] Checking for updates...
	I0814 17:55:34.686072    5665 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:55:34.689095    5665 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:55:34.692056    5665 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:55:34.695071    5665 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:55:34.697991    5665 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:55:34.701301    5665 config.go:182] Loaded profile config "no-preload-064000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:55:34.701570    5665 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:55:34.706035    5665 out.go:177] * Using the qemu2 driver based on existing profile
	I0814 17:55:34.713051    5665 start.go:297] selected driver: qemu2
	I0814 17:55:34.713058    5665 start.go:901] validating driver "qemu2" against &{Name:no-preload-064000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.0 ClusterName:no-preload-064000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 Cert
Expiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:55:34.713112    5665 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:55:34.715496    5665 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0814 17:55:34.715525    5665 cni.go:84] Creating CNI manager for ""
	I0814 17:55:34.715533    5665 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:55:34.715571    5665 start.go:340] cluster config:
	{Name:no-preload-064000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:no-preload-064000 Namespace:default APIServe
rHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVers
ion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:55:34.719216    5665 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:55:34.725000    5665 out.go:177] * Starting "no-preload-064000" primary control-plane node in "no-preload-064000" cluster
	I0814 17:55:34.729053    5665 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:55:34.729160    5665 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/no-preload-064000/config.json ...
	I0814 17:55:34.729163    5665 cache.go:107] acquiring lock: {Name:mkfb2a02c93df7684ceeb9294fe33d944a3bb658 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:55:34.729178    5665 cache.go:107] acquiring lock: {Name:mk9a98c0460e7c034a1aa3a3332be438a3ce3548 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:55:34.729215    5665 cache.go:107] acquiring lock: {Name:mk0060d3df1e40ec70b68d8d023a67954ec1aa05 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:55:34.729229    5665 cache.go:115] /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I0814 17:55:34.729234    5665 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 80.709µs
	I0814 17:55:34.729240    5665 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I0814 17:55:34.729253    5665 cache.go:107] acquiring lock: {Name:mkfb9f6efd773e1351d243ffe71827b67a4da0b5 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:55:34.729259    5665 cache.go:115] /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0 exists
	I0814 17:55:34.729265    5665 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.31.0" -> "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0" took 99.625µs
	I0814 17:55:34.729290    5665 cache.go:115] /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 exists
	I0814 17:55:34.729292    5665 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.31.0 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0 succeeded
	I0814 17:55:34.729287    5665 cache.go:115] /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 exists
	I0814 17:55:34.729293    5665 cache.go:107] acquiring lock: {Name:mk0fc162fdeb990fbe7afcfd830cb2ebe47fbb0b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:55:34.729300    5665 cache.go:107] acquiring lock: {Name:mkd8245903ab4dbb47eefa29d57de4b64041986c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:55:34.729300    5665 cache.go:96] cache image "registry.k8s.io/pause:3.10" -> "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10" took 107.041µs
	I0814 17:55:34.729335    5665 cache.go:115] /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0 exists
	I0814 17:55:34.729293    5665 cache.go:96] cache image "registry.k8s.io/etcd:3.5.15-0" -> "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0" took 41.541µs
	I0814 17:55:34.729341    5665 cache.go:115] /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0 exists
	I0814 17:55:34.729345    5665 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.31.0" -> "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0" took 46.417µs
	I0814 17:55:34.729342    5665 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.31.0" -> "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0" took 50.208µs
	I0814 17:55:34.729351    5665 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.31.0 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0 succeeded
	I0814 17:55:34.729353    5665 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.31.0 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0 succeeded
	I0814 17:55:34.729342    5665 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.15-0 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 succeeded
	I0814 17:55:34.729330    5665 cache.go:80] save to tar file registry.k8s.io/pause:3.10 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 succeeded
	I0814 17:55:34.729340    5665 cache.go:107] acquiring lock: {Name:mk0304140ff00df018778325ec25c4018977fe26 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:55:34.729393    5665 cache.go:107] acquiring lock: {Name:mk2d7e87f202540e2ba035581776414f765494b0 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:55:34.729424    5665 cache.go:115] /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0 exists
	I0814 17:55:34.729432    5665 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.31.0" -> "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0" took 279.375µs
	I0814 17:55:34.729436    5665 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.31.0 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0 succeeded
	I0814 17:55:34.729441    5665 cache.go:115] /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 exists
	I0814 17:55:34.729444    5665 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.1" -> "/Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1" took 106.084µs
	I0814 17:55:34.729449    5665 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.1 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 succeeded
	I0814 17:55:34.729454    5665 cache.go:87] Successfully saved all images to host disk.
	I0814 17:55:34.729605    5665 start.go:360] acquireMachinesLock for no-preload-064000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:55:34.729639    5665 start.go:364] duration metric: took 27.125µs to acquireMachinesLock for "no-preload-064000"
	I0814 17:55:34.729651    5665 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:55:34.729658    5665 fix.go:54] fixHost starting: 
	I0814 17:55:34.729779    5665 fix.go:112] recreateIfNeeded on no-preload-064000: state=Stopped err=<nil>
	W0814 17:55:34.729787    5665 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:55:34.738046    5665 out.go:177] * Restarting existing qemu2 VM for "no-preload-064000" ...
	I0814 17:55:34.741023    5665 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:55:34.741060    5665 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/qemu.pid -device virtio-net-pci,netdev=net0,mac=3e:5c:cb:54:e0:99 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/disk.qcow2
	I0814 17:55:34.743181    5665 main.go:141] libmachine: STDOUT: 
	I0814 17:55:34.743203    5665 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:55:34.743235    5665 fix.go:56] duration metric: took 13.579583ms for fixHost
	I0814 17:55:34.743240    5665 start.go:83] releasing machines lock for "no-preload-064000", held for 13.59775ms
	W0814 17:55:34.743246    5665 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:55:34.743282    5665 out.go:239] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:55:34.743286    5665 start.go:729] Will try again in 5 seconds ...
	I0814 17:55:39.745343    5665 start.go:360] acquireMachinesLock for no-preload-064000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:55:39.745725    5665 start.go:364] duration metric: took 296.25µs to acquireMachinesLock for "no-preload-064000"
	I0814 17:55:39.745857    5665 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:55:39.745876    5665 fix.go:54] fixHost starting: 
	I0814 17:55:39.746566    5665 fix.go:112] recreateIfNeeded on no-preload-064000: state=Stopped err=<nil>
	W0814 17:55:39.746594    5665 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:55:39.751105    5665 out.go:177] * Restarting existing qemu2 VM for "no-preload-064000" ...
	I0814 17:55:39.757936    5665 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:55:39.758164    5665 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/qemu.pid -device virtio-net-pci,netdev=net0,mac=3e:5c:cb:54:e0:99 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/no-preload-064000/disk.qcow2
	I0814 17:55:39.767015    5665 main.go:141] libmachine: STDOUT: 
	I0814 17:55:39.767077    5665 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:55:39.767140    5665 fix.go:56] duration metric: took 21.261583ms for fixHost
	I0814 17:55:39.767160    5665 start.go:83] releasing machines lock for "no-preload-064000", held for 21.401958ms
	W0814 17:55:39.767377    5665 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p no-preload-064000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p no-preload-064000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:55:39.775993    5665 out.go:177] 
	W0814 17:55:39.779136    5665 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:55:39.779160    5665 out.go:239] * 
	* 
	W0814 17:55:39.781875    5665 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:55:39.793024    5665 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-arm64 start -p no-preload-064000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.31.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-064000 -n no-preload-064000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-064000 -n no-preload-064000: exit status 7 (71.633375ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-064000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/SecondStart (5.25s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (0.03s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "no-preload-064000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-064000 -n no-preload-064000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-064000 -n no-preload-064000: exit status 7 (33.064625ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-064000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (0.03s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (0.06s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "no-preload-064000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-064000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context no-preload-064000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (26.36425ms)

                                                
                                                
** stderr ** 
	error: context "no-preload-064000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context no-preload-064000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-064000 -n no-preload-064000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-064000 -n no-preload-064000: exit status 7 (30.609334ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-064000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (0.06s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-arm64 -p no-preload-064000 image list --format=json
start_stop_delete_test.go:304: v1.31.0 images missing (-want +got):
[]string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.11.1",
- 	"registry.k8s.io/etcd:3.5.15-0",
- 	"registry.k8s.io/kube-apiserver:v1.31.0",
- 	"registry.k8s.io/kube-controller-manager:v1.31.0",
- 	"registry.k8s.io/kube-proxy:v1.31.0",
- 	"registry.k8s.io/kube-scheduler:v1.31.0",
- 	"registry.k8s.io/pause:3.10",
}
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-064000 -n no-preload-064000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-064000 -n no-preload-064000: exit status 7 (29.358625ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-064000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.07s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (0.1s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-arm64 pause -p no-preload-064000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-arm64 pause -p no-preload-064000 --alsologtostderr -v=1: exit status 83 (40.064125ms)

                                                
                                                
-- stdout --
	* The control-plane node no-preload-064000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p no-preload-064000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:55:40.064033    5684 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:55:40.064202    5684 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:55:40.064205    5684 out.go:304] Setting ErrFile to fd 2...
	I0814 17:55:40.064208    5684 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:55:40.064332    5684 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:55:40.064550    5684 out.go:298] Setting JSON to false
	I0814 17:55:40.064558    5684 mustload.go:65] Loading cluster: no-preload-064000
	I0814 17:55:40.064740    5684 config.go:182] Loaded profile config "no-preload-064000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:55:40.068800    5684 out.go:177] * The control-plane node no-preload-064000 host is not running: state=Stopped
	I0814 17:55:40.071860    5684 out.go:177]   To start a cluster, run: "minikube start -p no-preload-064000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-arm64 pause -p no-preload-064000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-064000 -n no-preload-064000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-064000 -n no-preload-064000: exit status 7 (29.4735ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-064000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-064000 -n no-preload-064000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-064000 -n no-preload-064000: exit status 7 (29.912792ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-064000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/Pause (0.10s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (9.95s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-arm64 start -p default-k8s-diff-port-559000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=qemu2  --kubernetes-version=v1.31.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p default-k8s-diff-port-559000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=qemu2  --kubernetes-version=v1.31.0: exit status 80 (9.878068s)

                                                
                                                
-- stdout --
	* [default-k8s-diff-port-559000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "default-k8s-diff-port-559000" primary control-plane node in "default-k8s-diff-port-559000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "default-k8s-diff-port-559000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:55:40.380125    5701 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:55:40.380258    5701 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:55:40.380261    5701 out.go:304] Setting ErrFile to fd 2...
	I0814 17:55:40.380263    5701 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:55:40.380385    5701 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:55:40.381423    5701 out.go:298] Setting JSON to false
	I0814 17:55:40.397543    5701 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3303,"bootTime":1723680037,"procs":459,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:55:40.397617    5701 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:55:40.402778    5701 out.go:177] * [default-k8s-diff-port-559000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:55:40.409722    5701 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:55:40.409766    5701 notify.go:220] Checking for updates...
	I0814 17:55:40.416738    5701 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:55:40.420768    5701 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:55:40.423753    5701 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:55:40.426772    5701 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:55:40.429723    5701 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:55:40.433195    5701 config.go:182] Loaded profile config "cert-expiration-172000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:55:40.433264    5701 config.go:182] Loaded profile config "multinode-628000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:55:40.433310    5701 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:55:40.437715    5701 out.go:177] * Using the qemu2 driver based on user configuration
	I0814 17:55:40.444750    5701 start.go:297] selected driver: qemu2
	I0814 17:55:40.444758    5701 start.go:901] validating driver "qemu2" against <nil>
	I0814 17:55:40.444764    5701 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:55:40.447242    5701 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0814 17:55:40.450639    5701 out.go:177] * Automatically selected the socket_vmnet network
	I0814 17:55:40.453782    5701 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0814 17:55:40.453800    5701 cni.go:84] Creating CNI manager for ""
	I0814 17:55:40.453812    5701 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:55:40.453816    5701 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0814 17:55:40.453840    5701 start.go:340] cluster config:
	{Name:default-k8s-diff-port-559000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:default-k8s-diff-port-559000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:c
luster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/s
ocket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:55:40.457435    5701 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:55:40.464701    5701 out.go:177] * Starting "default-k8s-diff-port-559000" primary control-plane node in "default-k8s-diff-port-559000" cluster
	I0814 17:55:40.468677    5701 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:55:40.468690    5701 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:55:40.468699    5701 cache.go:56] Caching tarball of preloaded images
	I0814 17:55:40.468752    5701 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:55:40.468757    5701 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:55:40.468825    5701 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/default-k8s-diff-port-559000/config.json ...
	I0814 17:55:40.468836    5701 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/default-k8s-diff-port-559000/config.json: {Name:mk774b3e955b7d7673b7c4a97b208bb8770df8ad Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:55:40.469087    5701 start.go:360] acquireMachinesLock for default-k8s-diff-port-559000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:55:40.469122    5701 start.go:364] duration metric: took 27.334µs to acquireMachinesLock for "default-k8s-diff-port-559000"
	I0814 17:55:40.469135    5701 start.go:93] Provisioning new machine with config: &{Name:default-k8s-diff-port-559000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.31.0 ClusterName:default-k8s-diff-port-559000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMS
ize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8444 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:55:40.469167    5701 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:55:40.477783    5701 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0814 17:55:40.495945    5701 start.go:159] libmachine.API.Create for "default-k8s-diff-port-559000" (driver="qemu2")
	I0814 17:55:40.495972    5701 client.go:168] LocalClient.Create starting
	I0814 17:55:40.496037    5701 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:55:40.496068    5701 main.go:141] libmachine: Decoding PEM data...
	I0814 17:55:40.496080    5701 main.go:141] libmachine: Parsing certificate...
	I0814 17:55:40.496120    5701 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:55:40.496142    5701 main.go:141] libmachine: Decoding PEM data...
	I0814 17:55:40.496148    5701 main.go:141] libmachine: Parsing certificate...
	I0814 17:55:40.496457    5701 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:55:40.649809    5701 main.go:141] libmachine: Creating SSH key...
	I0814 17:55:40.700106    5701 main.go:141] libmachine: Creating Disk image...
	I0814 17:55:40.700113    5701 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:55:40.700280    5701 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/disk.qcow2
	I0814 17:55:40.709262    5701 main.go:141] libmachine: STDOUT: 
	I0814 17:55:40.709280    5701 main.go:141] libmachine: STDERR: 
	I0814 17:55:40.709331    5701 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/disk.qcow2 +20000M
	I0814 17:55:40.717174    5701 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:55:40.717187    5701 main.go:141] libmachine: STDERR: 
	I0814 17:55:40.717199    5701 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/disk.qcow2
	I0814 17:55:40.717206    5701 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:55:40.717217    5701 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:55:40.717244    5701 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/qemu.pid -device virtio-net-pci,netdev=net0,mac=96:9b:58:5d:d9:00 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/disk.qcow2
	I0814 17:55:40.718799    5701 main.go:141] libmachine: STDOUT: 
	I0814 17:55:40.718819    5701 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:55:40.718835    5701 client.go:171] duration metric: took 222.864ms to LocalClient.Create
	I0814 17:55:42.720950    5701 start.go:128] duration metric: took 2.25182675s to createHost
	I0814 17:55:42.721023    5701 start.go:83] releasing machines lock for "default-k8s-diff-port-559000", held for 2.25195125s
	W0814 17:55:42.721081    5701 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:55:42.732026    5701 out.go:177] * Deleting "default-k8s-diff-port-559000" in qemu2 ...
	W0814 17:55:42.767977    5701 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:55:42.768001    5701 start.go:729] Will try again in 5 seconds ...
	I0814 17:55:47.770142    5701 start.go:360] acquireMachinesLock for default-k8s-diff-port-559000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:55:47.770719    5701 start.go:364] duration metric: took 473.375µs to acquireMachinesLock for "default-k8s-diff-port-559000"
	I0814 17:55:47.770863    5701 start.go:93] Provisioning new machine with config: &{Name:default-k8s-diff-port-559000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.31.0 ClusterName:default-k8s-diff-port-559000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMS
ize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8444 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:55:47.771134    5701 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:55:47.789618    5701 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0814 17:55:47.841515    5701 start.go:159] libmachine.API.Create for "default-k8s-diff-port-559000" (driver="qemu2")
	I0814 17:55:47.841568    5701 client.go:168] LocalClient.Create starting
	I0814 17:55:47.841681    5701 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:55:47.841740    5701 main.go:141] libmachine: Decoding PEM data...
	I0814 17:55:47.841758    5701 main.go:141] libmachine: Parsing certificate...
	I0814 17:55:47.841821    5701 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:55:47.841864    5701 main.go:141] libmachine: Decoding PEM data...
	I0814 17:55:47.841874    5701 main.go:141] libmachine: Parsing certificate...
	I0814 17:55:47.842471    5701 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:55:48.003037    5701 main.go:141] libmachine: Creating SSH key...
	I0814 17:55:48.163934    5701 main.go:141] libmachine: Creating Disk image...
	I0814 17:55:48.163941    5701 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:55:48.164150    5701 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/disk.qcow2
	I0814 17:55:48.173701    5701 main.go:141] libmachine: STDOUT: 
	I0814 17:55:48.173716    5701 main.go:141] libmachine: STDERR: 
	I0814 17:55:48.173772    5701 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/disk.qcow2 +20000M
	I0814 17:55:48.181608    5701 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:55:48.181623    5701 main.go:141] libmachine: STDERR: 
	I0814 17:55:48.181634    5701 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/disk.qcow2
	I0814 17:55:48.181640    5701 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:55:48.181650    5701 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:55:48.181683    5701 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/qemu.pid -device virtio-net-pci,netdev=net0,mac=4a:8f:b9:e9:91:a6 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/disk.qcow2
	I0814 17:55:48.183300    5701 main.go:141] libmachine: STDOUT: 
	I0814 17:55:48.183316    5701 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:55:48.183330    5701 client.go:171] duration metric: took 341.767083ms to LocalClient.Create
	I0814 17:55:50.185454    5701 start.go:128] duration metric: took 2.414357791s to createHost
	I0814 17:55:50.185527    5701 start.go:83] releasing machines lock for "default-k8s-diff-port-559000", held for 2.414847667s
	W0814 17:55:50.185831    5701 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p default-k8s-diff-port-559000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p default-k8s-diff-port-559000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:55:50.201400    5701 out.go:177] 
	W0814 17:55:50.205521    5701 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:55:50.205546    5701 out.go:239] * 
	* 
	W0814 17:55:50.208294    5701 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:55:50.217397    5701 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-arm64 start -p default-k8s-diff-port-559000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=qemu2  --kubernetes-version=v1.31.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-559000 -n default-k8s-diff-port-559000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-559000 -n default-k8s-diff-port-559000: exit status 7 (66.252416ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-559000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (9.95s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (0.09s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-559000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-559000 create -f testdata/busybox.yaml: exit status 1 (29.65925ms)

                                                
                                                
** stderr ** 
	error: context "default-k8s-diff-port-559000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context default-k8s-diff-port-559000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-559000 -n default-k8s-diff-port-559000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-559000 -n default-k8s-diff-port-559000: exit status 7 (28.915708ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-559000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-559000 -n default-k8s-diff-port-559000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-559000 -n default-k8s-diff-port-559000: exit status 7 (29.365042ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-559000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (0.09s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (0.12s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-arm64 addons enable metrics-server -p default-k8s-diff-port-559000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-diff-port-559000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-559000 describe deploy/metrics-server -n kube-system: exit status 1 (27.006625ms)

                                                
                                                
** stderr ** 
	error: context "default-k8s-diff-port-559000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context default-k8s-diff-port-559000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-559000 -n default-k8s-diff-port-559000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-559000 -n default-k8s-diff-port-559000: exit status 7 (31.870208ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-559000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (0.12s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (6.59s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-arm64 start -p default-k8s-diff-port-559000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=qemu2  --kubernetes-version=v1.31.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p default-k8s-diff-port-559000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=qemu2  --kubernetes-version=v1.31.0: exit status 80 (6.526061958s)

                                                
                                                
-- stdout --
	* [default-k8s-diff-port-559000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting "default-k8s-diff-port-559000" primary control-plane node in "default-k8s-diff-port-559000" cluster
	* Restarting existing qemu2 VM for "default-k8s-diff-port-559000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "default-k8s-diff-port-559000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:55:54.231095    5762 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:55:54.231230    5762 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:55:54.231233    5762 out.go:304] Setting ErrFile to fd 2...
	I0814 17:55:54.231236    5762 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:55:54.231370    5762 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:55:54.232408    5762 out.go:298] Setting JSON to false
	I0814 17:55:54.248157    5762 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3317,"bootTime":1723680037,"procs":459,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:55:54.248224    5762 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:55:54.252226    5762 out.go:177] * [default-k8s-diff-port-559000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:55:54.258131    5762 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:55:54.258227    5762 notify.go:220] Checking for updates...
	I0814 17:55:54.266065    5762 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:55:54.269130    5762 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:55:54.272119    5762 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:55:54.274997    5762 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:55:54.278067    5762 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:55:54.281453    5762 config.go:182] Loaded profile config "default-k8s-diff-port-559000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:55:54.281714    5762 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:55:54.285065    5762 out.go:177] * Using the qemu2 driver based on existing profile
	I0814 17:55:54.292064    5762 start.go:297] selected driver: qemu2
	I0814 17:55:54.292073    5762 start.go:901] validating driver "qemu2" against &{Name:default-k8s-diff-port-559000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes
Config:{KubernetesVersion:v1.31.0 ClusterName:default-k8s-diff-port-559000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:f
alse ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:55:54.292138    5762 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:55:54.294269    5762 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0814 17:55:54.294297    5762 cni.go:84] Creating CNI manager for ""
	I0814 17:55:54.294304    5762 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:55:54.294334    5762 start.go:340] cluster config:
	{Name:default-k8s-diff-port-559000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:default-k8s-diff-port-559000 Name
space:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/min
ikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:55:54.297678    5762 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:55:54.306084    5762 out.go:177] * Starting "default-k8s-diff-port-559000" primary control-plane node in "default-k8s-diff-port-559000" cluster
	I0814 17:55:54.308985    5762 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:55:54.308999    5762 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:55:54.309009    5762 cache.go:56] Caching tarball of preloaded images
	I0814 17:55:54.309064    5762 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:55:54.309069    5762 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:55:54.309125    5762 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/default-k8s-diff-port-559000/config.json ...
	I0814 17:55:54.309582    5762 start.go:360] acquireMachinesLock for default-k8s-diff-port-559000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:55:54.309619    5762 start.go:364] duration metric: took 30.875µs to acquireMachinesLock for "default-k8s-diff-port-559000"
	I0814 17:55:54.309629    5762 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:55:54.309634    5762 fix.go:54] fixHost starting: 
	I0814 17:55:54.309760    5762 fix.go:112] recreateIfNeeded on default-k8s-diff-port-559000: state=Stopped err=<nil>
	W0814 17:55:54.309768    5762 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:55:54.314145    5762 out.go:177] * Restarting existing qemu2 VM for "default-k8s-diff-port-559000" ...
	I0814 17:55:54.321096    5762 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:55:54.321143    5762 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/qemu.pid -device virtio-net-pci,netdev=net0,mac=4a:8f:b9:e9:91:a6 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/disk.qcow2
	I0814 17:55:54.323278    5762 main.go:141] libmachine: STDOUT: 
	I0814 17:55:54.323298    5762 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:55:54.323321    5762 fix.go:56] duration metric: took 13.687792ms for fixHost
	I0814 17:55:54.323325    5762 start.go:83] releasing machines lock for "default-k8s-diff-port-559000", held for 13.701542ms
	W0814 17:55:54.323332    5762 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:55:54.323367    5762 out.go:239] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:55:54.323372    5762 start.go:729] Will try again in 5 seconds ...
	I0814 17:55:59.324645    5762 start.go:360] acquireMachinesLock for default-k8s-diff-port-559000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:56:00.654799    5762 start.go:364] duration metric: took 1.330078833s to acquireMachinesLock for "default-k8s-diff-port-559000"
	I0814 17:56:00.655000    5762 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:56:00.655023    5762 fix.go:54] fixHost starting: 
	I0814 17:56:00.655809    5762 fix.go:112] recreateIfNeeded on default-k8s-diff-port-559000: state=Stopped err=<nil>
	W0814 17:56:00.655838    5762 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:56:00.665366    5762 out.go:177] * Restarting existing qemu2 VM for "default-k8s-diff-port-559000" ...
	I0814 17:56:00.680433    5762 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:56:00.680688    5762 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/qemu.pid -device virtio-net-pci,netdev=net0,mac=4a:8f:b9:e9:91:a6 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/default-k8s-diff-port-559000/disk.qcow2
	I0814 17:56:00.691592    5762 main.go:141] libmachine: STDOUT: 
	I0814 17:56:00.691659    5762 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:56:00.691801    5762 fix.go:56] duration metric: took 36.779875ms for fixHost
	I0814 17:56:00.691819    5762 start.go:83] releasing machines lock for "default-k8s-diff-port-559000", held for 36.968083ms
	W0814 17:56:00.692318    5762 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p default-k8s-diff-port-559000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p default-k8s-diff-port-559000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:56:00.698425    5762 out.go:177] 
	W0814 17:56:00.702542    5762 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:56:00.702578    5762 out.go:239] * 
	* 
	W0814 17:56:00.704766    5762 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:56:00.714486    5762 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-arm64 start -p default-k8s-diff-port-559000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=qemu2  --kubernetes-version=v1.31.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-559000 -n default-k8s-diff-port-559000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-559000 -n default-k8s-diff-port-559000: exit status 7 (59.659208ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-559000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (6.59s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (10.03s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-arm64 start -p newest-cni-973000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=qemu2  --kubernetes-version=v1.31.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p newest-cni-973000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=qemu2  --kubernetes-version=v1.31.0: exit status 80 (9.962666167s)

                                                
                                                
-- stdout --
	* [newest-cni-973000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "newest-cni-973000" primary control-plane node in "newest-cni-973000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "newest-cni-973000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:55:58.225286    5777 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:55:58.225402    5777 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:55:58.225405    5777 out.go:304] Setting ErrFile to fd 2...
	I0814 17:55:58.225407    5777 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:55:58.225542    5777 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:55:58.226652    5777 out.go:298] Setting JSON to false
	I0814 17:55:58.242875    5777 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3321,"bootTime":1723680037,"procs":461,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:55:58.242936    5777 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:55:58.248310    5777 out.go:177] * [newest-cni-973000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:55:58.256258    5777 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:55:58.256301    5777 notify.go:220] Checking for updates...
	I0814 17:55:58.260192    5777 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:55:58.263199    5777 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:55:58.266179    5777 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:55:58.269131    5777 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:55:58.272197    5777 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:55:58.275590    5777 config.go:182] Loaded profile config "default-k8s-diff-port-559000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:55:58.275657    5777 config.go:182] Loaded profile config "multinode-628000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:55:58.275707    5777 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:55:58.280132    5777 out.go:177] * Using the qemu2 driver based on user configuration
	I0814 17:55:58.287182    5777 start.go:297] selected driver: qemu2
	I0814 17:55:58.287189    5777 start.go:901] validating driver "qemu2" against <nil>
	I0814 17:55:58.287195    5777 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:55:58.289517    5777 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	W0814 17:55:58.289541    5777 out.go:239] ! With --network-plugin=cni, you will need to provide your own CNI. See --cni flag as a user-friendly alternative
	! With --network-plugin=cni, you will need to provide your own CNI. See --cni flag as a user-friendly alternative
	I0814 17:55:58.297232    5777 out.go:177] * Automatically selected the socket_vmnet network
	I0814 17:55:58.300239    5777 start_flags.go:966] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
	I0814 17:55:58.300257    5777 cni.go:84] Creating CNI manager for ""
	I0814 17:55:58.300263    5777 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:55:58.300274    5777 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0814 17:55:58.300298    5777 start.go:340] cluster config:
	{Name:newest-cni-973000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:newest-cni-973000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Container
Runtime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetri
cs:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:55:58.304271    5777 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:55:58.312194    5777 out.go:177] * Starting "newest-cni-973000" primary control-plane node in "newest-cni-973000" cluster
	I0814 17:55:58.315160    5777 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:55:58.315174    5777 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:55:58.315183    5777 cache.go:56] Caching tarball of preloaded images
	I0814 17:55:58.315238    5777 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:55:58.315243    5777 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:55:58.315301    5777 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/newest-cni-973000/config.json ...
	I0814 17:55:58.315313    5777 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/newest-cni-973000/config.json: {Name:mke6cc698f26ddcceea6372d5fcd1ee38b9479db Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:55:58.315730    5777 start.go:360] acquireMachinesLock for newest-cni-973000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:55:58.315765    5777 start.go:364] duration metric: took 29.291µs to acquireMachinesLock for "newest-cni-973000"
	I0814 17:55:58.315777    5777 start.go:93] Provisioning new machine with config: &{Name:newest-cni-973000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.31.0 ClusterName:newest-cni-973000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-
host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:55:58.315812    5777 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:55:58.323992    5777 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0814 17:55:58.342873    5777 start.go:159] libmachine.API.Create for "newest-cni-973000" (driver="qemu2")
	I0814 17:55:58.342897    5777 client.go:168] LocalClient.Create starting
	I0814 17:55:58.342960    5777 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:55:58.342994    5777 main.go:141] libmachine: Decoding PEM data...
	I0814 17:55:58.343006    5777 main.go:141] libmachine: Parsing certificate...
	I0814 17:55:58.343050    5777 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:55:58.343074    5777 main.go:141] libmachine: Decoding PEM data...
	I0814 17:55:58.343083    5777 main.go:141] libmachine: Parsing certificate...
	I0814 17:55:58.343488    5777 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:55:58.494045    5777 main.go:141] libmachine: Creating SSH key...
	I0814 17:55:58.632833    5777 main.go:141] libmachine: Creating Disk image...
	I0814 17:55:58.632838    5777 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:55:58.633037    5777 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/disk.qcow2
	I0814 17:55:58.642665    5777 main.go:141] libmachine: STDOUT: 
	I0814 17:55:58.642683    5777 main.go:141] libmachine: STDERR: 
	I0814 17:55:58.642737    5777 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/disk.qcow2 +20000M
	I0814 17:55:58.650638    5777 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:55:58.650652    5777 main.go:141] libmachine: STDERR: 
	I0814 17:55:58.650664    5777 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/disk.qcow2
	I0814 17:55:58.650673    5777 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:55:58.650685    5777 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:55:58.650712    5777 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/qemu.pid -device virtio-net-pci,netdev=net0,mac=fe:ae:41:bb:25:b7 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/disk.qcow2
	I0814 17:55:58.652390    5777 main.go:141] libmachine: STDOUT: 
	I0814 17:55:58.652405    5777 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:55:58.652426    5777 client.go:171] duration metric: took 309.531625ms to LocalClient.Create
	I0814 17:56:00.654574    5777 start.go:128] duration metric: took 2.338799417s to createHost
	I0814 17:56:00.654639    5777 start.go:83] releasing machines lock for "newest-cni-973000", held for 2.338926416s
	W0814 17:56:00.654777    5777 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:56:00.677470    5777 out.go:177] * Deleting "newest-cni-973000" in qemu2 ...
	W0814 17:56:00.731350    5777 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:56:00.731384    5777 start.go:729] Will try again in 5 seconds ...
	I0814 17:56:05.733545    5777 start.go:360] acquireMachinesLock for newest-cni-973000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:56:05.734065    5777 start.go:364] duration metric: took 392.458µs to acquireMachinesLock for "newest-cni-973000"
	I0814 17:56:05.734188    5777 start.go:93] Provisioning new machine with config: &{Name:newest-cni-973000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.31.0 ClusterName:newest-cni-973000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-
host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:56:05.734497    5777 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:56:05.743001    5777 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0814 17:56:05.793013    5777 start.go:159] libmachine.API.Create for "newest-cni-973000" (driver="qemu2")
	I0814 17:56:05.793062    5777 client.go:168] LocalClient.Create starting
	I0814 17:56:05.793178    5777 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:56:05.793242    5777 main.go:141] libmachine: Decoding PEM data...
	I0814 17:56:05.793260    5777 main.go:141] libmachine: Parsing certificate...
	I0814 17:56:05.793323    5777 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:56:05.793368    5777 main.go:141] libmachine: Decoding PEM data...
	I0814 17:56:05.793386    5777 main.go:141] libmachine: Parsing certificate...
	I0814 17:56:05.794444    5777 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:56:05.959123    5777 main.go:141] libmachine: Creating SSH key...
	I0814 17:56:06.091844    5777 main.go:141] libmachine: Creating Disk image...
	I0814 17:56:06.091850    5777 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:56:06.092029    5777 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/disk.qcow2
	I0814 17:56:06.101619    5777 main.go:141] libmachine: STDOUT: 
	I0814 17:56:06.101641    5777 main.go:141] libmachine: STDERR: 
	I0814 17:56:06.101687    5777 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/disk.qcow2 +20000M
	I0814 17:56:06.109521    5777 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:56:06.109646    5777 main.go:141] libmachine: STDERR: 
	I0814 17:56:06.109657    5777 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/disk.qcow2
	I0814 17:56:06.109661    5777 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:56:06.109672    5777 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:56:06.109718    5777 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ca:3e:60:00:34:5e -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/disk.qcow2
	I0814 17:56:06.111374    5777 main.go:141] libmachine: STDOUT: 
	I0814 17:56:06.111392    5777 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:56:06.111403    5777 client.go:171] duration metric: took 318.34275ms to LocalClient.Create
	I0814 17:56:08.113523    5777 start.go:128] duration metric: took 2.379063625s to createHost
	I0814 17:56:08.113570    5777 start.go:83] releasing machines lock for "newest-cni-973000", held for 2.3795395s
	W0814 17:56:08.113954    5777 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p newest-cni-973000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p newest-cni-973000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:56:08.124764    5777 out.go:177] 
	W0814 17:56:08.131745    5777 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:56:08.132221    5777 out.go:239] * 
	* 
	W0814 17:56:08.134213    5777 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:56:08.146731    5777 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-arm64 start -p newest-cni-973000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=qemu2  --kubernetes-version=v1.31.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-973000 -n newest-cni-973000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-973000 -n newest-cni-973000: exit status 7 (61.260292ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-973000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/FirstStart (10.03s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (0.03s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "default-k8s-diff-port-559000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-559000 -n default-k8s-diff-port-559000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-559000 -n default-k8s-diff-port-559000: exit status 7 (31.118208ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-559000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (0.03s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (0.06s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "default-k8s-diff-port-559000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context default-k8s-diff-port-559000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-559000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (26.700083ms)

                                                
                                                
** stderr ** 
	error: context "default-k8s-diff-port-559000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context default-k8s-diff-port-559000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-559000 -n default-k8s-diff-port-559000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-559000 -n default-k8s-diff-port-559000: exit status 7 (29.639417ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-559000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (0.06s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-arm64 -p default-k8s-diff-port-559000 image list --format=json
start_stop_delete_test.go:304: v1.31.0 images missing (-want +got):
[]string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.11.1",
- 	"registry.k8s.io/etcd:3.5.15-0",
- 	"registry.k8s.io/kube-apiserver:v1.31.0",
- 	"registry.k8s.io/kube-controller-manager:v1.31.0",
- 	"registry.k8s.io/kube-proxy:v1.31.0",
- 	"registry.k8s.io/kube-scheduler:v1.31.0",
- 	"registry.k8s.io/pause:3.10",
}
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-559000 -n default-k8s-diff-port-559000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-559000 -n default-k8s-diff-port-559000: exit status 7 (29.463041ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-559000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.07s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (0.1s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-arm64 pause -p default-k8s-diff-port-559000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-arm64 pause -p default-k8s-diff-port-559000 --alsologtostderr -v=1: exit status 83 (45.24025ms)

                                                
                                                
-- stdout --
	* The control-plane node default-k8s-diff-port-559000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p default-k8s-diff-port-559000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:56:00.975931    5799 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:56:00.976089    5799 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:56:00.976092    5799 out.go:304] Setting ErrFile to fd 2...
	I0814 17:56:00.976094    5799 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:56:00.976217    5799 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:56:00.976442    5799 out.go:298] Setting JSON to false
	I0814 17:56:00.976450    5799 mustload.go:65] Loading cluster: default-k8s-diff-port-559000
	I0814 17:56:00.976641    5799 config.go:182] Loaded profile config "default-k8s-diff-port-559000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:56:00.980355    5799 out.go:177] * The control-plane node default-k8s-diff-port-559000 host is not running: state=Stopped
	I0814 17:56:00.988459    5799 out.go:177]   To start a cluster, run: "minikube start -p default-k8s-diff-port-559000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-arm64 pause -p default-k8s-diff-port-559000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-559000 -n default-k8s-diff-port-559000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-559000 -n default-k8s-diff-port-559000: exit status 7 (28.605458ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-559000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-559000 -n default-k8s-diff-port-559000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-559000 -n default-k8s-diff-port-559000: exit status 7 (29.408625ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-559000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/Pause (0.10s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (9.93s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-arm64 start -p embed-certs-349000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=qemu2  --kubernetes-version=v1.31.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p embed-certs-349000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=qemu2  --kubernetes-version=v1.31.0: exit status 80 (9.869100541s)

                                                
                                                
-- stdout --
	* [embed-certs-349000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "embed-certs-349000" primary control-plane node in "embed-certs-349000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "embed-certs-349000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:56:01.292307    5816 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:56:01.292494    5816 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:56:01.292498    5816 out.go:304] Setting ErrFile to fd 2...
	I0814 17:56:01.292500    5816 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:56:01.292625    5816 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:56:01.293658    5816 out.go:298] Setting JSON to false
	I0814 17:56:01.309810    5816 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3324,"bootTime":1723680037,"procs":461,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:56:01.309940    5816 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:56:01.315382    5816 out.go:177] * [embed-certs-349000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:56:01.322246    5816 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:56:01.322296    5816 notify.go:220] Checking for updates...
	I0814 17:56:01.328247    5816 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:56:01.331199    5816 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:56:01.334261    5816 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:56:01.337254    5816 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:56:01.340247    5816 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:56:01.343593    5816 config.go:182] Loaded profile config "multinode-628000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:56:01.343664    5816 config.go:182] Loaded profile config "newest-cni-973000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:56:01.343718    5816 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:56:01.348241    5816 out.go:177] * Using the qemu2 driver based on user configuration
	I0814 17:56:01.355214    5816 start.go:297] selected driver: qemu2
	I0814 17:56:01.355221    5816 start.go:901] validating driver "qemu2" against <nil>
	I0814 17:56:01.355227    5816 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:56:01.357439    5816 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0814 17:56:01.360283    5816 out.go:177] * Automatically selected the socket_vmnet network
	I0814 17:56:01.363373    5816 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0814 17:56:01.363394    5816 cni.go:84] Creating CNI manager for ""
	I0814 17:56:01.363402    5816 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:56:01.363414    5816 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0814 17:56:01.363444    5816 start.go:340] cluster config:
	{Name:embed-certs-349000 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:embed-certs-349000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socke
t_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:56:01.366998    5816 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:56:01.374258    5816 out.go:177] * Starting "embed-certs-349000" primary control-plane node in "embed-certs-349000" cluster
	I0814 17:56:01.378219    5816 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:56:01.378237    5816 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:56:01.378251    5816 cache.go:56] Caching tarball of preloaded images
	I0814 17:56:01.378309    5816 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:56:01.378321    5816 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:56:01.378386    5816 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/embed-certs-349000/config.json ...
	I0814 17:56:01.378397    5816 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/embed-certs-349000/config.json: {Name:mk338fcfa7c920100a9d7849444b676b972c10f4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:56:01.378622    5816 start.go:360] acquireMachinesLock for embed-certs-349000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:56:01.378655    5816 start.go:364] duration metric: took 27.375µs to acquireMachinesLock for "embed-certs-349000"
	I0814 17:56:01.378667    5816 start.go:93] Provisioning new machine with config: &{Name:embed-certs-349000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.31.0 ClusterName:embed-certs-349000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptio
ns:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:56:01.378693    5816 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:56:01.387212    5816 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0814 17:56:01.404338    5816 start.go:159] libmachine.API.Create for "embed-certs-349000" (driver="qemu2")
	I0814 17:56:01.404365    5816 client.go:168] LocalClient.Create starting
	I0814 17:56:01.404419    5816 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:56:01.404448    5816 main.go:141] libmachine: Decoding PEM data...
	I0814 17:56:01.404459    5816 main.go:141] libmachine: Parsing certificate...
	I0814 17:56:01.404494    5816 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:56:01.404519    5816 main.go:141] libmachine: Decoding PEM data...
	I0814 17:56:01.404531    5816 main.go:141] libmachine: Parsing certificate...
	I0814 17:56:01.404921    5816 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:56:01.552907    5816 main.go:141] libmachine: Creating SSH key...
	I0814 17:56:01.669437    5816 main.go:141] libmachine: Creating Disk image...
	I0814 17:56:01.669451    5816 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:56:01.669611    5816 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/disk.qcow2
	I0814 17:56:01.678831    5816 main.go:141] libmachine: STDOUT: 
	I0814 17:56:01.678849    5816 main.go:141] libmachine: STDERR: 
	I0814 17:56:01.678898    5816 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/disk.qcow2 +20000M
	I0814 17:56:01.686690    5816 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:56:01.686713    5816 main.go:141] libmachine: STDERR: 
	I0814 17:56:01.686732    5816 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/disk.qcow2
	I0814 17:56:01.686738    5816 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:56:01.686750    5816 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:56:01.686775    5816 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/qemu.pid -device virtio-net-pci,netdev=net0,mac=1a:0f:f2:79:d3:53 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/disk.qcow2
	I0814 17:56:01.688406    5816 main.go:141] libmachine: STDOUT: 
	I0814 17:56:01.688421    5816 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:56:01.688447    5816 client.go:171] duration metric: took 284.085583ms to LocalClient.Create
	I0814 17:56:03.690658    5816 start.go:128] duration metric: took 2.312010834s to createHost
	I0814 17:56:03.690732    5816 start.go:83] releasing machines lock for "embed-certs-349000", held for 2.312130208s
	W0814 17:56:03.690779    5816 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:56:03.702819    5816 out.go:177] * Deleting "embed-certs-349000" in qemu2 ...
	W0814 17:56:03.731792    5816 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:56:03.731814    5816 start.go:729] Will try again in 5 seconds ...
	I0814 17:56:08.733843    5816 start.go:360] acquireMachinesLock for embed-certs-349000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:56:08.734237    5816 start.go:364] duration metric: took 301.375µs to acquireMachinesLock for "embed-certs-349000"
	I0814 17:56:08.734423    5816 start.go:93] Provisioning new machine with config: &{Name:embed-certs-349000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.31.0 ClusterName:embed-certs-349000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptio
ns:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0814 17:56:08.734776    5816 start.go:125] createHost starting for "" (driver="qemu2")
	I0814 17:56:08.740390    5816 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0814 17:56:08.790955    5816 start.go:159] libmachine.API.Create for "embed-certs-349000" (driver="qemu2")
	I0814 17:56:08.791004    5816 client.go:168] LocalClient.Create starting
	I0814 17:56:08.791109    5816 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/ca.pem
	I0814 17:56:08.791163    5816 main.go:141] libmachine: Decoding PEM data...
	I0814 17:56:08.791178    5816 main.go:141] libmachine: Parsing certificate...
	I0814 17:56:08.791244    5816 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19443-949/.minikube/certs/cert.pem
	I0814 17:56:08.791274    5816 main.go:141] libmachine: Decoding PEM data...
	I0814 17:56:08.791294    5816 main.go:141] libmachine: Parsing certificate...
	I0814 17:56:08.791811    5816 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19443-949/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso...
	I0814 17:56:08.953710    5816 main.go:141] libmachine: Creating SSH key...
	I0814 17:56:09.062346    5816 main.go:141] libmachine: Creating Disk image...
	I0814 17:56:09.062354    5816 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I0814 17:56:09.062565    5816 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/disk.qcow2.raw /Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/disk.qcow2
	I0814 17:56:09.071501    5816 main.go:141] libmachine: STDOUT: 
	I0814 17:56:09.071521    5816 main.go:141] libmachine: STDERR: 
	I0814 17:56:09.071575    5816 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/disk.qcow2 +20000M
	I0814 17:56:09.079388    5816 main.go:141] libmachine: STDOUT: Image resized.
	
	I0814 17:56:09.079406    5816 main.go:141] libmachine: STDERR: 
	I0814 17:56:09.079419    5816 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/disk.qcow2
	I0814 17:56:09.079423    5816 main.go:141] libmachine: Starting QEMU VM...
	I0814 17:56:09.079440    5816 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:56:09.079471    5816 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/qemu.pid -device virtio-net-pci,netdev=net0,mac=32:b9:5c:53:46:40 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/disk.qcow2
	I0814 17:56:09.081073    5816 main.go:141] libmachine: STDOUT: 
	I0814 17:56:09.081092    5816 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:56:09.081104    5816 client.go:171] duration metric: took 290.102167ms to LocalClient.Create
	I0814 17:56:11.083229    5816 start.go:128] duration metric: took 2.348486875s to createHost
	I0814 17:56:11.083317    5816 start.go:83] releasing machines lock for "embed-certs-349000", held for 2.349096625s
	W0814 17:56:11.083560    5816 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p embed-certs-349000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p embed-certs-349000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:56:11.095109    5816 out.go:177] 
	W0814 17:56:11.104263    5816 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:56:11.104290    5816 out.go:239] * 
	* 
	W0814 17:56:11.107124    5816 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:56:11.119934    5816 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-arm64 start -p embed-certs-349000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=qemu2  --kubernetes-version=v1.31.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-349000 -n embed-certs-349000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-349000 -n embed-certs-349000: exit status 7 (59.889084ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-349000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/FirstStart (9.93s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (0.09s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-349000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context embed-certs-349000 create -f testdata/busybox.yaml: exit status 1 (31.612667ms)

                                                
                                                
** stderr ** 
	error: context "embed-certs-349000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context embed-certs-349000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-349000 -n embed-certs-349000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-349000 -n embed-certs-349000: exit status 7 (28.771292ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-349000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-349000 -n embed-certs-349000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-349000 -n embed-certs-349000: exit status 7 (31.461916ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-349000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/DeployApp (0.09s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (5.29s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-arm64 start -p newest-cni-973000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=qemu2  --kubernetes-version=v1.31.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p newest-cni-973000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=qemu2  --kubernetes-version=v1.31.0: exit status 80 (5.217137958s)

                                                
                                                
-- stdout --
	* [newest-cni-973000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting "newest-cni-973000" primary control-plane node in "newest-cni-973000" cluster
	* Restarting existing qemu2 VM for "newest-cni-973000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "newest-cni-973000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:56:11.294296    5866 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:56:11.294432    5866 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:56:11.294436    5866 out.go:304] Setting ErrFile to fd 2...
	I0814 17:56:11.294438    5866 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:56:11.294569    5866 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:56:11.295544    5866 out.go:298] Setting JSON to false
	I0814 17:56:11.313840    5866 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3334,"bootTime":1723680037,"procs":459,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:56:11.313919    5866 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:56:11.318705    5866 out.go:177] * [newest-cni-973000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:56:11.325747    5866 notify.go:220] Checking for updates...
	I0814 17:56:11.329654    5866 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:56:11.341667    5866 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:56:11.348752    5866 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:56:11.358215    5866 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:56:11.366715    5866 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:56:11.373639    5866 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:56:11.377831    5866 config.go:182] Loaded profile config "newest-cni-973000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:56:11.378091    5866 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:56:11.382614    5866 out.go:177] * Using the qemu2 driver based on existing profile
	I0814 17:56:11.389561    5866 start.go:297] selected driver: qemu2
	I0814 17:56:11.389570    5866 start.go:901] validating driver "qemu2" against &{Name:newest-cni-973000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.0 ClusterName:newest-cni-973000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] Lis
tenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:56:11.389627    5866 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:56:11.392342    5866 start_flags.go:966] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
	I0814 17:56:11.392384    5866 cni.go:84] Creating CNI manager for ""
	I0814 17:56:11.392394    5866 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:56:11.392417    5866 start.go:340] cluster config:
	{Name:newest-cni-973000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:newest-cni-973000 Namespace:default APIServe
rHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0
CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:56:11.396452    5866 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:56:11.404620    5866 out.go:177] * Starting "newest-cni-973000" primary control-plane node in "newest-cni-973000" cluster
	I0814 17:56:11.407547    5866 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:56:11.407579    5866 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:56:11.407591    5866 cache.go:56] Caching tarball of preloaded images
	I0814 17:56:11.407674    5866 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:56:11.407681    5866 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:56:11.407753    5866 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/newest-cni-973000/config.json ...
	I0814 17:56:11.408120    5866 start.go:360] acquireMachinesLock for newest-cni-973000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:56:11.408155    5866 start.go:364] duration metric: took 25.042µs to acquireMachinesLock for "newest-cni-973000"
	I0814 17:56:11.408164    5866 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:56:11.408171    5866 fix.go:54] fixHost starting: 
	I0814 17:56:11.408292    5866 fix.go:112] recreateIfNeeded on newest-cni-973000: state=Stopped err=<nil>
	W0814 17:56:11.408300    5866 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:56:11.412651    5866 out.go:177] * Restarting existing qemu2 VM for "newest-cni-973000" ...
	I0814 17:56:11.419658    5866 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:56:11.419709    5866 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ca:3e:60:00:34:5e -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/disk.qcow2
	I0814 17:56:11.421815    5866 main.go:141] libmachine: STDOUT: 
	I0814 17:56:11.421832    5866 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:56:11.421862    5866 fix.go:56] duration metric: took 13.691417ms for fixHost
	I0814 17:56:11.421867    5866 start.go:83] releasing machines lock for "newest-cni-973000", held for 13.70825ms
	W0814 17:56:11.421873    5866 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:56:11.421915    5866 out.go:239] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:56:11.421919    5866 start.go:729] Will try again in 5 seconds ...
	I0814 17:56:16.424040    5866 start.go:360] acquireMachinesLock for newest-cni-973000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:56:16.424531    5866 start.go:364] duration metric: took 365.75µs to acquireMachinesLock for "newest-cni-973000"
	I0814 17:56:16.424653    5866 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:56:16.424673    5866 fix.go:54] fixHost starting: 
	I0814 17:56:16.425429    5866 fix.go:112] recreateIfNeeded on newest-cni-973000: state=Stopped err=<nil>
	W0814 17:56:16.425457    5866 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:56:16.429811    5866 out.go:177] * Restarting existing qemu2 VM for "newest-cni-973000" ...
	I0814 17:56:16.437763    5866 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:56:16.437925    5866 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ca:3e:60:00:34:5e -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/newest-cni-973000/disk.qcow2
	I0814 17:56:16.447019    5866 main.go:141] libmachine: STDOUT: 
	I0814 17:56:16.447086    5866 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:56:16.447156    5866 fix.go:56] duration metric: took 22.480125ms for fixHost
	I0814 17:56:16.447176    5866 start.go:83] releasing machines lock for "newest-cni-973000", held for 22.619ms
	W0814 17:56:16.447334    5866 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p newest-cni-973000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p newest-cni-973000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:56:16.454787    5866 out.go:177] 
	W0814 17:56:16.458863    5866 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:56:16.458886    5866 out.go:239] * 
	* 
	W0814 17:56:16.461469    5866 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:56:16.467940    5866 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-arm64 start -p newest-cni-973000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=qemu2  --kubernetes-version=v1.31.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-973000 -n newest-cni-973000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-973000 -n newest-cni-973000: exit status 7 (67.02425ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-973000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/SecondStart (5.29s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.16s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-arm64 addons enable metrics-server -p embed-certs-349000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-349000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context embed-certs-349000 describe deploy/metrics-server -n kube-system: exit status 1 (28.068209ms)

                                                
                                                
** stderr ** 
	error: context "embed-certs-349000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context embed-certs-349000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-349000 -n embed-certs-349000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-349000 -n embed-certs-349000: exit status 7 (28.092833ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-349000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.16s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (5.26s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-arm64 start -p embed-certs-349000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=qemu2  --kubernetes-version=v1.31.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p embed-certs-349000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=qemu2  --kubernetes-version=v1.31.0: exit status 80 (5.189123375s)

                                                
                                                
-- stdout --
	* [embed-certs-349000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting "embed-certs-349000" primary control-plane node in "embed-certs-349000" cluster
	* Restarting existing qemu2 VM for "embed-certs-349000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "embed-certs-349000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:56:15.129852    5901 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:56:15.129993    5901 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:56:15.129996    5901 out.go:304] Setting ErrFile to fd 2...
	I0814 17:56:15.129999    5901 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:56:15.130131    5901 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:56:15.131129    5901 out.go:298] Setting JSON to false
	I0814 17:56:15.147237    5901 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3338,"bootTime":1723680037,"procs":459,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:56:15.147307    5901 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:56:15.152609    5901 out.go:177] * [embed-certs-349000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:56:15.159572    5901 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:56:15.159626    5901 notify.go:220] Checking for updates...
	I0814 17:56:15.166549    5901 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:56:15.169584    5901 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:56:15.172611    5901 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:56:15.175573    5901 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:56:15.178547    5901 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:56:15.181807    5901 config.go:182] Loaded profile config "embed-certs-349000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:56:15.182066    5901 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:56:15.185539    5901 out.go:177] * Using the qemu2 driver based on existing profile
	I0814 17:56:15.192527    5901 start.go:297] selected driver: qemu2
	I0814 17:56:15.192533    5901 start.go:901] validating driver "qemu2" against &{Name:embed-certs-349000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.0 ClusterName:embed-certs-349000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 Cer
tExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:56:15.192578    5901 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:56:15.194765    5901 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0814 17:56:15.194821    5901 cni.go:84] Creating CNI manager for ""
	I0814 17:56:15.194829    5901 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:56:15.194853    5901 start.go:340] cluster config:
	{Name:embed-certs-349000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:embed-certs-349000 Namespace:default APIServ
erHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVer
sion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:56:15.198383    5901 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:56:15.205563    5901 out.go:177] * Starting "embed-certs-349000" primary control-plane node in "embed-certs-349000" cluster
	I0814 17:56:15.209501    5901 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:56:15.209516    5901 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:56:15.209525    5901 cache.go:56] Caching tarball of preloaded images
	I0814 17:56:15.209580    5901 preload.go:172] Found /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0814 17:56:15.209585    5901 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
	I0814 17:56:15.209646    5901 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/embed-certs-349000/config.json ...
	I0814 17:56:15.210114    5901 start.go:360] acquireMachinesLock for embed-certs-349000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:56:15.210149    5901 start.go:364] duration metric: took 29.167µs to acquireMachinesLock for "embed-certs-349000"
	I0814 17:56:15.210158    5901 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:56:15.210164    5901 fix.go:54] fixHost starting: 
	I0814 17:56:15.210276    5901 fix.go:112] recreateIfNeeded on embed-certs-349000: state=Stopped err=<nil>
	W0814 17:56:15.210284    5901 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:56:15.218580    5901 out.go:177] * Restarting existing qemu2 VM for "embed-certs-349000" ...
	I0814 17:56:15.222517    5901 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:56:15.222563    5901 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/qemu.pid -device virtio-net-pci,netdev=net0,mac=32:b9:5c:53:46:40 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/disk.qcow2
	I0814 17:56:15.224508    5901 main.go:141] libmachine: STDOUT: 
	I0814 17:56:15.224526    5901 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:56:15.224560    5901 fix.go:56] duration metric: took 14.39625ms for fixHost
	I0814 17:56:15.224564    5901 start.go:83] releasing machines lock for "embed-certs-349000", held for 14.4105ms
	W0814 17:56:15.224570    5901 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:56:15.224610    5901 out.go:239] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:56:15.224617    5901 start.go:729] Will try again in 5 seconds ...
	I0814 17:56:20.226718    5901 start.go:360] acquireMachinesLock for embed-certs-349000: {Name:mk96d5f7500483084bc5d4d1b2bb04ebe19a115e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0814 17:56:20.227228    5901 start.go:364] duration metric: took 358.958µs to acquireMachinesLock for "embed-certs-349000"
	I0814 17:56:20.227405    5901 start.go:96] Skipping create...Using existing machine configuration
	I0814 17:56:20.227426    5901 fix.go:54] fixHost starting: 
	I0814 17:56:20.228187    5901 fix.go:112] recreateIfNeeded on embed-certs-349000: state=Stopped err=<nil>
	W0814 17:56:20.228218    5901 fix.go:138] unexpected machine state, will restart: <nil>
	I0814 17:56:20.236592    5901 out.go:177] * Restarting existing qemu2 VM for "embed-certs-349000" ...
	I0814 17:56:20.244171    5901 qemu.go:418] Using hvf for hardware acceleration
	I0814 17:56:20.244439    5901 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/qemu.pid -device virtio-net-pci,netdev=net0,mac=32:b9:5c:53:46:40 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19443-949/.minikube/machines/embed-certs-349000/disk.qcow2
	I0814 17:56:20.254523    5901 main.go:141] libmachine: STDOUT: 
	I0814 17:56:20.254581    5901 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I0814 17:56:20.254655    5901 fix.go:56] duration metric: took 27.232916ms for fixHost
	I0814 17:56:20.254669    5901 start.go:83] releasing machines lock for "embed-certs-349000", held for 27.416417ms
	W0814 17:56:20.254907    5901 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p embed-certs-349000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p embed-certs-349000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I0814 17:56:20.263593    5901 out.go:177] 
	W0814 17:56:20.266650    5901 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W0814 17:56:20.266681    5901 out.go:239] * 
	* 
	W0814 17:56:20.269061    5901 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:56:20.277631    5901 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-arm64 start -p embed-certs-349000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=qemu2  --kubernetes-version=v1.31.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-349000 -n embed-certs-349000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-349000 -n embed-certs-349000: exit status 7 (66.163042ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-349000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/SecondStart (5.26s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-arm64 -p newest-cni-973000 image list --format=json
start_stop_delete_test.go:304: v1.31.0 images missing (-want +got):
[]string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.11.1",
- 	"registry.k8s.io/etcd:3.5.15-0",
- 	"registry.k8s.io/kube-apiserver:v1.31.0",
- 	"registry.k8s.io/kube-controller-manager:v1.31.0",
- 	"registry.k8s.io/kube-proxy:v1.31.0",
- 	"registry.k8s.io/kube-scheduler:v1.31.0",
- 	"registry.k8s.io/pause:3.10",
}
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-973000 -n newest-cni-973000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-973000 -n newest-cni-973000: exit status 7 (29.764791ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-973000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.07s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (0.1s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-arm64 pause -p newest-cni-973000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-arm64 pause -p newest-cni-973000 --alsologtostderr -v=1: exit status 83 (41.859792ms)

                                                
                                                
-- stdout --
	* The control-plane node newest-cni-973000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p newest-cni-973000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:56:16.649967    5915 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:56:16.650137    5915 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:56:16.650140    5915 out.go:304] Setting ErrFile to fd 2...
	I0814 17:56:16.650143    5915 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:56:16.650280    5915 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:56:16.650496    5915 out.go:298] Setting JSON to false
	I0814 17:56:16.650504    5915 mustload.go:65] Loading cluster: newest-cni-973000
	I0814 17:56:16.650703    5915 config.go:182] Loaded profile config "newest-cni-973000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:56:16.655240    5915 out.go:177] * The control-plane node newest-cni-973000 host is not running: state=Stopped
	I0814 17:56:16.659046    5915 out.go:177]   To start a cluster, run: "minikube start -p newest-cni-973000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-arm64 pause -p newest-cni-973000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-973000 -n newest-cni-973000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-973000 -n newest-cni-973000: exit status 7 (28.981209ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-973000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-973000 -n newest-cni-973000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-973000 -n newest-cni-973000: exit status 7 (28.883583ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-973000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/Pause (0.10s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (0.03s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "embed-certs-349000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-349000 -n embed-certs-349000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-349000 -n embed-certs-349000: exit status 7 (31.934792ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-349000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (0.03s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (0.06s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "embed-certs-349000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context embed-certs-349000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context embed-certs-349000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (26.491125ms)

                                                
                                                
** stderr ** 
	error: context "embed-certs-349000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context embed-certs-349000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-349000 -n embed-certs-349000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-349000 -n embed-certs-349000: exit status 7 (30.719583ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-349000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (0.06s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-arm64 -p embed-certs-349000 image list --format=json
start_stop_delete_test.go:304: v1.31.0 images missing (-want +got):
[]string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.11.1",
- 	"registry.k8s.io/etcd:3.5.15-0",
- 	"registry.k8s.io/kube-apiserver:v1.31.0",
- 	"registry.k8s.io/kube-controller-manager:v1.31.0",
- 	"registry.k8s.io/kube-proxy:v1.31.0",
- 	"registry.k8s.io/kube-scheduler:v1.31.0",
- 	"registry.k8s.io/pause:3.10",
}
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-349000 -n embed-certs-349000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-349000 -n embed-certs-349000: exit status 7 (29.794917ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-349000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.07s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (0.1s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-arm64 pause -p embed-certs-349000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-arm64 pause -p embed-certs-349000 --alsologtostderr -v=1: exit status 83 (42.757584ms)

                                                
                                                
-- stdout --
	* The control-plane node embed-certs-349000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p embed-certs-349000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:56:20.547595    5944 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:56:20.547757    5944 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:56:20.547760    5944 out.go:304] Setting ErrFile to fd 2...
	I0814 17:56:20.547763    5944 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:56:20.547897    5944 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:56:20.548122    5944 out.go:298] Setting JSON to false
	I0814 17:56:20.548130    5944 mustload.go:65] Loading cluster: embed-certs-349000
	I0814 17:56:20.548324    5944 config.go:182] Loaded profile config "embed-certs-349000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:56:20.553021    5944 out.go:177] * The control-plane node embed-certs-349000 host is not running: state=Stopped
	I0814 17:56:20.557001    5944 out.go:177]   To start a cluster, run: "minikube start -p embed-certs-349000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-arm64 pause -p embed-certs-349000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-349000 -n embed-certs-349000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-349000 -n embed-certs-349000: exit status 7 (30.190917ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-349000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-349000 -n embed-certs-349000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-349000 -n embed-certs-349000: exit status 7 (28.894ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-349000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/Pause (0.10s)

                                                
                                    

Test pass (156/274)

Order passed test Duration
4 TestDownloadOnly/v1.20.0/preload-exists 0
8 TestDownloadOnly/v1.20.0/LogsDuration 0.1
9 TestDownloadOnly/v1.20.0/DeleteAll 0.12
10 TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds 0.1
12 TestDownloadOnly/v1.31.0/json-events 13.01
13 TestDownloadOnly/v1.31.0/preload-exists 0
16 TestDownloadOnly/v1.31.0/kubectl 0
17 TestDownloadOnly/v1.31.0/LogsDuration 0.08
18 TestDownloadOnly/v1.31.0/DeleteAll 0.11
19 TestDownloadOnly/v1.31.0/DeleteAlwaysSucceeds 0.1
21 TestBinaryMirror 0.34
25 TestAddons/PreSetup/EnablingAddonOnNonExistingCluster 0.05
26 TestAddons/PreSetup/DisablingAddonOnNonExistingCluster 0.05
27 TestAddons/Setup 199.43
29 TestAddons/serial/Volcano 38.39
31 TestAddons/serial/GCPAuth/Namespaces 0.09
33 TestAddons/parallel/Registry 15.75
34 TestAddons/parallel/Ingress 19.14
35 TestAddons/parallel/InspektorGadget 10.25
36 TestAddons/parallel/MetricsServer 5.27
39 TestAddons/parallel/CSI 39.77
40 TestAddons/parallel/Headlamp 16.69
41 TestAddons/parallel/CloudSpanner 5.2
42 TestAddons/parallel/LocalPath 49.84
43 TestAddons/parallel/NvidiaDevicePlugin 6.19
44 TestAddons/parallel/Yakd 10.28
45 TestAddons/StoppedEnableDisable 12.4
53 TestHyperKitDriverInstallOrUpdate 10.64
56 TestErrorSpam/setup 35.45
57 TestErrorSpam/start 0.34
58 TestErrorSpam/status 0.23
59 TestErrorSpam/pause 0.71
60 TestErrorSpam/unpause 0.62
61 TestErrorSpam/stop 64.3
64 TestFunctional/serial/CopySyncFile 0
65 TestFunctional/serial/StartWithProxy 48.54
66 TestFunctional/serial/AuditLog 0
67 TestFunctional/serial/SoftStart 34.77
68 TestFunctional/serial/KubeContext 0.03
69 TestFunctional/serial/KubectlGetPods 0.05
72 TestFunctional/serial/CacheCmd/cache/add_remote 2.74
73 TestFunctional/serial/CacheCmd/cache/add_local 1.17
74 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.04
75 TestFunctional/serial/CacheCmd/cache/list 0.03
76 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.07
77 TestFunctional/serial/CacheCmd/cache/cache_reload 0.62
78 TestFunctional/serial/CacheCmd/cache/delete 0.07
79 TestFunctional/serial/MinikubeKubectlCmd 0.74
80 TestFunctional/serial/MinikubeKubectlCmdDirectly 1.02
81 TestFunctional/serial/ExtraConfig 37.65
82 TestFunctional/serial/ComponentHealth 0.05
83 TestFunctional/serial/LogsCmd 0.66
84 TestFunctional/serial/LogsFileCmd 0.66
85 TestFunctional/serial/InvalidService 4.68
87 TestFunctional/parallel/ConfigCmd 0.23
88 TestFunctional/parallel/DashboardCmd 9.56
89 TestFunctional/parallel/DryRun 0.24
90 TestFunctional/parallel/InternationalLanguage 0.12
91 TestFunctional/parallel/StatusCmd 0.23
96 TestFunctional/parallel/AddonsCmd 0.1
97 TestFunctional/parallel/PersistentVolumeClaim 23.95
99 TestFunctional/parallel/SSHCmd 0.12
100 TestFunctional/parallel/CpCmd 0.4
102 TestFunctional/parallel/FileSync 0.06
103 TestFunctional/parallel/CertSync 0.39
107 TestFunctional/parallel/NodeLabels 0.04
109 TestFunctional/parallel/NonActiveRuntimeDisabled 0.06
111 TestFunctional/parallel/License 0.39
113 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.84
114 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0.02
116 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 10.1
117 TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP 0.04
118 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 0.01
119 TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig 0.02
120 TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil 0.02
121 TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS 0.01
122 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.12
123 TestFunctional/parallel/ServiceCmd/DeployApp 6.09
124 TestFunctional/parallel/ServiceCmd/List 0.3
125 TestFunctional/parallel/ServiceCmd/JSONOutput 0.29
126 TestFunctional/parallel/ServiceCmd/HTTPS 0.11
127 TestFunctional/parallel/ServiceCmd/Format 0.09
128 TestFunctional/parallel/ServiceCmd/URL 0.09
129 TestFunctional/parallel/ProfileCmd/profile_not_create 0.12
130 TestFunctional/parallel/ProfileCmd/profile_list 0.12
131 TestFunctional/parallel/ProfileCmd/profile_json_output 0.12
132 TestFunctional/parallel/MountCmd/any-port 6.25
133 TestFunctional/parallel/MountCmd/specific-port 1.16
134 TestFunctional/parallel/MountCmd/VerifyCleanup 0.97
135 TestFunctional/parallel/Version/short 0.04
136 TestFunctional/parallel/Version/components 0.15
137 TestFunctional/parallel/ImageCommands/ImageListShort 0.07
138 TestFunctional/parallel/ImageCommands/ImageListTable 0.07
139 TestFunctional/parallel/ImageCommands/ImageListJson 0.07
140 TestFunctional/parallel/ImageCommands/ImageListYaml 0.07
141 TestFunctional/parallel/ImageCommands/ImageBuild 1.73
142 TestFunctional/parallel/ImageCommands/Setup 1.73
143 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 0.47
144 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 0.37
145 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 1.17
146 TestFunctional/parallel/ImageCommands/ImageSaveToFile 0.15
147 TestFunctional/parallel/ImageCommands/ImageRemove 0.28
148 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 0.23
149 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 0.2
150 TestFunctional/parallel/DockerEnv/bash 0.34
151 TestFunctional/parallel/UpdateContextCmd/no_changes 0.06
152 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.05
153 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.05
154 TestFunctional/delete_echo-server_images 0.03
155 TestFunctional/delete_my-image_image 0.01
156 TestFunctional/delete_minikube_cached_images 0.01
160 TestMultiControlPlane/serial/StartCluster 179.24
161 TestMultiControlPlane/serial/DeployApp 4.76
162 TestMultiControlPlane/serial/PingHostFromPods 0.72
163 TestMultiControlPlane/serial/AddWorkerNode 54.13
164 TestMultiControlPlane/serial/NodeLabels 0.13
165 TestMultiControlPlane/serial/HAppyAfterClusterStart 0.24
166 TestMultiControlPlane/serial/CopyFile 4.36
170 TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart 79.72
178 TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd 0.05
185 TestJSONOutput/start/Audit 0
187 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
188 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
191 TestJSONOutput/pause/Audit 0
193 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
194 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
197 TestJSONOutput/unpause/Audit 0
199 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
200 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
202 TestJSONOutput/stop/Command 3.68
203 TestJSONOutput/stop/Audit 0
205 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
206 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
207 TestErrorJSONOutput 0.2
212 TestMainNoArgs 0.03
257 TestStoppedBinaryUpgrade/Setup 1.27
259 TestStoppedBinaryUpgrade/MinikubeLogs 0.88
270 TestNoKubernetes/serial/StartNoK8sWithVersion 0.1
276 TestNoKubernetes/serial/VerifyK8sNotRunning 0.04
277 TestNoKubernetes/serial/ProfileList 0.1
278 TestNoKubernetes/serial/Stop 3.11
280 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.04
294 TestStartStop/group/old-k8s-version/serial/Stop 2.77
295 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.12
305 TestStartStop/group/no-preload/serial/Stop 3.37
306 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.12
316 TestStartStop/group/default-k8s-diff-port/serial/Stop 3.57
317 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.12
327 TestStartStop/group/newest-cni/serial/DeployApp 0
328 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 0.06
329 TestStartStop/group/newest-cni/serial/Stop 2.86
330 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.12
334 TestStartStop/group/embed-certs/serial/Stop 3.53
335 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.13
337 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
338 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
x
+
TestDownloadOnly/v1.20.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/preload-exists
--- PASS: TestDownloadOnly/v1.20.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/LogsDuration (0.1s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-darwin-arm64 logs -p download-only-599000
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-arm64 logs -p download-only-599000: exit status 85 (96.788ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-599000 | jenkins | v1.33.1 | 14 Aug 24 17:04 PDT |          |
	|         | -p download-only-599000        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|         | --driver=qemu2                 |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	
	==> Last Start <==
	Log file created at: 2024/08/14 17:04:31
	Running on machine: MacOS-M1-Agent-2
	Binary: Built with gc go1.22.5 for darwin/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0814 17:04:31.832691    1406 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:04:31.832846    1406 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:04:31.832849    1406 out.go:304] Setting ErrFile to fd 2...
	I0814 17:04:31.832851    1406 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:04:31.832981    1406 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	W0814 17:04:31.833070    1406 root.go:314] Error reading config file at /Users/jenkins/minikube-integration/19443-949/.minikube/config/config.json: open /Users/jenkins/minikube-integration/19443-949/.minikube/config/config.json: no such file or directory
	I0814 17:04:31.834266    1406 out.go:298] Setting JSON to true
	I0814 17:04:31.851541    1406 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":234,"bootTime":1723680037,"procs":447,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:04:31.851614    1406 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:04:31.857253    1406 out.go:97] [download-only-599000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:04:31.857425    1406 notify.go:220] Checking for updates...
	W0814 17:04:31.857445    1406 preload.go:293] Failed to list preload files: open /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball: no such file or directory
	I0814 17:04:31.861146    1406 out.go:169] MINIKUBE_LOCATION=19443
	I0814 17:04:31.864233    1406 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:04:31.869217    1406 out.go:169] MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:04:31.872232    1406 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:04:31.875229    1406 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	W0814 17:04:31.881207    1406 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0814 17:04:31.881467    1406 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:04:31.886192    1406 out.go:97] Using the qemu2 driver based on user configuration
	I0814 17:04:31.886213    1406 start.go:297] selected driver: qemu2
	I0814 17:04:31.886226    1406 start.go:901] validating driver "qemu2" against <nil>
	I0814 17:04:31.886296    1406 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0814 17:04:31.890182    1406 out.go:169] Automatically selected the socket_vmnet network
	I0814 17:04:31.895643    1406 start_flags.go:393] Using suggested 4000MB memory alloc based on sys=16384MB, container=0MB
	I0814 17:04:31.895728    1406 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0814 17:04:31.895817    1406 cni.go:84] Creating CNI manager for ""
	I0814 17:04:31.895832    1406 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0814 17:04:31.895876    1406 start.go:340] cluster config:
	{Name:download-only-599000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:download-only-599000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Con
tainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSo
ck: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:04:31.901241    1406 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:04:31.905228    1406 out.go:97] Downloading VM boot image ...
	I0814 17:04:31.905247    1406 download.go:107] Downloading: https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso?checksum=file:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso.sha256 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/iso/arm64/minikube-v1.33.1-1723650137-19443-arm64.iso
	I0814 17:04:40.850305    1406 out.go:97] Starting "download-only-599000" primary control-plane node in "download-only-599000" cluster
	I0814 17:04:40.850322    1406 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0814 17:04:40.912267    1406 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4
	I0814 17:04:40.912290    1406 cache.go:56] Caching tarball of preloaded images
	I0814 17:04:40.912460    1406 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0814 17:04:40.918555    1406 out.go:97] Downloading Kubernetes v1.20.0 preload ...
	I0814 17:04:40.918562    1406 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...
	I0814 17:04:41.008110    1406 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4?checksum=md5:1a3e8f9b29e6affec63d76d0d3000942 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4
	I0814 17:04:46.620623    1406 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...
	I0814 17:04:46.620775    1406 preload.go:254] verifying checksum of /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...
	I0814 17:04:47.317013    1406 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I0814 17:04:47.317209    1406 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/download-only-599000/config.json ...
	I0814 17:04:47.317228    1406 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/download-only-599000/config.json: {Name:mk2ed7cb5d9ce47bee4571252d4a10ea822f3d07 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0814 17:04:47.317454    1406 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0814 17:04:47.317652    1406 download.go:107] Downloading: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/darwin/arm64/v1.20.0/kubectl
	I0814 17:04:47.699180    1406 out.go:169] 
	W0814 17:04:47.708167    1406 out_reason.go:110] Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256: getter: &{Ctx:context.Background Src:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 Dst:/Users/jenkins/minikube-integration/19443-949/.minikube/cache/darwin/arm64/v1.20.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x1092a7940 0x1092a7940 0x1092a7940 0x1092a7940 0x1092a7940 0x1092a7940 0x1092a7940] Decompressors:map[bz2:0x140003e1290 gz:0x140003e1298 tar:0x140003e1230 tar.bz2:0x140003e1240 tar.gz:0x140003e1260 tar.xz:0x140003e1270 tar.zst:0x140003e1280 tbz2:0x140003e1240 tgz:0x140003e1260 txz:0x140003e1270 tzst:0x140003e1280 xz:0x140003e12a0 zip:0x140003e12b0 zst:0x140003e12a8] Getters:map[file:0x14001826560 http:0x1400078c3c0 https:0x1400078c410] Dir:false ProgressListe
ner:<nil> Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404
	W0814 17:04:47.708192    1406 out_reason.go:110] 
	W0814 17:04:47.716154    1406 out.go:229] ╭───────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                           │
	│    If the above advice does not help, please let us know:                                 │
	│    https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                           │
	│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                           │
	╰───────────────────────────────────────────────────────────────────────────────────────────╯
	I0814 17:04:47.719106    1406 out.go:169] 
	
	
	* The control-plane node download-only-599000 host does not exist
	  To start a cluster, run: "minikube start -p download-only-599000"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.20.0/LogsDuration (0.10s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAll (0.12s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-darwin-arm64 delete --all
--- PASS: TestDownloadOnly/v1.20.0/DeleteAll (0.12s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.1s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-darwin-arm64 delete -p download-only-599000
--- PASS: TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.10s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0/json-events (13.01s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-darwin-arm64 start -o=json --download-only -p download-only-348000 --force --alsologtostderr --kubernetes-version=v1.31.0 --container-runtime=docker --driver=qemu2 
aaa_download_only_test.go:81: (dbg) Done: out/minikube-darwin-arm64 start -o=json --download-only -p download-only-348000 --force --alsologtostderr --kubernetes-version=v1.31.0 --container-runtime=docker --driver=qemu2 : (13.006872875s)
--- PASS: TestDownloadOnly/v1.31.0/json-events (13.01s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0/preload-exists
--- PASS: TestDownloadOnly/v1.31.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0/kubectl
--- PASS: TestDownloadOnly/v1.31.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0/LogsDuration (0.08s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-darwin-arm64 logs -p download-only-348000
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-arm64 logs -p download-only-348000: exit status 85 (75.065208ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only        | download-only-599000 | jenkins | v1.33.1 | 14 Aug 24 17:04 PDT |                     |
	|         | -p download-only-599000        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |                     |
	|         | --container-runtime=docker     |                      |         |         |                     |                     |
	|         | --driver=qemu2                 |                      |         |         |                     |                     |
	| delete  | --all                          | minikube             | jenkins | v1.33.1 | 14 Aug 24 17:04 PDT | 14 Aug 24 17:04 PDT |
	| delete  | -p download-only-599000        | download-only-599000 | jenkins | v1.33.1 | 14 Aug 24 17:04 PDT | 14 Aug 24 17:04 PDT |
	| start   | -o=json --download-only        | download-only-348000 | jenkins | v1.33.1 | 14 Aug 24 17:04 PDT |                     |
	|         | -p download-only-348000        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.0   |                      |         |         |                     |                     |
	|         | --container-runtime=docker     |                      |         |         |                     |                     |
	|         | --driver=qemu2                 |                      |         |         |                     |                     |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/08/14 17:04:48
	Running on machine: MacOS-M1-Agent-2
	Binary: Built with gc go1.22.5 for darwin/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0814 17:04:48.130662    1433 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:04:48.130777    1433 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:04:48.130780    1433 out.go:304] Setting ErrFile to fd 2...
	I0814 17:04:48.130782    1433 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:04:48.130917    1433 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:04:48.132026    1433 out.go:298] Setting JSON to true
	I0814 17:04:48.148113    1433 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":251,"bootTime":1723680037,"procs":445,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:04:48.148175    1433 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:04:48.153500    1433 out.go:97] [download-only-348000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:04:48.153574    1433 notify.go:220] Checking for updates...
	I0814 17:04:48.156371    1433 out.go:169] MINIKUBE_LOCATION=19443
	I0814 17:04:48.159448    1433 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:04:48.163441    1433 out.go:169] MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:04:48.166430    1433 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:04:48.169456    1433 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	W0814 17:04:48.173811    1433 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0814 17:04:48.173984    1433 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:04:48.177409    1433 out.go:97] Using the qemu2 driver based on user configuration
	I0814 17:04:48.177416    1433 start.go:297] selected driver: qemu2
	I0814 17:04:48.177419    1433 start.go:901] validating driver "qemu2" against <nil>
	I0814 17:04:48.177464    1433 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0814 17:04:48.180404    1433 out.go:169] Automatically selected the socket_vmnet network
	I0814 17:04:48.185512    1433 start_flags.go:393] Using suggested 4000MB memory alloc based on sys=16384MB, container=0MB
	I0814 17:04:48.185593    1433 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0814 17:04:48.185624    1433 cni.go:84] Creating CNI manager for ""
	I0814 17:04:48.185630    1433 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0814 17:04:48.185635    1433 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0814 17:04:48.185671    1433 start.go:340] cluster config:
	{Name:download-only-348000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:download-only-348000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Con
tainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAut
hSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:04:48.189062    1433 iso.go:125] acquiring lock: {Name:mkb17efc003f266caa28eaae37471a419a95a573 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0814 17:04:48.192446    1433 out.go:97] Starting "download-only-348000" primary control-plane node in "download-only-348000" cluster
	I0814 17:04:48.192454    1433 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:04:48.254129    1433 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.31.0/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	I0814 17:04:48.254157    1433 cache.go:56] Caching tarball of preloaded images
	I0814 17:04:48.254346    1433 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
	I0814 17:04:48.258767    1433 out.go:97] Downloading Kubernetes v1.31.0 preload ...
	I0814 17:04:48.258774    1433 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 ...
	I0814 17:04:48.343794    1433 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.31.0/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4?checksum=md5:90c22abece392b762c0b4e45be981bb4 -> /Users/jenkins/minikube-integration/19443-949/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
	
	
	* The control-plane node download-only-348000 host does not exist
	  To start a cluster, run: "minikube start -p download-only-348000"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.31.0/LogsDuration (0.08s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0/DeleteAll (0.11s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-darwin-arm64 delete --all
--- PASS: TestDownloadOnly/v1.31.0/DeleteAll (0.11s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0/DeleteAlwaysSucceeds (0.1s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-darwin-arm64 delete -p download-only-348000
--- PASS: TestDownloadOnly/v1.31.0/DeleteAlwaysSucceeds (0.10s)

                                                
                                    
x
+
TestBinaryMirror (0.34s)

                                                
                                                
=== RUN   TestBinaryMirror
aaa_download_only_test.go:314: (dbg) Run:  out/minikube-darwin-arm64 start --download-only -p binary-mirror-962000 --alsologtostderr --binary-mirror http://127.0.0.1:49311 --driver=qemu2 
helpers_test.go:175: Cleaning up "binary-mirror-962000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p binary-mirror-962000
--- PASS: TestBinaryMirror (0.34s)

                                                
                                    
x
+
TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.05s)

                                                
                                                
=== RUN   TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
addons_test.go:1037: (dbg) Run:  out/minikube-darwin-arm64 addons enable dashboard -p addons-365000
addons_test.go:1037: (dbg) Non-zero exit: out/minikube-darwin-arm64 addons enable dashboard -p addons-365000: exit status 85 (53.431791ms)

                                                
                                                
-- stdout --
	* Profile "addons-365000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-365000"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.05s)

                                                
                                    
x
+
TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.05s)

                                                
                                                
=== RUN   TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
addons_test.go:1048: (dbg) Run:  out/minikube-darwin-arm64 addons disable dashboard -p addons-365000
addons_test.go:1048: (dbg) Non-zero exit: out/minikube-darwin-arm64 addons disable dashboard -p addons-365000: exit status 85 (53.40775ms)

                                                
                                                
-- stdout --
	* Profile "addons-365000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-365000"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.05s)

                                                
                                    
x
+
TestAddons/Setup (199.43s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:110: (dbg) Run:  out/minikube-darwin-arm64 start -p addons-365000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=qemu2  --addons=ingress --addons=ingress-dns
addons_test.go:110: (dbg) Done: out/minikube-darwin-arm64 start -p addons-365000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=qemu2  --addons=ingress --addons=ingress-dns: (3m19.430816458s)
--- PASS: TestAddons/Setup (199.43s)

                                                
                                    
x
+
TestAddons/serial/Volcano (38.39s)

                                                
                                                
=== RUN   TestAddons/serial/Volcano
addons_test.go:897: volcano-scheduler stabilized in 8.30825ms
addons_test.go:913: volcano-controller stabilized in 8.32225ms
addons_test.go:905: volcano-admission stabilized in 8.378041ms
addons_test.go:919: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-576bc46687-xwswz" [d0404e25-4370-4824-94a1-0358d4079226] Running
addons_test.go:919: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 5.005377334s
addons_test.go:923: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-admission-77d7d48b68-5sdjs" [50d4e032-f531-4ded-b0ef-7080108ea459] Running
addons_test.go:923: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 5.004745625s
addons_test.go:927: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-controllers-56675bb4d5-8xgkq" [bae75b57-308a-4282-a1b4-98f1d2213d90] Running
addons_test.go:927: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.00526225s
addons_test.go:932: (dbg) Run:  kubectl --context addons-365000 delete -n volcano-system job volcano-admission-init
addons_test.go:938: (dbg) Run:  kubectl --context addons-365000 create -f testdata/vcjob.yaml
addons_test.go:946: (dbg) Run:  kubectl --context addons-365000 get vcjob -n my-volcano
addons_test.go:964: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:344: "test-job-nginx-0" [1fbb3054-b812-484f-a4e7-343b1584dda3] Pending
helpers_test.go:344: "test-job-nginx-0" [1fbb3054-b812-484f-a4e7-343b1584dda3] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "test-job-nginx-0" [1fbb3054-b812-484f-a4e7-343b1584dda3] Running
addons_test.go:964: (dbg) TestAddons/serial/Volcano: volcano.sh/job-name=test-job healthy within 13.003784209s
addons_test.go:968: (dbg) Run:  out/minikube-darwin-arm64 -p addons-365000 addons disable volcano --alsologtostderr -v=1
addons_test.go:968: (dbg) Done: out/minikube-darwin-arm64 -p addons-365000 addons disable volcano --alsologtostderr -v=1: (10.130635875s)
--- PASS: TestAddons/serial/Volcano (38.39s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/Namespaces (0.09s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/Namespaces
addons_test.go:656: (dbg) Run:  kubectl --context addons-365000 create ns new-namespace
addons_test.go:670: (dbg) Run:  kubectl --context addons-365000 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.09s)

                                                
                                    
x
+
TestAddons/parallel/Registry (15.75s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:332: registry stabilized in 1.229709ms
addons_test.go:334: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-6fb4cdfc84-9b48d" [ac8ff11b-a739-4a57-9ccb-f601be88d271] Running
addons_test.go:334: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 6.003166375s
addons_test.go:337: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-5jdwb" [6de13f60-7192-4841-abb2-24cec136accf] Running
addons_test.go:337: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 6.009293209s
addons_test.go:342: (dbg) Run:  kubectl --context addons-365000 delete po -l run=registry-test --now
addons_test.go:347: (dbg) Run:  kubectl --context addons-365000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:347: (dbg) Done: kubectl --context addons-365000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (3.418516084s)
addons_test.go:361: (dbg) Run:  out/minikube-darwin-arm64 -p addons-365000 ip
2024/08/14 17:09:31 [DEBUG] GET http://192.168.105.2:5000
addons_test.go:390: (dbg) Run:  out/minikube-darwin-arm64 -p addons-365000 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (15.75s)

                                                
                                    
x
+
TestAddons/parallel/Ingress (19.14s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:209: (dbg) Run:  kubectl --context addons-365000 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:234: (dbg) Run:  kubectl --context addons-365000 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:247: (dbg) Run:  kubectl --context addons-365000 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:252: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [ff958b75-bdce-4534-a3b4-452beefceabb] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [ff958b75-bdce-4534-a3b4-452beefceabb] Running
addons_test.go:252: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 10.010647209s
addons_test.go:264: (dbg) Run:  out/minikube-darwin-arm64 -p addons-365000 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:288: (dbg) Run:  kubectl --context addons-365000 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:293: (dbg) Run:  out/minikube-darwin-arm64 -p addons-365000 ip
addons_test.go:299: (dbg) Run:  nslookup hello-john.test 192.168.105.2
addons_test.go:308: (dbg) Run:  out/minikube-darwin-arm64 -p addons-365000 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:308: (dbg) Done: out/minikube-darwin-arm64 -p addons-365000 addons disable ingress-dns --alsologtostderr -v=1: (1.182110291s)
addons_test.go:313: (dbg) Run:  out/minikube-darwin-arm64 -p addons-365000 addons disable ingress --alsologtostderr -v=1
addons_test.go:313: (dbg) Done: out/minikube-darwin-arm64 -p addons-365000 addons disable ingress --alsologtostderr -v=1: (7.327038542s)
--- PASS: TestAddons/parallel/Ingress (19.14s)

                                                
                                    
x
+
TestAddons/parallel/InspektorGadget (10.25s)

                                                
                                                
=== RUN   TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/InspektorGadget
addons_test.go:848: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:344: "gadget-vfxqs" [4426abdb-4623-4447-a418-8a17a644e7d6] Running / Ready:ContainersNotReady (containers with unready status: [gadget]) / ContainersReady:ContainersNotReady (containers with unready status: [gadget])
addons_test.go:848: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 5.004085459s
addons_test.go:851: (dbg) Run:  out/minikube-darwin-arm64 addons disable inspektor-gadget -p addons-365000
addons_test.go:851: (dbg) Done: out/minikube-darwin-arm64 addons disable inspektor-gadget -p addons-365000: (5.243018542s)
--- PASS: TestAddons/parallel/InspektorGadget (10.25s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (5.27s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:409: metrics-server stabilized in 4.107417ms
addons_test.go:411: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:344: "metrics-server-8988944d9-qf8j2" [888af3f9-b95a-4ec9-9cf9-4b37c9571f4e] Running
addons_test.go:411: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.004767334s
addons_test.go:417: (dbg) Run:  kubectl --context addons-365000 top pods -n kube-system
addons_test.go:434: (dbg) Run:  out/minikube-darwin-arm64 -p addons-365000 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (5.27s)

                                                
                                    
x
+
TestAddons/parallel/CSI (39.77s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:567: csi-hostpath-driver pods stabilized in 50.010875ms
addons_test.go:570: (dbg) Run:  kubectl --context addons-365000 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:575: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-365000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-365000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-365000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-365000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-365000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-365000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-365000 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:580: (dbg) Run:  kubectl --context addons-365000 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:585: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:344: "task-pv-pod" [fea72ad8-5270-4ccd-89d0-addd9d1394b6] Pending
helpers_test.go:344: "task-pv-pod" [fea72ad8-5270-4ccd-89d0-addd9d1394b6] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod" [fea72ad8-5270-4ccd-89d0-addd9d1394b6] Running
addons_test.go:585: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 9.010282042s
addons_test.go:590: (dbg) Run:  kubectl --context addons-365000 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:595: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:419: (dbg) Run:  kubectl --context addons-365000 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-365000 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:600: (dbg) Run:  kubectl --context addons-365000 delete pod task-pv-pod
addons_test.go:600: (dbg) Done: kubectl --context addons-365000 delete pod task-pv-pod: (1.086962417s)
addons_test.go:606: (dbg) Run:  kubectl --context addons-365000 delete pvc hpvc
addons_test.go:612: (dbg) Run:  kubectl --context addons-365000 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:617: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-365000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-365000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-365000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-365000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-365000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-365000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-365000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-365000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:622: (dbg) Run:  kubectl --context addons-365000 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:627: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:344: "task-pv-pod-restore" [b0a8b188-88bf-4cd7-8131-9b5fe49f6246] Pending
helpers_test.go:344: "task-pv-pod-restore" [b0a8b188-88bf-4cd7-8131-9b5fe49f6246] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod-restore" [b0a8b188-88bf-4cd7-8131-9b5fe49f6246] Running
addons_test.go:627: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 7.005380167s
addons_test.go:632: (dbg) Run:  kubectl --context addons-365000 delete pod task-pv-pod-restore
addons_test.go:632: (dbg) Done: kubectl --context addons-365000 delete pod task-pv-pod-restore: (1.083448875s)
addons_test.go:636: (dbg) Run:  kubectl --context addons-365000 delete pvc hpvc-restore
addons_test.go:640: (dbg) Run:  kubectl --context addons-365000 delete volumesnapshot new-snapshot-demo
addons_test.go:644: (dbg) Run:  out/minikube-darwin-arm64 -p addons-365000 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:644: (dbg) Done: out/minikube-darwin-arm64 -p addons-365000 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.140404041s)
addons_test.go:648: (dbg) Run:  out/minikube-darwin-arm64 -p addons-365000 addons disable volumesnapshots --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CSI (39.77s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (16.69s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:830: (dbg) Run:  out/minikube-darwin-arm64 addons enable headlamp -p addons-365000 --alsologtostderr -v=1
addons_test.go:835: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:344: "headlamp-57fb76fcdb-j2k2b" [0b6ee212-004c-4f09-aa15-f309cb7e2dac] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-57fb76fcdb-j2k2b" [0b6ee212-004c-4f09-aa15-f309cb7e2dac] Running
addons_test.go:835: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 11.011060542s
addons_test.go:839: (dbg) Run:  out/minikube-darwin-arm64 -p addons-365000 addons disable headlamp --alsologtostderr -v=1
addons_test.go:839: (dbg) Done: out/minikube-darwin-arm64 -p addons-365000 addons disable headlamp --alsologtostderr -v=1: (5.282601291s)
--- PASS: TestAddons/parallel/Headlamp (16.69s)

                                                
                                    
x
+
TestAddons/parallel/CloudSpanner (5.2s)

                                                
                                                
=== RUN   TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CloudSpanner
addons_test.go:867: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:344: "cloud-spanner-emulator-c4bc9b5f8-rpdxv" [e4122f6a-a617-42c2-abfa-7d5a77892838] Running
addons_test.go:867: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 5.008325042s
addons_test.go:870: (dbg) Run:  out/minikube-darwin-arm64 addons disable cloud-spanner -p addons-365000
--- PASS: TestAddons/parallel/CloudSpanner (5.20s)

                                                
                                    
x
+
TestAddons/parallel/LocalPath (49.84s)

                                                
                                                
=== RUN   TestAddons/parallel/LocalPath
=== PAUSE TestAddons/parallel/LocalPath

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/LocalPath
addons_test.go:982: (dbg) Run:  kubectl --context addons-365000 apply -f testdata/storage-provisioner-rancher/pvc.yaml
addons_test.go:988: (dbg) Run:  kubectl --context addons-365000 apply -f testdata/storage-provisioner-rancher/pod.yaml
addons_test.go:992: (dbg) TestAddons/parallel/LocalPath: waiting 5m0s for pvc "test-pvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-365000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-365000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-365000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-365000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-365000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-365000 get pvc test-pvc -o jsonpath={.status.phase} -n default
addons_test.go:995: (dbg) TestAddons/parallel/LocalPath: waiting 3m0s for pods matching "run=test-local-path" in namespace "default" ...
helpers_test.go:344: "test-local-path" [8e7e121d-1d32-4d98-9fae-33feeec6b9c5] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "test-local-path" [8e7e121d-1d32-4d98-9fae-33feeec6b9c5] Pending / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "test-local-path" [8e7e121d-1d32-4d98-9fae-33feeec6b9c5] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
addons_test.go:995: (dbg) TestAddons/parallel/LocalPath: run=test-local-path healthy within 4.010512875s
addons_test.go:1000: (dbg) Run:  kubectl --context addons-365000 get pvc test-pvc -o=json
addons_test.go:1009: (dbg) Run:  out/minikube-darwin-arm64 -p addons-365000 ssh "cat /opt/local-path-provisioner/pvc-734a2a7e-2272-4081-b886-42612963d510_default_test-pvc/file1"
addons_test.go:1021: (dbg) Run:  kubectl --context addons-365000 delete pod test-local-path
addons_test.go:1025: (dbg) Run:  kubectl --context addons-365000 delete pvc test-pvc
addons_test.go:1029: (dbg) Run:  out/minikube-darwin-arm64 -p addons-365000 addons disable storage-provisioner-rancher --alsologtostderr -v=1
addons_test.go:1029: (dbg) Done: out/minikube-darwin-arm64 -p addons-365000 addons disable storage-provisioner-rancher --alsologtostderr -v=1: (40.311605084s)
--- PASS: TestAddons/parallel/LocalPath (49.84s)

                                                
                                    
x
+
TestAddons/parallel/NvidiaDevicePlugin (6.19s)

                                                
                                                
=== RUN   TestAddons/parallel/NvidiaDevicePlugin
=== PAUSE TestAddons/parallel/NvidiaDevicePlugin

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/NvidiaDevicePlugin
addons_test.go:1061: (dbg) TestAddons/parallel/NvidiaDevicePlugin: waiting 6m0s for pods matching "name=nvidia-device-plugin-ds" in namespace "kube-system" ...
helpers_test.go:344: "nvidia-device-plugin-daemonset-fg95p" [62dc3dc2-97e0-401a-b4a8-d04ac4e0a4d0] Running
addons_test.go:1061: (dbg) TestAddons/parallel/NvidiaDevicePlugin: name=nvidia-device-plugin-ds healthy within 6.010231417s
addons_test.go:1064: (dbg) Run:  out/minikube-darwin-arm64 addons disable nvidia-device-plugin -p addons-365000
--- PASS: TestAddons/parallel/NvidiaDevicePlugin (6.19s)

                                                
                                    
x
+
TestAddons/parallel/Yakd (10.28s)

                                                
                                                
=== RUN   TestAddons/parallel/Yakd
=== PAUSE TestAddons/parallel/Yakd

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Yakd
addons_test.go:1072: (dbg) TestAddons/parallel/Yakd: waiting 2m0s for pods matching "app.kubernetes.io/name=yakd-dashboard" in namespace "yakd-dashboard" ...
helpers_test.go:344: "yakd-dashboard-67d98fc6b-pfqsd" [3ce4454a-655f-4dda-9c04-ab5c4b36d249] Running
addons_test.go:1072: (dbg) TestAddons/parallel/Yakd: app.kubernetes.io/name=yakd-dashboard healthy within 5.007606917s
addons_test.go:1076: (dbg) Run:  out/minikube-darwin-arm64 -p addons-365000 addons disable yakd --alsologtostderr -v=1
addons_test.go:1076: (dbg) Done: out/minikube-darwin-arm64 -p addons-365000 addons disable yakd --alsologtostderr -v=1: (5.267608333s)
--- PASS: TestAddons/parallel/Yakd (10.28s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (12.4s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:174: (dbg) Run:  out/minikube-darwin-arm64 stop -p addons-365000
addons_test.go:174: (dbg) Done: out/minikube-darwin-arm64 stop -p addons-365000: (12.208254625s)
addons_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 addons enable dashboard -p addons-365000
addons_test.go:182: (dbg) Run:  out/minikube-darwin-arm64 addons disable dashboard -p addons-365000
addons_test.go:187: (dbg) Run:  out/minikube-darwin-arm64 addons disable gvisor -p addons-365000
--- PASS: TestAddons/StoppedEnableDisable (12.40s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (10.64s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
=== PAUSE TestHyperKitDriverInstallOrUpdate

                                                
                                                

                                                
                                                
=== CONT  TestHyperKitDriverInstallOrUpdate
--- PASS: TestHyperKitDriverInstallOrUpdate (10.64s)

                                                
                                    
x
+
TestErrorSpam/setup (35.45s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-darwin-arm64 start -p nospam-164000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/nospam-164000 --driver=qemu2 
error_spam_test.go:81: (dbg) Done: out/minikube-darwin-arm64 start -p nospam-164000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/nospam-164000 --driver=qemu2 : (35.45435s)
error_spam_test.go:91: acceptable stderr: "! /usr/local/bin/kubectl is version 1.29.2, which may have incompatibilities with Kubernetes 1.31.0."
--- PASS: TestErrorSpam/setup (35.45s)

                                                
                                    
x
+
TestErrorSpam/start (0.34s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-164000 --log_dir /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/nospam-164000 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-164000 --log_dir /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/nospam-164000 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-164000 --log_dir /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/nospam-164000 start --dry-run
--- PASS: TestErrorSpam/start (0.34s)

                                                
                                    
x
+
TestErrorSpam/status (0.23s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-164000 --log_dir /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/nospam-164000 status
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-164000 --log_dir /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/nospam-164000 status
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-164000 --log_dir /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/nospam-164000 status
--- PASS: TestErrorSpam/status (0.23s)

                                                
                                    
x
+
TestErrorSpam/pause (0.71s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-164000 --log_dir /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/nospam-164000 pause
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-164000 --log_dir /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/nospam-164000 pause
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-164000 --log_dir /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/nospam-164000 pause
--- PASS: TestErrorSpam/pause (0.71s)

                                                
                                    
x
+
TestErrorSpam/unpause (0.62s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-164000 --log_dir /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/nospam-164000 unpause
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-164000 --log_dir /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/nospam-164000 unpause
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-164000 --log_dir /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/nospam-164000 unpause
--- PASS: TestErrorSpam/unpause (0.62s)

                                                
                                    
x
+
TestErrorSpam/stop (64.3s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-164000 --log_dir /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/nospam-164000 stop
error_spam_test.go:159: (dbg) Done: out/minikube-darwin-arm64 -p nospam-164000 --log_dir /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/nospam-164000 stop: (12.204643834s)
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-164000 --log_dir /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/nospam-164000 stop
error_spam_test.go:159: (dbg) Done: out/minikube-darwin-arm64 -p nospam-164000 --log_dir /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/nospam-164000 stop: (26.057736s)
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-164000 --log_dir /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/nospam-164000 stop
error_spam_test.go:182: (dbg) Done: out/minikube-darwin-arm64 -p nospam-164000 --log_dir /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/nospam-164000 stop: (26.03221025s)
--- PASS: TestErrorSpam/stop (64.30s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1855: local sync path: /Users/jenkins/minikube-integration/19443-949/.minikube/files/etc/test/nested/copy/1404/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (48.54s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2234: (dbg) Run:  out/minikube-darwin-arm64 start -p functional-248000 --memory=4000 --apiserver-port=8441 --wait=all --driver=qemu2 
E0814 17:13:21.410882    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:13:21.419098    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:13:21.432459    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:13:21.455797    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:13:21.499146    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:13:21.582596    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:13:21.744588    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:13:22.068029    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:13:22.711489    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:13:23.994965    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:13:26.558584    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
functional_test.go:2234: (dbg) Done: out/minikube-darwin-arm64 start -p functional-248000 --memory=4000 --apiserver-port=8441 --wait=all --driver=qemu2 : (48.537597084s)
--- PASS: TestFunctional/serial/StartWithProxy (48.54s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (34.77s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
functional_test.go:659: (dbg) Run:  out/minikube-darwin-arm64 start -p functional-248000 --alsologtostderr -v=8
E0814 17:13:31.682471    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:13:41.926302    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:14:02.408220    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
functional_test.go:659: (dbg) Done: out/minikube-darwin-arm64 start -p functional-248000 --alsologtostderr -v=8: (34.771606292s)
functional_test.go:663: soft start took 34.772029792s for "functional-248000" cluster.
--- PASS: TestFunctional/serial/SoftStart (34.77s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.03s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:681: (dbg) Run:  kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.03s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.05s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:696: (dbg) Run:  kubectl --context functional-248000 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.05s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (2.74s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1049: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 cache add registry.k8s.io/pause:3.1
functional_test.go:1049: (dbg) Done: out/minikube-darwin-arm64 -p functional-248000 cache add registry.k8s.io/pause:3.1: (1.038758458s)
functional_test.go:1049: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 cache add registry.k8s.io/pause:3.3
functional_test.go:1049: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 cache add registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (2.74s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (1.17s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1077: (dbg) Run:  docker build -t minikube-local-cache-test:functional-248000 /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalserialCacheCmdcacheadd_local1608423303/001
functional_test.go:1089: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 cache add minikube-local-cache-test:functional-248000
functional_test.go:1094: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 cache delete minikube-local-cache-test:functional-248000
functional_test.go:1083: (dbg) Run:  docker rmi minikube-local-cache-test:functional-248000
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.17s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.04s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1102: (dbg) Run:  out/minikube-darwin-arm64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.04s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.03s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1110: (dbg) Run:  out/minikube-darwin-arm64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.03s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.07s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1124: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.07s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (0.62s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1147: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh sudo docker rmi registry.k8s.io/pause:latest
functional_test.go:1153: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1153: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-248000 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (63.835334ms)

                                                
                                                
-- stdout --
	FATA[0000] no such image "registry.k8s.io/pause:latest" present 

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:1158: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 cache reload
functional_test.go:1163: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh sudo crictl inspecti registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (0.62s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.07s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1172: (dbg) Run:  out/minikube-darwin-arm64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1172: (dbg) Run:  out/minikube-darwin-arm64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.07s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.74s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:716: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 kubectl -- --context functional-248000 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.74s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (1.02s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:741: (dbg) Run:  out/kubectl --context functional-248000 get pods
functional_test.go:741: (dbg) Done: out/kubectl --context functional-248000 get pods: (1.018639083s)
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (1.02s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (37.65s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:757: (dbg) Run:  out/minikube-darwin-arm64 start -p functional-248000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
E0814 17:14:43.371444    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
functional_test.go:757: (dbg) Done: out/minikube-darwin-arm64 start -p functional-248000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (37.645026208s)
functional_test.go:761: restart took 37.64511825s for "functional-248000" cluster.
--- PASS: TestFunctional/serial/ExtraConfig (37.65s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.05s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:810: (dbg) Run:  kubectl --context functional-248000 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:825: etcd phase: Running
functional_test.go:835: etcd status: Ready
functional_test.go:825: kube-apiserver phase: Running
functional_test.go:835: kube-apiserver status: Ready
functional_test.go:825: kube-controller-manager phase: Running
functional_test.go:835: kube-controller-manager status: Ready
functional_test.go:825: kube-scheduler phase: Running
functional_test.go:835: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.05s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (0.66s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1236: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 logs
--- PASS: TestFunctional/serial/LogsCmd (0.66s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (0.66s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1250: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 logs --file /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalserialLogsFileCmd225435752/001/logs.txt
--- PASS: TestFunctional/serial/LogsFileCmd (0.66s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (4.68s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2321: (dbg) Run:  kubectl --context functional-248000 apply -f testdata/invalidsvc.yaml
functional_test.go:2335: (dbg) Run:  out/minikube-darwin-arm64 service invalid-svc -p functional-248000
functional_test.go:2335: (dbg) Non-zero exit: out/minikube-darwin-arm64 service invalid-svc -p functional-248000: exit status 115 (143.248792ms)

                                                
                                                
-- stdout --
	|-----------|-------------|-------------|----------------------------|
	| NAMESPACE |    NAME     | TARGET PORT |            URL             |
	|-----------|-------------|-------------|----------------------------|
	| default   | invalid-svc |          80 | http://192.168.105.4:30543 |
	|-----------|-------------|-------------|----------------------------|
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found
	* 
	╭────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                            │
	│    * If the above advice does not help, please let us know:                                                                │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                              │
	│                                                                                                                            │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                   │
	│    * Please also attach the following file to the GitHub issue:                                                            │
	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log    │
	│                                                                                                                            │
	╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:2327: (dbg) Run:  kubectl --context functional-248000 delete -f testdata/invalidsvc.yaml
functional_test.go:2327: (dbg) Done: kubectl --context functional-248000 delete -f testdata/invalidsvc.yaml: (1.443008s)
--- PASS: TestFunctional/serial/InvalidService (4.68s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1199: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 config unset cpus
functional_test.go:1199: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 config get cpus
functional_test.go:1199: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-248000 config get cpus: exit status 14 (30.668834ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1199: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 config set cpus 2
functional_test.go:1199: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 config get cpus
functional_test.go:1199: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 config unset cpus
functional_test.go:1199: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 config get cpus
functional_test.go:1199: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-248000 config get cpus: exit status 14 (31.239792ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.23s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (9.56s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:905: (dbg) daemon: [out/minikube-darwin-arm64 dashboard --url --port 36195 -p functional-248000 --alsologtostderr -v=1]
functional_test.go:910: (dbg) stopping [out/minikube-darwin-arm64 dashboard --url --port 36195 -p functional-248000 --alsologtostderr -v=1] ...
helpers_test.go:508: unable to kill pid 2098: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (9.56s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:974: (dbg) Run:  out/minikube-darwin-arm64 start -p functional-248000 --dry-run --memory 250MB --alsologtostderr --driver=qemu2 
functional_test.go:974: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p functional-248000 --dry-run --memory 250MB --alsologtostderr --driver=qemu2 : exit status 23 (129.728292ms)

                                                
                                                
-- stdout --
	* [functional-248000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:15:35.426445    2085 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:15:35.426581    2085 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:15:35.426584    2085 out.go:304] Setting ErrFile to fd 2...
	I0814 17:15:35.426587    2085 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:15:35.426716    2085 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:15:35.427690    2085 out.go:298] Setting JSON to false
	I0814 17:15:35.443765    2085 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":898,"bootTime":1723680037,"procs":454,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:15:35.443849    2085 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:15:35.448484    2085 out.go:177] * [functional-248000] minikube v1.33.1 on Darwin 14.5 (arm64)
	I0814 17:15:35.455501    2085 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:15:35.455541    2085 notify.go:220] Checking for updates...
	I0814 17:15:35.466498    2085 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:15:35.474414    2085 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:15:35.477466    2085 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:15:35.480350    2085 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:15:35.490981    2085 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:15:35.493748    2085 config.go:182] Loaded profile config "functional-248000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:15:35.494019    2085 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:15:35.497407    2085 out.go:177] * Using the qemu2 driver based on existing profile
	I0814 17:15:35.504415    2085 start.go:297] selected driver: qemu2
	I0814 17:15:35.504420    2085 start.go:901] validating driver "qemu2" against &{Name:functional-248000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.0 ClusterName:functional-248000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpirat
ion:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:15:35.504475    2085 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:15:35.510387    2085 out.go:177] 
	W0814 17:15:35.514515    2085 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I0814 17:15:35.518524    2085 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:991: (dbg) Run:  out/minikube-darwin-arm64 start -p functional-248000 --dry-run --alsologtostderr -v=1 --driver=qemu2 
--- PASS: TestFunctional/parallel/DryRun (0.24s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.12s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1020: (dbg) Run:  out/minikube-darwin-arm64 start -p functional-248000 --dry-run --memory 250MB --alsologtostderr --driver=qemu2 
functional_test.go:1020: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p functional-248000 --dry-run --memory 250MB --alsologtostderr --driver=qemu2 : exit status 23 (115.805875ms)

                                                
                                                
-- stdout --
	* [functional-248000] minikube v1.33.1 sur Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote qemu2 basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0814 17:15:35.305823    2081 out.go:291] Setting OutFile to fd 1 ...
	I0814 17:15:35.305935    2081 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:15:35.305938    2081 out.go:304] Setting ErrFile to fd 2...
	I0814 17:15:35.305941    2081 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0814 17:15:35.306068    2081 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
	I0814 17:15:35.307490    2081 out.go:298] Setting JSON to false
	I0814 17:15:35.324314    2081 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":898,"bootTime":1723680037,"procs":454,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}
	W0814 17:15:35.324387    2081 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0814 17:15:35.330528    2081 out.go:177] * [functional-248000] minikube v1.33.1 sur Darwin 14.5 (arm64)
	I0814 17:15:35.338459    2081 out.go:177]   - MINIKUBE_LOCATION=19443
	I0814 17:15:35.338507    2081 notify.go:220] Checking for updates...
	I0814 17:15:35.346407    2081 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	I0814 17:15:35.350471    2081 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I0814 17:15:35.353453    2081 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0814 17:15:35.356481    2081 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	I0814 17:15:35.359416    2081 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0814 17:15:35.362855    2081 config.go:182] Loaded profile config "functional-248000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
	I0814 17:15:35.363116    2081 driver.go:392] Setting default libvirt URI to qemu:///system
	I0814 17:15:35.367412    2081 out.go:177] * Utilisation du pilote qemu2 basé sur le profil existant
	I0814 17:15:35.374419    2081 start.go:297] selected driver: qemu2
	I0814 17:15:35.374427    2081 start.go:901] validating driver "qemu2" against &{Name:functional-248000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19443/minikube-v1.33.1-1723650137-19443-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723650208-19443@sha256:2be48dc5c74cde3c1d15ac913a640f4a2331b48358b81777568fb487d2757002 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.0 ClusterName:functional-248000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpirat
ion:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0814 17:15:35.374479    2081 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0814 17:15:35.380413    2081 out.go:177] 
	W0814 17:15:35.384491    2081 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I0814 17:15:35.388314    2081 out.go:177] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.12s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:854: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 status
functional_test.go:860: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:872: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (0.23s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1690: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 addons list
functional_test.go:1702: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (23.95s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:344: "storage-provisioner" [00f0c3b8-7d7e-49d8-8689-a1e8d94cbe86] Running
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 5.020033583s
functional_test_pvc_test.go:49: (dbg) Run:  kubectl --context functional-248000 get storageclass -o=json
functional_test_pvc_test.go:69: (dbg) Run:  kubectl --context functional-248000 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-248000 get pvc myclaim -o=json
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-248000 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [5c3b8ef2-d69c-4c8f-9fed-ce24fc529d22] Pending
helpers_test.go:344: "sp-pod" [5c3b8ef2-d69c-4c8f-9fed-ce24fc529d22] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [5c3b8ef2-d69c-4c8f-9fed-ce24fc529d22] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 11.005637542s
functional_test_pvc_test.go:100: (dbg) Run:  kubectl --context functional-248000 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:106: (dbg) Run:  kubectl --context functional-248000 delete -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-248000 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [53eee139-90ca-4d19-b835-d1e9c48c409d] Pending
helpers_test.go:344: "sp-pod" [53eee139-90ca-4d19-b835-d1e9c48c409d] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [53eee139-90ca-4d19-b835-d1e9c48c409d] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 7.00895025s
functional_test_pvc_test.go:114: (dbg) Run:  kubectl --context functional-248000 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (23.95s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.12s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1725: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh "echo hello"
functional_test.go:1742: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.12s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (0.4s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh -n functional-248000 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 cp functional-248000:/home/docker/cp-test.txt /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelCpCmd2493638077/001/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh -n functional-248000 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh -n functional-248000 "sudo cat /tmp/does/not/exist/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (0.40s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.06s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1929: Checking for existence of /etc/test/nested/copy/1404/hosts within VM
functional_test.go:1931: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh "sudo cat /etc/test/nested/copy/1404/hosts"
functional_test.go:1936: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.06s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (0.39s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1972: Checking for existence of /etc/ssl/certs/1404.pem within VM
functional_test.go:1973: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh "sudo cat /etc/ssl/certs/1404.pem"
functional_test.go:1972: Checking for existence of /usr/share/ca-certificates/1404.pem within VM
functional_test.go:1973: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh "sudo cat /usr/share/ca-certificates/1404.pem"
functional_test.go:1972: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1973: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:1999: Checking for existence of /etc/ssl/certs/14042.pem within VM
functional_test.go:2000: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh "sudo cat /etc/ssl/certs/14042.pem"
functional_test.go:1999: Checking for existence of /usr/share/ca-certificates/14042.pem within VM
functional_test.go:2000: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh "sudo cat /usr/share/ca-certificates/14042.pem"
functional_test.go:1999: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:2000: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (0.39s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.04s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:219: (dbg) Run:  kubectl --context functional-248000 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.04s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.06s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2027: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh "sudo systemctl is-active crio"
functional_test.go:2027: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-248000 ssh "sudo systemctl is-active crio": exit status 1 (64.198125ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.06s)

                                                
                                    
x
+
TestFunctional/parallel/License (0.39s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2288: (dbg) Run:  out/minikube-darwin-arm64 license
--- PASS: TestFunctional/parallel/License (0.39s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.84s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-darwin-arm64 -p functional-248000 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-darwin-arm64 -p functional-248000 tunnel --alsologtostderr]
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-darwin-arm64 -p functional-248000 tunnel --alsologtostderr] ...
helpers_test.go:508: unable to kill pid 1943: os: process already finished
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-darwin-arm64 -p functional-248000 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.84s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.02s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-darwin-arm64 -p functional-248000 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.02s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (10.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:212: (dbg) Run:  kubectl --context functional-248000 apply -f testdata/testsvc.yaml
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...
helpers_test.go:344: "nginx-svc" [6fd3181c-0b71-443b-b16f-06c05e503b31] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx-svc" [6fd3181c-0b71-443b-b16f-06c05e503b31] Running
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 10.004435s
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (10.10s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.04s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP
functional_test_tunnel_test.go:234: (dbg) Run:  kubectl --context functional-248000 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.04s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.01s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:299: tunnel at http://10.107.179.204 is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.01s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.02s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:319: (dbg) Run:  dig +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A
functional_test_tunnel_test.go:327: DNS resolution by dig for nginx-svc.default.svc.cluster.local. is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.02s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.02s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:351: (dbg) Run:  dscacheutil -q host -a name nginx-svc.default.svc.cluster.local.
functional_test_tunnel_test.go:359: DNS resolution by dscacheutil for nginx-svc.default.svc.cluster.local. is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.02s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.01s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:424: tunnel at http://nginx-svc.default.svc.cluster.local. is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.01s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.12s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-darwin-arm64 -p functional-248000 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.12s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (6.09s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1437: (dbg) Run:  kubectl --context functional-248000 create deployment hello-node --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1445: (dbg) Run:  kubectl --context functional-248000 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1450: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:344: "hello-node-64b4f8f9ff-pcth6" [b965467d-be4f-41e6-b4b1-61f6a55c96d8] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-64b4f8f9ff-pcth6" [b965467d-be4f-41e6-b4b1-61f6a55c96d8] Running / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
functional_test.go:1450: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: app=hello-node healthy within 6.005956375s
--- PASS: TestFunctional/parallel/ServiceCmd/DeployApp (6.09s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.3s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1459: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 service list
--- PASS: TestFunctional/parallel/ServiceCmd/List (0.30s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.29s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1489: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 service list -o json
functional_test.go:1494: Took "286.483958ms" to run "out/minikube-darwin-arm64 -p functional-248000 service list -o json"
--- PASS: TestFunctional/parallel/ServiceCmd/JSONOutput (0.29s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1509: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 service --namespace=default --https --url hello-node
functional_test.go:1522: found endpoint: https://192.168.105.4:31676
--- PASS: TestFunctional/parallel/ServiceCmd/HTTPS (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.09s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1540: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 service hello-node --url --format={{.IP}}
--- PASS: TestFunctional/parallel/ServiceCmd/Format (0.09s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.09s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1559: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 service hello-node --url
functional_test.go:1565: found endpoint for hello-node: http://192.168.105.4:31676
--- PASS: TestFunctional/parallel/ServiceCmd/URL (0.09s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.12s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1270: (dbg) Run:  out/minikube-darwin-arm64 profile lis
functional_test.go:1275: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.12s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.12s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1310: (dbg) Run:  out/minikube-darwin-arm64 profile list
functional_test.go:1315: Took "83.044875ms" to run "out/minikube-darwin-arm64 profile list"
functional_test.go:1324: (dbg) Run:  out/minikube-darwin-arm64 profile list -l
functional_test.go:1329: Took "34.720625ms" to run "out/minikube-darwin-arm64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.12s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.12s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1361: (dbg) Run:  out/minikube-darwin-arm64 profile list -o json
functional_test.go:1366: Took "87.662916ms" to run "out/minikube-darwin-arm64 profile list -o json"
functional_test.go:1374: (dbg) Run:  out/minikube-darwin-arm64 profile list -o json --light
functional_test.go:1379: Took "33.722125ms" to run "out/minikube-darwin-arm64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.12s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (6.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-darwin-arm64 mount -p functional-248000 /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdany-port3664838828/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1723680926675188000" to /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdany-port3664838828/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1723680926675188000" to /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdany-port3664838828/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1723680926675188000" to /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdany-port3664838828/001/test-1723680926675188000
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-248000 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (54.4515ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-248000 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (90.951792ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:129: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh -- ls -la /mount-9p
functional_test_mount_test.go:133: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Aug 15 00:15 created-by-test
-rw-r--r-- 1 docker docker 24 Aug 15 00:15 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Aug 15 00:15 test-1723680926675188000
functional_test_mount_test.go:137: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh cat /mount-9p/test-1723680926675188000
functional_test_mount_test.go:148: (dbg) Run:  kubectl --context functional-248000 replace --force -f testdata/busybox-mount-test.yaml
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:344: "busybox-mount" [77aa892c-c14f-47c0-b8c5-db04d74dcc65] Pending
helpers_test.go:344: "busybox-mount" [77aa892c-c14f-47c0-b8c5-db04d74dcc65] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
helpers_test.go:344: "busybox-mount" [77aa892c-c14f-47c0-b8c5-db04d74dcc65] Pending / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "busybox-mount" [77aa892c-c14f-47c0-b8c5-db04d74dcc65] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 4.008071041s
functional_test_mount_test.go:169: (dbg) Run:  kubectl --context functional-248000 logs busybox-mount
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh stat /mount-9p/created-by-test
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh stat /mount-9p/created-by-pod
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-darwin-arm64 mount -p functional-248000 /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdany-port3664838828/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (6.25s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (1.16s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-darwin-arm64 mount -p functional-248000 /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdspecific-port3301669921/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-248000 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (56.488917ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:257: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh -- ls -la /mount-9p
functional_test_mount_test.go:261: guest mount directory contents
total 0
functional_test_mount_test.go:263: (dbg) stopping [out/minikube-darwin-arm64 mount -p functional-248000 /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdspecific-port3301669921/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
functional_test_mount_test.go:264: reading mount text
functional_test_mount_test.go:278: done reading mount text
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-248000 ssh "sudo umount -f /mount-9p": exit status 1 (57.072709ms)

                                                
                                                
-- stdout --
	umount: /mount-9p: not mounted.

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 32

                                                
                                                
** /stderr **
functional_test_mount_test.go:232: "out/minikube-darwin-arm64 -p functional-248000 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-darwin-arm64 mount -p functional-248000 /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdspecific-port3301669921/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- PASS: TestFunctional/parallel/MountCmd/specific-port (1.16s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (0.97s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-darwin-arm64 mount -p functional-248000 /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdVerifyCleanup1206242887/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-darwin-arm64 mount -p functional-248000 /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdVerifyCleanup1206242887/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-darwin-arm64 mount -p functional-248000 /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdVerifyCleanup1206242887/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-248000 ssh "findmnt -T" /mount1: exit status 1 (64.947916ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh "findmnt -T" /mount2
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh "findmnt -T" /mount3
functional_test_mount_test.go:370: (dbg) Run:  out/minikube-darwin-arm64 mount -p functional-248000 --kill=true
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-darwin-arm64 mount -p functional-248000 /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdVerifyCleanup1206242887/001:/mount1 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-darwin-arm64 mount -p functional-248000 /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdVerifyCleanup1206242887/001:/mount2 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-darwin-arm64 mount -p functional-248000 /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdVerifyCleanup1206242887/001:/mount3 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/MountCmd/VerifyCleanup (0.97s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.04s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2256: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 version --short
--- PASS: TestFunctional/parallel/Version/short (0.04s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (0.15s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2270: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 version -o=json --components
--- PASS: TestFunctional/parallel/Version/components (0.15s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:261: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 image ls --format short --alsologtostderr
functional_test.go:266: (dbg) Stdout: out/minikube-darwin-arm64 -p functional-248000 image ls --format short --alsologtostderr:
registry.k8s.io/pause:latest
registry.k8s.io/pause:3.3
registry.k8s.io/pause:3.10
registry.k8s.io/pause:3.1
registry.k8s.io/kube-scheduler:v1.31.0
registry.k8s.io/kube-proxy:v1.31.0
registry.k8s.io/kube-controller-manager:v1.31.0
registry.k8s.io/kube-apiserver:v1.31.0
registry.k8s.io/etcd:3.5.15-0
registry.k8s.io/echoserver-arm:1.8
registry.k8s.io/coredns/coredns:v1.11.1
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
docker.io/library/nginx:latest
docker.io/library/nginx:alpine
docker.io/library/minikube-local-cache-test:functional-248000
docker.io/kubernetesui/metrics-scraper:<none>
docker.io/kubernetesui/dashboard:<none>
docker.io/kicbase/echo-server:functional-248000
functional_test.go:269: (dbg) Stderr: out/minikube-darwin-arm64 -p functional-248000 image ls --format short --alsologtostderr:
I0814 17:15:44.524240    2243 out.go:291] Setting OutFile to fd 1 ...
I0814 17:15:44.524383    2243 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0814 17:15:44.524387    2243 out.go:304] Setting ErrFile to fd 2...
I0814 17:15:44.524390    2243 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0814 17:15:44.524541    2243 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
I0814 17:15:44.524984    2243 config.go:182] Loaded profile config "functional-248000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
I0814 17:15:44.525051    2243 config.go:182] Loaded profile config "functional-248000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
I0814 17:15:44.525893    2243 ssh_runner.go:195] Run: systemctl --version
I0814 17:15:44.525904    2243 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/functional-248000/id_rsa Username:docker}
I0814 17:15:44.548763    2243 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.07s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:261: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 image ls --format table --alsologtostderr
functional_test.go:266: (dbg) Stdout: out/minikube-darwin-arm64 -p functional-248000 image ls --format table --alsologtostderr:
|---------------------------------------------|-------------------|---------------|--------|
|                    Image                    |        Tag        |   Image ID    |  Size  |
|---------------------------------------------|-------------------|---------------|--------|
| registry.k8s.io/kube-apiserver              | v1.31.0           | cd0f0ae0ec9e0 | 91.5MB |
| registry.k8s.io/pause                       | 3.10              | afb61768ce381 | 514kB  |
| registry.k8s.io/coredns/coredns             | v1.11.1           | 2437cf7621777 | 57.4MB |
| registry.k8s.io/pause                       | 3.3               | 3d18732f8686c | 484kB  |
| registry.k8s.io/pause                       | 3.1               | 8057e0500773a | 525kB  |
| registry.k8s.io/kube-scheduler              | v1.31.0           | fbbbd428abb4d | 66MB   |
| docker.io/kubernetesui/metrics-scraper      | <none>            | a422e0e982356 | 42.3MB |
| gcr.io/k8s-minikube/storage-provisioner     | v5                | ba04bb24b9575 | 29MB   |
| docker.io/kicbase/echo-server               | functional-248000 | ce2d2cda2d858 | 4.78MB |
| gcr.io/k8s-minikube/busybox                 | 1.28.4-glibc      | 1611cd07b61d5 | 3.55MB |
| registry.k8s.io/echoserver-arm              | 1.8               | 72565bf5bbedf | 85MB   |
| registry.k8s.io/kube-proxy                  | v1.31.0           | 71d55d66fd4ee | 94.7MB |
| registry.k8s.io/etcd                        | 3.5.15-0          | 27e3830e14027 | 139MB  |
| docker.io/library/nginx                     | latest            | 235ff27fe7956 | 193MB  |
| docker.io/library/nginx                     | alpine            | d7cd33d7d4ed1 | 44.8MB |
| docker.io/kubernetesui/dashboard            | <none>            | 20b332c9a70d8 | 244MB  |
| registry.k8s.io/pause                       | latest            | 8cb2091f603e7 | 240kB  |
| docker.io/library/minikube-local-cache-test | functional-248000 | 0eab15208e6c7 | 30B    |
| registry.k8s.io/kube-controller-manager     | v1.31.0           | fcb0683e6bdbd | 85.9MB |
|---------------------------------------------|-------------------|---------------|--------|
functional_test.go:269: (dbg) Stderr: out/minikube-darwin-arm64 -p functional-248000 image ls --format table --alsologtostderr:
I0814 17:15:44.666389    2247 out.go:291] Setting OutFile to fd 1 ...
I0814 17:15:44.666542    2247 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0814 17:15:44.666545    2247 out.go:304] Setting ErrFile to fd 2...
I0814 17:15:44.666548    2247 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0814 17:15:44.666672    2247 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
I0814 17:15:44.667103    2247 config.go:182] Loaded profile config "functional-248000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
I0814 17:15:44.667172    2247 config.go:182] Loaded profile config "functional-248000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
I0814 17:15:44.667992    2247 ssh_runner.go:195] Run: systemctl --version
I0814 17:15:44.668001    2247 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/functional-248000/id_rsa Username:docker}
I0814 17:15:44.691681    2247 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.07s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:261: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 image ls --format json --alsologtostderr
functional_test.go:266: (dbg) Stdout: out/minikube-darwin-arm64 -p functional-248000 image ls --format json --alsologtostderr:
[{"id":"72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb","repoDigests":[],"repoTags":["registry.k8s.io/echoserver-arm:1.8"],"size":"85000000"},{"id":"27e3830e1402783674d8b594038967deea9d51f0d91b34c93c8f39d2f68af7da","repoDigests":[],"repoTags":["registry.k8s.io/etcd:3.5.15-0"],"size":"139000000"},{"id":"20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8","repoDigests":[],"repoTags":["docker.io/kubernetesui/dashboard:\u003cnone\u003e"],"size":"244000000"},{"id":"a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a","repoDigests":[],"repoTags":["docker.io/kubernetesui/metrics-scraper:\u003cnone\u003e"],"size":"42300000"},{"id":"1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c","repoDigests":[],"repoTags":["gcr.io/k8s-minikube/busybox:1.28.4-glibc"],"size":"3550000"},{"id":"8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.1"],"size":"525000"},{"id":"fbbbd428abb4dae52ab3018797d
00d5840a739f0cc5697b662791831a60b0adb","repoDigests":[],"repoTags":["registry.k8s.io/kube-scheduler:v1.31.0"],"size":"66000000"},{"id":"71d55d66fd4eec8986225089a135fadd96bc6624d987096808772ce1e1924d89","repoDigests":[],"repoTags":["registry.k8s.io/kube-proxy:v1.31.0"],"size":"94700000"},{"id":"fcb0683e6bdbd083710cf2d6fd7eb699c77fe4994c38a5c82d059e2e3cb4c2fd","repoDigests":[],"repoTags":["registry.k8s.io/kube-controller-manager:v1.31.0"],"size":"85900000"},{"id":"ce2d2cda2d858fdaea84129deb86d18e5dbf1c548f230b79fdca74cc91729d17","repoDigests":[],"repoTags":["docker.io/kicbase/echo-server:functional-248000"],"size":"4780000"},{"id":"ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6","repoDigests":[],"repoTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"29000000"},{"id":"8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a","repoDigests":[],"repoTags":["registry.k8s.io/pause:latest"],"size":"240000"},{"id":"0eab15208e6c7f96430219044ba246f0e4342124b2b45af31fb0a6a1e3b8e033","r
epoDigests":[],"repoTags":["docker.io/library/minikube-local-cache-test:functional-248000"],"size":"30"},{"id":"cd0f0ae0ec9e0cdc092079156c122bf034ba3f24d31c1b1dd1b52a42ecf9b388","repoDigests":[],"repoTags":["registry.k8s.io/kube-apiserver:v1.31.0"],"size":"91500000"},{"id":"afb61768ce381961ca0beff95337601f29dc70ff3ed14e5e4b3e5699057e6aa8","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.10"],"size":"514000"},{"id":"2437cf762177702dec2dfe99a09c37427a15af6d9a57c456b65352667c223d93","repoDigests":[],"repoTags":["registry.k8s.io/coredns/coredns:v1.11.1"],"size":"57400000"},{"id":"3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.3"],"size":"484000"},{"id":"235ff27fe79567e8ccaf4d26a2d24828a65898a83b97fba3c7e39ec4621e1b51","repoDigests":[],"repoTags":["docker.io/library/nginx:latest"],"size":"193000000"},{"id":"d7cd33d7d4ed1cdef69594adc36fcc03a0aa45ba930d39a9286024d9b2322660","repoDigests":[],"repoTags":["docker.io/library/nginx:alpine"],"si
ze":"44800000"}]
functional_test.go:269: (dbg) Stderr: out/minikube-darwin-arm64 -p functional-248000 image ls --format json --alsologtostderr:
I0814 17:15:44.592590    2245 out.go:291] Setting OutFile to fd 1 ...
I0814 17:15:44.592785    2245 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0814 17:15:44.592793    2245 out.go:304] Setting ErrFile to fd 2...
I0814 17:15:44.592795    2245 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0814 17:15:44.592933    2245 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
I0814 17:15:44.593384    2245 config.go:182] Loaded profile config "functional-248000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
I0814 17:15:44.593441    2245 config.go:182] Loaded profile config "functional-248000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
I0814 17:15:44.594269    2245 ssh_runner.go:195] Run: systemctl --version
I0814 17:15:44.594286    2245 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/functional-248000/id_rsa Username:docker}
I0814 17:15:44.616395    2245 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.07s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:261: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 image ls --format yaml --alsologtostderr
functional_test.go:266: (dbg) Stdout: out/minikube-darwin-arm64 -p functional-248000 image ls --format yaml --alsologtostderr:
- id: 20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8
repoDigests: []
repoTags:
- docker.io/kubernetesui/dashboard:<none>
size: "244000000"
- id: 1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c
repoDigests: []
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "3550000"
- id: fcb0683e6bdbd083710cf2d6fd7eb699c77fe4994c38a5c82d059e2e3cb4c2fd
repoDigests: []
repoTags:
- registry.k8s.io/kube-controller-manager:v1.31.0
size: "85900000"
- id: 71d55d66fd4eec8986225089a135fadd96bc6624d987096808772ce1e1924d89
repoDigests: []
repoTags:
- registry.k8s.io/kube-proxy:v1.31.0
size: "94700000"
- id: 27e3830e1402783674d8b594038967deea9d51f0d91b34c93c8f39d2f68af7da
repoDigests: []
repoTags:
- registry.k8s.io/etcd:3.5.15-0
size: "139000000"
- id: 235ff27fe79567e8ccaf4d26a2d24828a65898a83b97fba3c7e39ec4621e1b51
repoDigests: []
repoTags:
- docker.io/library/nginx:latest
size: "193000000"
- id: 2437cf762177702dec2dfe99a09c37427a15af6d9a57c456b65352667c223d93
repoDigests: []
repoTags:
- registry.k8s.io/coredns/coredns:v1.11.1
size: "57400000"
- id: 0eab15208e6c7f96430219044ba246f0e4342124b2b45af31fb0a6a1e3b8e033
repoDigests: []
repoTags:
- docker.io/library/minikube-local-cache-test:functional-248000
size: "30"
- id: 3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.3
size: "484000"
- id: 8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.1
size: "525000"
- id: a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a
repoDigests: []
repoTags:
- docker.io/kubernetesui/metrics-scraper:<none>
size: "42300000"
- id: ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6
repoDigests: []
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "29000000"
- id: 72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb
repoDigests: []
repoTags:
- registry.k8s.io/echoserver-arm:1.8
size: "85000000"
- id: 8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a
repoDigests: []
repoTags:
- registry.k8s.io/pause:latest
size: "240000"
- id: cd0f0ae0ec9e0cdc092079156c122bf034ba3f24d31c1b1dd1b52a42ecf9b388
repoDigests: []
repoTags:
- registry.k8s.io/kube-apiserver:v1.31.0
size: "91500000"
- id: fbbbd428abb4dae52ab3018797d00d5840a739f0cc5697b662791831a60b0adb
repoDigests: []
repoTags:
- registry.k8s.io/kube-scheduler:v1.31.0
size: "66000000"
- id: d7cd33d7d4ed1cdef69594adc36fcc03a0aa45ba930d39a9286024d9b2322660
repoDigests: []
repoTags:
- docker.io/library/nginx:alpine
size: "44800000"
- id: afb61768ce381961ca0beff95337601f29dc70ff3ed14e5e4b3e5699057e6aa8
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.10
size: "514000"
- id: ce2d2cda2d858fdaea84129deb86d18e5dbf1c548f230b79fdca74cc91729d17
repoDigests: []
repoTags:
- docker.io/kicbase/echo-server:functional-248000
size: "4780000"

                                                
                                                
functional_test.go:269: (dbg) Stderr: out/minikube-darwin-arm64 -p functional-248000 image ls --format yaml --alsologtostderr:
I0814 17:15:44.733465    2249 out.go:291] Setting OutFile to fd 1 ...
I0814 17:15:44.733872    2249 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0814 17:15:44.733877    2249 out.go:304] Setting ErrFile to fd 2...
I0814 17:15:44.733880    2249 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0814 17:15:44.734097    2249 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
I0814 17:15:44.734846    2249 config.go:182] Loaded profile config "functional-248000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
I0814 17:15:44.734932    2249 config.go:182] Loaded profile config "functional-248000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
I0814 17:15:44.735765    2249 ssh_runner.go:195] Run: systemctl --version
I0814 17:15:44.735777    2249 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/functional-248000/id_rsa Username:docker}
I0814 17:15:44.756647    2249 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.07s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (1.73s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:308: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 ssh pgrep buildkitd
functional_test.go:308: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-248000 ssh pgrep buildkitd: exit status 1 (53.639833ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:315: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 image build -t localhost/my-image:functional-248000 testdata/build --alsologtostderr
2024/08/14 17:15:44 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
functional_test.go:315: (dbg) Done: out/minikube-darwin-arm64 -p functional-248000 image build -t localhost/my-image:functional-248000 testdata/build --alsologtostderr: (1.614460833s)
functional_test.go:323: (dbg) Stderr: out/minikube-darwin-arm64 -p functional-248000 image build -t localhost/my-image:functional-248000 testdata/build --alsologtostderr:
I0814 17:15:44.854589    2253 out.go:291] Setting OutFile to fd 1 ...
I0814 17:15:44.854819    2253 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0814 17:15:44.854823    2253 out.go:304] Setting ErrFile to fd 2...
I0814 17:15:44.854825    2253 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0814 17:15:44.854972    2253 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19443-949/.minikube/bin
I0814 17:15:44.855421    2253 config.go:182] Loaded profile config "functional-248000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
I0814 17:15:44.856009    2253 config.go:182] Loaded profile config "functional-248000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
I0814 17:15:44.856893    2253 ssh_runner.go:195] Run: systemctl --version
I0814 17:15:44.856902    2253 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19443-949/.minikube/machines/functional-248000/id_rsa Username:docker}
I0814 17:15:44.878416    2253 build_images.go:161] Building image from path: /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/build.1968432506.tar
I0814 17:15:44.878466    2253 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build
I0814 17:15:44.882200    2253 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/build/build.1968432506.tar
I0814 17:15:44.883896    2253 ssh_runner.go:352] existence check for /var/lib/minikube/build/build.1968432506.tar: stat -c "%s %y" /var/lib/minikube/build/build.1968432506.tar: Process exited with status 1
stdout:

                                                
                                                
stderr:
stat: cannot statx '/var/lib/minikube/build/build.1968432506.tar': No such file or directory
I0814 17:15:44.883911    2253 ssh_runner.go:362] scp /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/build.1968432506.tar --> /var/lib/minikube/build/build.1968432506.tar (3072 bytes)
I0814 17:15:44.891788    2253 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build/build.1968432506
I0814 17:15:44.895324    2253 ssh_runner.go:195] Run: sudo tar -C /var/lib/minikube/build/build.1968432506 -xf /var/lib/minikube/build/build.1968432506.tar
I0814 17:15:44.898512    2253 docker.go:360] Building image: /var/lib/minikube/build/build.1968432506
I0814 17:15:44.898558    2253 ssh_runner.go:195] Run: docker build -t localhost/my-image:functional-248000 /var/lib/minikube/build/build.1968432506
#0 building with "default" instance using docker driver

                                                
                                                
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 97B done
#1 DONE 0.0s

                                                
                                                
#2 [internal] load metadata for gcr.io/k8s-minikube/busybox:latest
#2 DONE 1.0s

                                                
                                                
#3 [internal] load .dockerignore
#3 transferring context: 2B done
#3 DONE 0.0s

                                                
                                                
#4 [internal] load build context
#4 transferring context: 62B done
#4 DONE 0.0s

                                                
                                                
#5 [1/3] FROM gcr.io/k8s-minikube/busybox:latest@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b
#5 resolve gcr.io/k8s-minikube/busybox:latest@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 0.0s done
#5 sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 770B / 770B done
#5 sha256:a77fe109c026308f149d36484d795b42efe0fd29b332be9071f63e1634c36ac9 527B / 527B done
#5 sha256:71a676dd070f4b701c3272e566d84951362f1326ea07d5bbad119d1c4f6b3d02 1.47kB / 1.47kB done
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0B / 828.50kB 0.1s
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 828.50kB / 828.50kB 0.2s
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 828.50kB / 828.50kB 0.2s done
#5 extracting sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0.0s done
#5 DONE 0.3s

                                                
                                                
#6 [2/3] RUN true
#6 DONE 0.1s

                                                
                                                
#7 [3/3] ADD content.txt /
#7 DONE 0.0s

                                                
                                                
#8 exporting to image
#8 exporting layers done
#8 writing image sha256:a4715d07f60ab97ad07292b46b573ecd20243020aedf3902907911fd5f6a35fb done
#8 naming to localhost/my-image:functional-248000 done
#8 DONE 0.0s
I0814 17:15:46.427879    2253 ssh_runner.go:235] Completed: docker build -t localhost/my-image:functional-248000 /var/lib/minikube/build/build.1968432506: (1.529334542s)
I0814 17:15:46.427940    2253 ssh_runner.go:195] Run: sudo rm -rf /var/lib/minikube/build/build.1968432506
I0814 17:15:46.431516    2253 ssh_runner.go:195] Run: sudo rm -f /var/lib/minikube/build/build.1968432506.tar
I0814 17:15:46.434701    2253 build_images.go:217] Built localhost/my-image:functional-248000 from /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/build.1968432506.tar
I0814 17:15:46.434716    2253 build_images.go:133] succeeded building to: functional-248000
I0814 17:15:46.434718    2253 build_images.go:134] failed building to: 
functional_test.go:451: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (1.73s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (1.73s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:342: (dbg) Run:  docker pull kicbase/echo-server:1.0
functional_test.go:342: (dbg) Done: docker pull kicbase/echo-server:1.0: (1.714521292s)
functional_test.go:347: (dbg) Run:  docker tag kicbase/echo-server:1.0 kicbase/echo-server:functional-248000
--- PASS: TestFunctional/parallel/ImageCommands/Setup (1.73s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (0.47s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:355: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 image load --daemon kicbase/echo-server:functional-248000 --alsologtostderr
functional_test.go:451: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (0.47s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (0.37s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:365: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 image load --daemon kicbase/echo-server:functional-248000 --alsologtostderr
functional_test.go:451: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (0.37s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (1.17s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:235: (dbg) Run:  docker pull kicbase/echo-server:latest
functional_test.go:240: (dbg) Run:  docker tag kicbase/echo-server:latest kicbase/echo-server:functional-248000
functional_test.go:245: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 image load --daemon kicbase/echo-server:functional-248000 --alsologtostderr
functional_test.go:451: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (1.17s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.15s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:380: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 image save kicbase/echo-server:functional-248000 /Users/jenkins/workspace/echo-server-save.tar --alsologtostderr
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.15s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.28s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:392: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 image rm kicbase/echo-server:functional-248000 --alsologtostderr
functional_test.go:451: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.28s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:409: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 image load /Users/jenkins/workspace/echo-server-save.tar --alsologtostderr
functional_test.go:451: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.23s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:419: (dbg) Run:  docker rmi kicbase/echo-server:functional-248000
functional_test.go:424: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 image save --daemon kicbase/echo-server:functional-248000 --alsologtostderr
functional_test.go:432: (dbg) Run:  docker image inspect kicbase/echo-server:functional-248000
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.20s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv/bash (0.34s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv/bash
functional_test.go:499: (dbg) Run:  /bin/bash -c "eval $(out/minikube-darwin-arm64 -p functional-248000 docker-env) && out/minikube-darwin-arm64 status -p functional-248000"
functional_test.go:522: (dbg) Run:  /bin/bash -c "eval $(out/minikube-darwin-arm64 -p functional-248000 docker-env) && docker images"
--- PASS: TestFunctional/parallel/DockerEnv/bash (0.34s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.06s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2119: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.06s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2119: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.05s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2119: (dbg) Run:  out/minikube-darwin-arm64 -p functional-248000 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.05s)

                                                
                                    
x
+
TestFunctional/delete_echo-server_images (0.03s)

                                                
                                                
=== RUN   TestFunctional/delete_echo-server_images
functional_test.go:190: (dbg) Run:  docker rmi -f kicbase/echo-server:1.0
functional_test.go:190: (dbg) Run:  docker rmi -f kicbase/echo-server:functional-248000
--- PASS: TestFunctional/delete_echo-server_images (0.03s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.01s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:198: (dbg) Run:  docker rmi -f localhost/my-image:functional-248000
--- PASS: TestFunctional/delete_my-image_image (0.01s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.01s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:206: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-248000
--- PASS: TestFunctional/delete_minikube_cached_images (0.01s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StartCluster (179.24s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StartCluster
ha_test.go:101: (dbg) Run:  out/minikube-darwin-arm64 start -p ha-512000 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=qemu2 
E0814 17:16:05.293462    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:18:21.405789    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:101: (dbg) Done: out/minikube-darwin-arm64 start -p ha-512000 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=qemu2 : (2m59.031566916s)
ha_test.go:107: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 status -v=7 --alsologtostderr
--- PASS: TestMultiControlPlane/serial/StartCluster (179.24s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DeployApp (4.76s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DeployApp
ha_test.go:128: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-512000 -- apply -f ./testdata/ha/ha-pod-dns-test.yaml
ha_test.go:133: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-512000 -- rollout status deployment/busybox
E0814 17:18:49.133211    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:133: (dbg) Done: out/minikube-darwin-arm64 kubectl -p ha-512000 -- rollout status deployment/busybox: (3.058271958s)
ha_test.go:140: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-512000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:163: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-512000 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:171: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-512000 -- exec busybox-7dff88458-54s22 -- nslookup kubernetes.io
ha_test.go:171: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-512000 -- exec busybox-7dff88458-gvccr -- nslookup kubernetes.io
ha_test.go:171: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-512000 -- exec busybox-7dff88458-t25sp -- nslookup kubernetes.io
ha_test.go:181: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-512000 -- exec busybox-7dff88458-54s22 -- nslookup kubernetes.default
ha_test.go:181: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-512000 -- exec busybox-7dff88458-gvccr -- nslookup kubernetes.default
ha_test.go:181: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-512000 -- exec busybox-7dff88458-t25sp -- nslookup kubernetes.default
ha_test.go:189: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-512000 -- exec busybox-7dff88458-54s22 -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-512000 -- exec busybox-7dff88458-gvccr -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-512000 -- exec busybox-7dff88458-t25sp -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiControlPlane/serial/DeployApp (4.76s)

                                                
                                    
x
+
TestMultiControlPlane/serial/PingHostFromPods (0.72s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/PingHostFromPods
ha_test.go:199: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-512000 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:207: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-512000 -- exec busybox-7dff88458-54s22 -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-512000 -- exec busybox-7dff88458-54s22 -- sh -c "ping -c 1 192.168.105.1"
ha_test.go:207: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-512000 -- exec busybox-7dff88458-gvccr -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-512000 -- exec busybox-7dff88458-gvccr -- sh -c "ping -c 1 192.168.105.1"
ha_test.go:207: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-512000 -- exec busybox-7dff88458-t25sp -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-512000 -- exec busybox-7dff88458-t25sp -- sh -c "ping -c 1 192.168.105.1"
--- PASS: TestMultiControlPlane/serial/PingHostFromPods (0.72s)

                                                
                                    
x
+
TestMultiControlPlane/serial/AddWorkerNode (54.13s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/AddWorkerNode
ha_test.go:228: (dbg) Run:  out/minikube-darwin-arm64 node add -p ha-512000 -v=7 --alsologtostderr
ha_test.go:228: (dbg) Done: out/minikube-darwin-arm64 node add -p ha-512000 -v=7 --alsologtostderr: (53.900687333s)
ha_test.go:234: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 status -v=7 --alsologtostderr
--- PASS: TestMultiControlPlane/serial/AddWorkerNode (54.13s)

                                                
                                    
x
+
TestMultiControlPlane/serial/NodeLabels (0.13s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/NodeLabels
ha_test.go:255: (dbg) Run:  kubectl --context ha-512000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
--- PASS: TestMultiControlPlane/serial/NodeLabels (0.13s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterClusterStart (0.24s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterClusterStart
ha_test.go:281: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterClusterStart (0.24s)

                                                
                                    
x
+
TestMultiControlPlane/serial/CopyFile (4.36s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/CopyFile
ha_test.go:326: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 status --output json -v=7 --alsologtostderr
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 cp testdata/cp-test.txt ha-512000:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 cp ha-512000:/home/docker/cp-test.txt /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestMultiControlPlaneserialCopyFile3294755854/001/cp-test_ha-512000.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 cp ha-512000:/home/docker/cp-test.txt ha-512000-m02:/home/docker/cp-test_ha-512000_ha-512000-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000-m02 "sudo cat /home/docker/cp-test_ha-512000_ha-512000-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 cp ha-512000:/home/docker/cp-test.txt ha-512000-m03:/home/docker/cp-test_ha-512000_ha-512000-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000-m03 "sudo cat /home/docker/cp-test_ha-512000_ha-512000-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 cp ha-512000:/home/docker/cp-test.txt ha-512000-m04:/home/docker/cp-test_ha-512000_ha-512000-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000-m04 "sudo cat /home/docker/cp-test_ha-512000_ha-512000-m04.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 cp testdata/cp-test.txt ha-512000-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 cp ha-512000-m02:/home/docker/cp-test.txt /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestMultiControlPlaneserialCopyFile3294755854/001/cp-test_ha-512000-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 cp ha-512000-m02:/home/docker/cp-test.txt ha-512000:/home/docker/cp-test_ha-512000-m02_ha-512000.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000 "sudo cat /home/docker/cp-test_ha-512000-m02_ha-512000.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 cp ha-512000-m02:/home/docker/cp-test.txt ha-512000-m03:/home/docker/cp-test_ha-512000-m02_ha-512000-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000-m03 "sudo cat /home/docker/cp-test_ha-512000-m02_ha-512000-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 cp ha-512000-m02:/home/docker/cp-test.txt ha-512000-m04:/home/docker/cp-test_ha-512000-m02_ha-512000-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000-m04 "sudo cat /home/docker/cp-test_ha-512000-m02_ha-512000-m04.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 cp testdata/cp-test.txt ha-512000-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 cp ha-512000-m03:/home/docker/cp-test.txt /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestMultiControlPlaneserialCopyFile3294755854/001/cp-test_ha-512000-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 cp ha-512000-m03:/home/docker/cp-test.txt ha-512000:/home/docker/cp-test_ha-512000-m03_ha-512000.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000 "sudo cat /home/docker/cp-test_ha-512000-m03_ha-512000.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 cp ha-512000-m03:/home/docker/cp-test.txt ha-512000-m02:/home/docker/cp-test_ha-512000-m03_ha-512000-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000-m02 "sudo cat /home/docker/cp-test_ha-512000-m03_ha-512000-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 cp ha-512000-m03:/home/docker/cp-test.txt ha-512000-m04:/home/docker/cp-test_ha-512000-m03_ha-512000-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000-m04 "sudo cat /home/docker/cp-test_ha-512000-m03_ha-512000-m04.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 cp testdata/cp-test.txt ha-512000-m04:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 cp ha-512000-m04:/home/docker/cp-test.txt /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestMultiControlPlaneserialCopyFile3294755854/001/cp-test_ha-512000-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 cp ha-512000-m04:/home/docker/cp-test.txt ha-512000:/home/docker/cp-test_ha-512000-m04_ha-512000.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000 "sudo cat /home/docker/cp-test_ha-512000-m04_ha-512000.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 cp ha-512000-m04:/home/docker/cp-test.txt ha-512000-m02:/home/docker/cp-test_ha-512000-m04_ha-512000-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000-m02 "sudo cat /home/docker/cp-test_ha-512000-m04_ha-512000-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 cp ha-512000-m04:/home/docker/cp-test.txt ha-512000-m03:/home/docker/cp-test_ha-512000-m04_ha-512000-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p ha-512000 ssh -n ha-512000-m03 "sudo cat /home/docker/cp-test_ha-512000-m04_ha-512000-m03.txt"
--- PASS: TestMultiControlPlane/serial/CopyFile (4.36s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart (79.72s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart
ha_test.go:281: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json
E0814 17:29:44.466121    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/addons-365000/client.crt: no such file or directory" logger="UnhandledError"
E0814 17:29:55.358245    1404 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19443-949/.minikube/profiles/functional-248000/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:281: (dbg) Done: out/minikube-darwin-arm64 profile list --output json: (1m19.723138625s)
--- PASS: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart (79.72s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.05s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd
ha_test.go:281: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.05s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (3.68s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 stop -p json-output-868000 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-darwin-arm64 stop -p json-output-868000 --output=json --user=testUser: (3.675400834s)
--- PASS: TestJSONOutput/stop/Command (3.68s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.2s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-darwin-arm64 start -p json-output-error-451000 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p json-output-error-451000 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (94.895958ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"2c06835f-6c70-4f03-be4e-36eb4ccf321c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-451000] minikube v1.33.1 on Darwin 14.5 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"75c99b9a-7852-42d8-bdac-fa34e1814a1e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19443"}}
	{"specversion":"1.0","id":"86a5cfdb-d8b3-4263-8aaf-53a9545e4892","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig"}}
	{"specversion":"1.0","id":"54a4fdd9-710c-419a-8fdb-14fb75ce1f75","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-arm64"}}
	{"specversion":"1.0","id":"65e058c3-f2bc-49dd-acb3-85301e3f4beb","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"7c4ea87d-b372-4dbf-ae83-2f25b75f224d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube"}}
	{"specversion":"1.0","id":"236be17d-7651-43ba-973b-55c9fa3ddb8f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"ff4e5313-cf84-472e-a5fa-fe2c8d180138","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on darwin/arm64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-451000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p json-output-error-451000
--- PASS: TestErrorJSONOutput (0.20s)

                                                
                                    
x
+
TestMainNoArgs (0.03s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-darwin-arm64
--- PASS: TestMainNoArgs (0.03s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (1.27s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (1.27s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (0.88s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:206: (dbg) Run:  out/minikube-darwin-arm64 logs -p stopped-upgrade-504000
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (0.88s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.1s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-darwin-arm64 start -p NoKubernetes-707000 --no-kubernetes --kubernetes-version=1.20 --driver=qemu2 
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p NoKubernetes-707000 --no-kubernetes --kubernetes-version=1.20 --driver=qemu2 : exit status 14 (96.813708ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-707000] minikube v1.33.1 on Darwin 14.5 (arm64)
	  - MINIKUBE_LOCATION=19443
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19443-949/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19443-949/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.10s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.04s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-darwin-arm64 ssh -p NoKubernetes-707000 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-darwin-arm64 ssh -p NoKubernetes-707000 "sudo systemctl is-active --quiet service kubelet": exit status 83 (39.506875ms)

                                                
                                                
-- stdout --
	* The control-plane node NoKubernetes-707000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p NoKubernetes-707000"

                                                
                                                
-- /stdout --
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.04s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (0.1s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-darwin-arm64 profile list
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-darwin-arm64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (0.10s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (3.11s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-darwin-arm64 stop -p NoKubernetes-707000
no_kubernetes_test.go:158: (dbg) Done: out/minikube-darwin-arm64 stop -p NoKubernetes-707000: (3.111840834s)
--- PASS: TestNoKubernetes/serial/Stop (3.11s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.04s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-darwin-arm64 ssh -p NoKubernetes-707000 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-darwin-arm64 ssh -p NoKubernetes-707000 "sudo systemctl is-active --quiet service kubelet": exit status 83 (42.461333ms)

                                                
                                                
-- stdout --
	* The control-plane node NoKubernetes-707000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p NoKubernetes-707000"

                                                
                                                
-- /stdout --
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.04s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (2.77s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-arm64 stop -p old-k8s-version-637000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-arm64 stop -p old-k8s-version-637000 --alsologtostderr -v=3: (2.771257042s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (2.77s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.12s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-637000 -n old-k8s-version-637000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-637000 -n old-k8s-version-637000: exit status 7 (58.806542ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-arm64 addons enable dashboard -p old-k8s-version-637000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.12s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (3.37s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-arm64 stop -p no-preload-064000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-arm64 stop -p no-preload-064000 --alsologtostderr -v=3: (3.373131416s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (3.37s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.12s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-064000 -n no-preload-064000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-064000 -n no-preload-064000: exit status 7 (55.583458ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-arm64 addons enable dashboard -p no-preload-064000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.12s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (3.57s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-arm64 stop -p default-k8s-diff-port-559000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-arm64 stop -p default-k8s-diff-port-559000 --alsologtostderr -v=3: (3.572963334s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (3.57s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.12s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-559000 -n default-k8s-diff-port-559000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-559000 -n default-k8s-diff-port-559000: exit status 7 (56.827958ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-arm64 addons enable dashboard -p default-k8s-diff-port-559000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.12s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.06s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-arm64 addons enable metrics-server -p newest-cni-973000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.06s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (2.86s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-arm64 stop -p newest-cni-973000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-arm64 stop -p newest-cni-973000 --alsologtostderr -v=3: (2.863689583s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (2.86s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.12s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-973000 -n newest-cni-973000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-973000 -n newest-cni-973000: exit status 7 (50.427167ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-arm64 addons enable dashboard -p newest-cni-973000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.12s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (3.53s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-arm64 stop -p embed-certs-349000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-arm64 stop -p embed-certs-349000 --alsologtostderr -v=3: (3.524968625s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (3.53s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.13s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-349000 -n embed-certs-349000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-349000 -n embed-certs-349000: exit status 7 (59.130834ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-arm64 addons enable dashboard -p embed-certs-349000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.13s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    

Test skip (21/274)

x
+
TestDownloadOnly/v1.20.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.20.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.20.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.31.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.31.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnlyKic (0s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:220: skipping, only for docker or podman driver
--- SKIP: TestDownloadOnlyKic (0.00s)

                                                
                                    
x
+
TestAddons/parallel/HelmTiller (0s)

                                                
                                                
=== RUN   TestAddons/parallel/HelmTiller
=== PAUSE TestAddons/parallel/HelmTiller

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:446: skip Helm test on arm64
--- SKIP: TestAddons/parallel/HelmTiller (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:500: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestDockerEnvContainerd (0s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with docker false darwin arm64
docker_test.go:172: skipping: TestDockerEnvContainerd can only be run with the containerd runtime on Docker driver
--- SKIP: TestDockerEnvContainerd (0.00s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
driver_install_or_update_test.go:41: Skip if not linux.
--- SKIP: TestKVMDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1787: arm64 is not supported by mysql. Skip the test. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestFunctional/parallel/MySQL (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:550: only validate podman env with docker container runtime, currently testing docker
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestKicCustomNetwork (0s)

                                                
                                                
=== RUN   TestKicCustomNetwork
kic_custom_network_test.go:34: only runs with docker driver
--- SKIP: TestKicCustomNetwork (0.00s)

                                                
                                    
x
+
TestKicExistingNetwork (0s)

                                                
                                                
=== RUN   TestKicExistingNetwork
kic_custom_network_test.go:73: only runs with docker driver
--- SKIP: TestKicExistingNetwork (0.00s)

                                                
                                    
x
+
TestKicCustomSubnet (0s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:102: only runs with docker/podman driver
--- SKIP: TestKicCustomSubnet (0.00s)

                                                
                                    
x
+
TestKicStaticIP (0s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:123: only run with docker/podman driver
--- SKIP: TestKicStaticIP (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestInsufficientStorage (0s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:38: only runs with docker driver
--- SKIP: TestInsufficientStorage (0.00s)

                                                
                                    
x
+
TestMissingContainerUpgrade (0s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
version_upgrade_test.go:284: This test is only for Docker
--- SKIP: TestMissingContainerUpgrade (0.00s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (2.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:626: 
----------------------- debugLogs start: cilium-672000 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-672000

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-672000

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-672000

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-672000

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-672000

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-672000

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-672000

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-672000

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-672000

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-672000

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-672000

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-672000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-672000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-672000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-672000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-672000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-672000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-672000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-672000" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-672000

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-672000

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-672000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-672000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-672000

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-672000

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-672000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-672000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-672000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-672000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-672000" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-672000

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-672000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-672000"

                                                
                                                
----------------------- debugLogs end: cilium-672000 [took: 2.173042834s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-672000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p cilium-672000
--- SKIP: TestNetworkPlugins/group/cilium (2.28s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.1s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-051000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p disable-driver-mounts-051000
--- SKIP: TestStartStop/group/disable-driver-mounts (0.10s)

                                                
                                    
Copied to clipboard